985 Open source projects that are alternatives of or similar to Awesome Kafka

A toolkit for creating and managing declarative, self-healing infrastructure.

Companion scripts to VPC tutorials

Racecar: a simple framework for Kafka consumers in Ruby

A library to compute histograms on distributed environments, on streaming data

Little DSL to make data processing sane with clojure.spec and spec-tools

Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/

KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.

A high-performance observability data pipeline.

An opinionated clojure framework for writing kafka machines

End-to-end encrypted messaging and mutual authentication between cloud and edge-device applications

Efficient, easy-to-use, and fast PHP JSON stream parser

Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

Twitter Dynamic Dataset Api. Create any dataset YOU want.

Template based Kafka topic/cluster/ACL management

A framework for processing adsorption data and isotherm fitting

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

A resilient Ethereum event listener that bridges your smart contract events and backend microservices

curated list of awesome tools and libraries for specific domains

Open Source Computer Vision with TensorFlow, MiniFi, Apache NiFi, OpenCV, Apache Tika and Python For processing images from IoT devices like Raspberry Pis, NVidia Jetson TX1, NanoPi Duos and more which are equipped with attached cameras or external USB webcams, we use Python to interface via OpenCV and PiCamera. From there we run image processin…

A tool for deploying Azure infrastructure based on proven practices. Azure building blocks take advantage of the Azure CLI and Azure Resource Manager templates to provision collections of resources as logical units with production-ready settings.

Remote Sensing and GIS Software Library; python module tools for processing spatial data.

Spark in Action, 2nd edition - chapter 1 - Introduction

Kafka input and output plugin for Fluentd

anmolnagpal.com/infrastructure-as-code

Kafka UI and Monitoring Tool

The Kubernetes Operator for Netris

Apache Spark Course Material

A simple and lightweight JavaScript data processing tool. Live demo:

A framework and application for network observability

Big Data Management and Analysis Final Project

The Internals of Spark SQL

Kafka library in Go

ARTML- Real time learning

Twitter Streaming API Example with Kafka Streams in Scala

OpenSource self-service infrastructure solution that defines and manages the complete lifecycle of resources used and provisioned into a cloud! It is a terraform UI with rest api for terraform automation

An event-driven monitoring tool that can consume messages from Apache Kafka clusters and display the aggregated data on a dashboard for analysis and maintenance.

Dataset format for AI. Build, manage, & visualize datasets for deep learning. Stream data real-time to PyTorch/TensorFlow & version-control it. https://activeloop.ai

Converting data from services like Censys and Shodan to a common data model

High-Performance Erlang Stream Processor

Yelp's internal caching proxy, powered by Nginx and OpenResty at its core

Kooper is a simple Go library to create Kubernetes operators and controllers.

Terraform provider for automating Cisco ACI enabled networks

3D Visualization of a Kubernetes Cluster

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

A Data Engineering & Machine Learning Knowledge Hub

CLI tool to see redis memory usage by keys in hierarchical way. Think of disk inventory but for redis.

Provisioning app, which triggers project and component provisions (including Jira / Confluence / BitBucket and OCP resource creation)

Clojure Command-line Data Processor for JSON, YAML, EDN, XML and more

A repository containing scripts for managing infrastructure

A boilerplate for writing PySpark Jobs

Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!

This is a quick script installation for resilient redirector using nginx reverse proxy and letsencrypt compatible with some popular Post-Ex Tools (Cobalt Strike, Empire, Metasploit, PoshC2).

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

(RETIRED) Azure 70-533 Certification Practice Test

Baleen 3 is a data processing tool based on the Annot8 framework

A collection of basic usability component tools dedicated to providing micro-services and single services, drawing on some excellent open source project features such as kratos, go-kit, mosn, sentinel, gopkg core components. I hope you will use and mention issue and pr more often.

A Pythonic and ultra fast template engine DSL.

Kafka storage rebalancing, automated replication throttle, cluster API and more