985 Open source projects that are alternatives of or similar to Awesome Kafka

Kafka Tutorials microsite

A lightweight stream processing library for Go

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.

A REPL for Apache Kafka

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Open-Source Web GUI for Apache Kafka Management

When Apache Pulsar meets Apache Spark

🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

Demo applications and code examples for Confluent Platform and Apache Kafka

Materials (slides and code) for Kafka and Kafka Streams Workshop

Kattlo CLI Project

A high performance/ real-time C++ Kafka streams framework (C++17)

Source code for the Kafka Streams in Action Book

Python Stream Processing

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Fancy stream processing made operationally mundane

Building event-driven applications the easy way in Go.

Kafka Connect HDFS connector

Modern C++ Apache Kafka client library (wrapper for librdkafka)

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

The Apache Kafka C/C++ library

Kafka command line tool that likes JSON

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Apache Kafka running on Kubernetes

A curated list of Pulsar tools, integrations and resources.

Kafka-based Job Queue for Python

Thin Scala wrapper around Kafka Streams Java API

Framework for Apache Kafka based Ruby and Rails applications development.

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

WaterDrop is a standalone Karafka component library for generating Kafka messages

Kafka 한국 사용자 모임에서 운영하는 meetup repository

🚀 Web GUI for Kafka Cluster Management

Apache Kafka Web UI for exploring messages, consumers, configurations and more with a focus on a good UI & UX.

Azure Event Hubs for Apache Kafka Ecosystems

Scala DSL for Unit-Testing Processing Topologies in Kafka Streams

Command Line Tool for managing Apache Kafka

docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

Astronomy Broker based on Apache Spark

The magic message bus

Event-Driven microservices with Kafka Streams

Open Source Phasor Data Concentrator

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

a payment application intended for deployment by the united states treasury

Repository for integration with Apache Kafka

This repository contains the code base for the Open Stream Processing Benchmark.

Stream Processing Made Easy

Apache Pulsar Adapters

A simple and eloquent workflow for streaming messages to micro-services.

This repository contains a set of examples to be used with Red Hat AMQ messaging suite components.

Simple demonstration of how to build a complex real time machine learning visualization tool.

A curated list of awesome big data frameworks, ressources and other awesomeness.