398 Open source projects that are alternatives of or similar to Awesome Kafka

Files needed to try out KSQL Recipes for yourself

Streaming reactive and dataflow graphs in Python

Learn the Confluent Schema Registry & REST Proxy

syncClient，数据实时同步中间件（同步mysql到kafka、redis、elasticsearch、httpmq）！

This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.

Materialize lets you ask questions of your live data, which it answers and then maintains for you as your data continue to change. The moment you need a refreshed answer, you can get it in milliseconds. Materialize is designed to help you interactively explore your streaming data, perform data warehousing analytics against live relational data, or just increase the freshness and reduce the load of your dashboard and monitoring tasks.

A python wrapper for the KSQL REST API.

An actor framework for Go

weiboAd Infrastructure Data Processor : kafka consumer embedded Lua scripting language in data process framework

以教学为目的的电商系统。包含ToB复杂业务、互联网高并发业务、缓存应用；DDD、微服务指导。模型驱动、数据驱动。了解大型服务进化路线，编码技巧、学习Linux，性能调优。Docker/k8s助力、监控、日志收集、中间件学习。前端技术、后端实践等。主要技术：SpringBoot+JPA+Mybatis-plus+Antd+Vue3。

Instagram Clone - Cloning Instagram for learning purpose

The Kafka CLI for humans

MySQL to NoSQL real time dataflow

Asky开源架构：极简、轻量、极致性能《Asky零基础1小时学编程 dnc+vue+tidb+redis+rabbitMQ+ES》QQ群 779699538

A Clojure DSL for Kafka Streams

基于Spring Cloud（Greenwich.SR2）搭建的微服务脚手架（适用于在线系统），已集成注册中心（Nacos Config）、配置中心（Nacos Discovery）、认证授权（Oauth 2 + JWT）、日志处理（ELK + Kafka）、限流熔断（AliBaba Sentinel）、应用指标监控（Prometheus + Grafana）、调用链监控（Pinpoint）、以及Spring Boot Admin。

必看！java后端，亮剑诛仙。java发展路线技术要点。

Sample Application DDD, Reactive Microservices, CQRS Event Sourcing Powered by DERMAYON LIBRARY

My own version of r/place, done in a weekend

我的个人技术博客（Python、Django、Docker、Go、Redis、ElasticSearch、Kafka、Linux）

Apache Kafka support for Ruby Object Mapper

QMQ是去哪儿网内部广泛使用的消息中间件，自2012年诞生以来在去哪儿网所有业务场景中广泛的应用，包括跟交易息息相关的订单场景； 也包括报价搜索等高吞吐量场景。

kafka php client

Sync data from the other DB to ClickHouse(cluster)

Distributed Stream and Batch Processing

♒︎ [WIP] An experimental ~distributed~ commit-log

推荐项目（实时推荐和离线推荐）

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Serverless Platform for the stateful services

General purpose bitemporal database for SQL, Datalog & graph queries

Reactive (RSocket/gRPC) Gateway for the event-based systems

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Thin Scala wrapper around Kafka Streams Java API

KafkaFlow is a .NET framework to consume and produce Kafka messages with multi-threading support. It's very simple to use and very extendable. You just need to install, configure, start/stop the bus with your app and create a middleware/handler to process the messages.

Proxy connections to Kafka cluster. Connect through SOCKS Proxy, HTTP Proxy or to cluster running in Kubernetes.

A resilient and scalable shopping cart system designed using Event Sourcing (ES) and Command Query Responsibility Segregation (CQRS)

High throughput asynchronous task processing on Apache Kafka

Distributed Prometheus time series database

Schema Registry

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Scala DSL for Unit-Testing Processing Topologies in Kafka Streams

Apache Kafka bridge

Kafka consumer lag-checking application for monitoring, written in Scala and Akka HTTP; a wrap around the Kafka consumer group command. Integrations with Cloudwatch and Datadog. Authentication recently added

KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

A set of tools and examples to run a flow-pipeline (sFlow, NetFlow)

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

深圳地铁大数据客流分析系统🚇🚄🌟

Simplifying Kafka for ruby apps

CMAK is a tool for managing Apache Kafka clusters

👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/

Kafka Tutorials microsite

Apache Kafka on Docker

Confluent REST Proxy for Kafka

Node.js bindings for librdkafka

PG数据同步工具（Java实现）

A solution to help you build automation and gitops in your Apache Kafka deployments. The Kafka gitops!

SpringBoot 整合各类框架和应用

🚀 Web GUI for Kafka Cluster Management