398 Open source projects that are alternatives of or similar to Awesome Kafka

docker compose files to create a fully working kafka stack

❤for real-time DataOps - where the application and data fabric blends - Lenses

Avro SerDe for Apache Spark structured APIs.

Load data from Kafka to any data warehouse

一个涵盖六个专栏：Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖，右上角来个 Star，感恩 1024

Community driven, reusable components for distributed apps

A collection of kafka-resources

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Reliable messages resolve distributed transactions

Neo4j Kafka Integrations, Docs =>

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

An opinionated Elixir wrapper around brod, the Erlang Kafka client, that supports encrypted connections to Heroku Kafka out of the box.

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

a command-line Protobuf parser with Kafka support and JSON output

Syslog Collector written in Go, streams to Kafka 0.8

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors

Metronome is a distributed and fault-tolerant event scheduler

The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

This repo contains my notes on working with Go and computer systems.

Python Stream Processing. A Faust fork

Bireme is an incremental synchronization tool for the Greenplum / HashData data warehouse

Secor is a service implementing Kafka log persistence

Machine Learning Platform and Recommendation Engine built on Kubernetes

Azure Event Hubs for Apache Kafka Ecosystems

Production-ready, stable Kafka client for PHP

Superman是什么：构建Java 高级开发技术的知识体系，从基础不断打怪升级成为超人之路（更新中.......）

🦄 开源社区系统：基于 SpringBoot + MyBatis + MySQL + Redis + Kafka + Elasticsearch + Spring Security + ... 并提供详细的开发文档和配套教程。包含帖子、评论、私信、系统通知、点赞、关注、搜索、用户设置、数据统计等模块。

Kafka Zookeeper RESTful API to perform topic/consumer group administration/metric(offset\lag\message) collection and monitor

Playground for Kafka/Confluent Docker experimentations

Apache Spark and Apache Kafka integration example

Samsara is a real-time analytics platform

Learn the Confluent Schema Registry & REST Proxy

Instagram Clone - Cloning Instagram for learning purpose

My own version of r/place, done in a weekend

KafkaFlow is a .NET framework to consume and produce Kafka messages with multi-threading support. It's very simple to use and very extendable. You just need to install, configure, start/stop the bus with your app and create a middleware/handler to process the messages.

Apache Kafka bridge

CMAK is a tool for managing Apache Kafka clusters

This library wraps Kafka's embedded test cluster, allowing you to more easily create and run integration tests using JUnit against a "real" kafka server running within the context of your tests. No need to stand up an external kafka cluster!

Kafka Connect Tooling

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Distributed Java game server, including login, gateway, game demo

all kinds of scrapy demo

支持mysql、MongoDB数据变更订阅分发

WaterDrop is a standalone Karafka component library for generating Kafka messages

Confluent Schema Registry for Kafka

Bro IDS Dockerfile

Golang Kafka consumer and producer example

Big Data Toolkit for the JVM

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

python通用分布式函数调度框架 pip install function_scheduling_distributed_framework

syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.

Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.

[https://www.sofineday.com], golang项目开发脚手架,集成最佳实践(gin+gorm+go-redis+mongo+cors+jwt+json日志库zap(支持日志收集到kafka或mongo)+消息队列kafka+微信支付宝支付gopay+api加密+api反向代理+go modules依赖管理+headless爬虫chromedp+makefile+二进制压缩+livereload热加载)

Kafka Tutorials microsite

Apache Kafka on Docker

Confluent REST Proxy for Kafka

Node.js bindings for librdkafka

PG数据同步工具（Java实现）