Top 766 kafka open source projects

Simplifying Kafka for ruby apps

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

《Kafka技术内幕》代码

Kafka web UI

Write your Spark data to Kafka seamlessly

light, fast, scalable, streaming microservices made easy

Collection of Kubernetes Operators built with KUDO.

Java SDK for CloudEvents

.NET Stream Processing Library for Apache Kafka 🚀

A search framework and multi-tenant search platform based on java, kafka, kafka connect, elasticsearch

Mirus is a cross data-center data replication tool for Apache Kafka

一站式Apache Kafka集群指标监控与运维管控平台

Spark Structured Streaming / Kafka / Cassandra / Elastic

Source code for the Kafka Streams in Action Book

Use Kafka as a remote storage database for Prometheus (remote write only)

MongoDB Kafka Connector

大数据分析可视化实践

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

An Hexagonal Architecture with DDD + Aggregates + Event Sourcing using .NET Core, Kafka e MongoDB (Blog Engine)

本人的RabbitMQ和Kafka详细笔记以及示例代码

Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro

Confluent's Apache Kafka .NET client

我,请始皇[打钱]是一个前后端分离的工具人系统，项目采用 SpringBoot+Go+Vue 开发，项目加入常见的企业级应用所涉及到的技术点，例如 Redis、RabbitMQ 等(主要是多用用工具多踩踩坑)。

Laravel Enqueue message queue extension. Supports AMQP, Amazon SQS, Kafka, Google PubSub, Redis, STOMP, Gearman, Beanstalk and others

Parallel Apache Kafka client wrapper with client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

Apollo graphql subscriptions over Kafka protocol

Redpanda is the real-time engine for modern apps. Kafka API Compatible; 10x faster 🚀 See more at vectorized.io/redpanda

Kafka Connect suite of connectors for Cloud storage (Amazon S3)

Modern and performant Kafka client library for Ruby based on librdkafka

StreamLine - Streaming Analytics

Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...

🥚 Netty实践学习案例，见微知著！带着你的心，跟着教程。我相信你行欧。

PHP Kafka client is used in PHP-FPM and Swoole. PHP Kafka client supports 50 APIs, which might be one that supports the most message types ever.

A easy and high-performance monitoring system, for comprehensive monitoring and management of kafka cluster.

A kafka command line browser

Kafka ecosystem ... but step by step!

🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

A modern Apache Kafka client for node.js

Sample Event Sourcing implementation with .NET Core

汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识

Everything about Apache Kafka

Kafka Tutorials microsite

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Apache Kafka on Docker

Instagram Clone - Cloning Instagram for learning purpose

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Big Data Toolkit for the JVM

Confluent REST Proxy for Kafka

Playground for Kafka/Confluent Docker experimentations

Syslog Collector written in Go, streams to Kafka 0.8

Apache Kafka bridge

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

WaterDrop is a standalone Karafka component library for generating Kafka messages

Secor is a service implementing Kafka log persistence

Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.

Node.js bindings for librdkafka

🦄 开源社区系统：基于 SpringBoot + MyBatis + MySQL + Redis + Kafka + Elasticsearch + Spring Security + ... 并提供详细的开发文档和配套教程。包含帖子、评论、私信、系统通知、点赞、关注、搜索、用户设置、数据统计等模块。

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Samsara is a real-time analytics platform