Top 766 kafka open source projects

A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka

Python Stream Processing

A cohesive & pragmatic framework of FP centric Scala libraries

Learn Kafka Streams with several examples!

DoctorK is a service for Kafka cluster auto healing and workload balancing

A lightweight stream processing library for Go

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

gRPC/REST proxy for Kafka

A fast data collector in Rust

分布式架构开发套件。包括缓存(一二级缓存、自动缓存管理)、队列、分布式定时任务、文件服务(七牛、阿里云OSS、fastDFS)、日志、搜索、分布式锁、分布式事务、集成dubbo、spring boot支持以及常用的工具包等。

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

java-study 是本人学习Java过程中记录的一些代码！从Java基础的数据类型、jdk1.8的Lambda、Stream和日期的使用、 IO流、数据集合、多线程使用、并发编程、23种设计模式示例代码、常用的工具类， 以及一些常用框架，netty、mina、springboot、kafka、storm、zookeeper、redis、elasticsearch、hbase、hive等等。

The Apache Kafka C/C++ library

程序员进阶书籍（视频），持续更新（Programmer Books）

Kafka Connect Elasticsearch connector

dnc 去中心化 开源社区 轻联盟 dncto.com QQ群 779699538

Rust client for Apache Kafka

asyncio client for kafka

Kafka-based Job Queue for Python

A swiss army knife CLI tool for interacting with Kafka, RabbitMQ and other messaging systems.

Real Time Analytics and Data Pipelines based on Spark Streaming

✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索等必备技能

golang版本的hangout, 希望能省些内存. 使用了自己写的Kafka lib .. 虚. 不过我们在生产环境已经使用近1年, kafka 版本从0.9.0.1到2.0都在使用, 目前情况稳定. 吞吐量在每天2000亿条以上.

Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern

Apache Kafka client library for Erlang/Elixir

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

Oh no! Yet another Kafka operator for Kubernetes

A community-developed, free, open source, microservices API automation and load testing framework built using JUnit core runners for Http REST, SOAP, Security, Database, Kafka and much more. Zerocode Open Source enables you to create, change, orchestrate and maintain your automated test cases declaratively with absolute ease.

Comprehensive guide to a couple of possible ways of synchronizing two states with Spring tools. Synchronization is shown by separating command and queries in a simple CQRS application.

用java实现一下Logstash的几个常用input/filter/output, 希望能有效率上面的大提升. 现在我们迁移到golang了 https://github.com/childe/gohangout

Kafka client library for Elixir

Create low-latency, interactive user experiences for stateless microservices.

Container auto-configurations for spring-boot based integration tests

The high-scalability sFlow/NetFlow/IPFIX collector used internally at Cloudflare.

Python client for Apache Kafka

Distributed Named Pipes

Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

Java源码分析 【源码笔记】专注于Java后端系列框架的源码分析，每周持续推出Java后端系列框架的源码分析文章。

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

The database purpose-built for stream processing applications.

SpringBoot框架源码实战（已更新到springboot2版本实现）~基本用法，Rest，Controller，事件监听，连接数据库MySQL，jpa，redis集成，mybatis集成（声明式与xml两种方式~对应的添删查改功能），日志处理，devtools配置，拦截器用法，资源配置读取，测试集成，Web层实现请求映射，security安全验证，rabbitMq集成，kafka集成，分布式id生成器等。项目实战：https://github.com/hemin1003/yfax-parent 已投入生产线上使用

🎉🎉🎉JAVA高级架构师技术栈==任何技能通过 “刻意练习” 都可以达到融会贯通的境界，就像烹饪一样，这里有一份JAVA开发技术手册，只需要增加自己练习的次数。🏃🏃🏃

In this repository, I have developed the entire server-side principal architecture for real-time stock market prediction with Machine Learning. I have used Tensorflow.js for constructing ml model architecture, and Kafka for real-time data streaming and pipelining.

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Modern C++ Apache Kafka client library (wrapper for librdkafka)

Kasper is a lightweight library for processing Kafka topics.

【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch

Kafka Connect HDFS connector

A list about Apache Kafka

spring、spring-boot、spring-cloud 常用整合用例

Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻

End-to-end encrypted messaging and mutual authentication between cloud and edge-device applications

Very simplified insurance sales system made in a microservices architecture using Micronaut

基于 scrapy-redis 的通用分布式爬虫框架

Web tool for Kafka Connect |

Kafka 中文文档

🚀 Web GUI for Kafka Cluster Management

Mirror of Apache Kafka

C++ Parallel Computing and Asynchronous Networking Engine

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!