Top 766 kafka open source projects

Kafka UI and Monitoring Tool

全栈工程师手册

Web tool for Avro Schema Registry |

Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)

Kafka storage rebalancing, automated replication throttle, cluster API and more

基于Gradle构建，使用SpringBoot在各个场景的应用，包括集成消息中间件、前后端分离、数据库、缓存、分布式锁、分布式事务等

A Microservice Toolkit from The New York Times

Bitnami Docker Image for Kafka

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Get a stream of issues and pull requests for your chosen GitHub repository

Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具

Racecar: a simple framework for Kafka consumers in Ruby

Gathers scalable tensorflow and infrastructure deployment

Kafka library in Go

Full-featured web-based Apache Kafka consumer UI

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

A Kafka Operator for Kubernetes

A CLI tool for Kafka

Surging is a micro-service engine that provides a lightweight, high-performance, modular RPC request pipeline. The service engine supports http, TCP, WS,Grpc, Thrift,Mqtt, UDP, and DNS protocols. It uses ZooKeeper and Consul as a registry, and integrates it. Hash, random, polling, Fair Polling as a load balancing algorithm, built-in service gove…

A library that provides an in-memory Kafka instance to run your tests against.

Experimental CQRS and Event Sourcing service

Ansible playbooks for the Confluent Platform

Fancy stream processing made operationally mundane

提供各种客户端接入阿里云 消息队列 Kafka 的demo工程

Confluent Platform Demo including Apache Kafka, ksqlDB, Control Center, Replicator, Confluent Schema Registry, Security

SpringCloud构建实战、从入门到高级，包含eureka、zuul、gateway、feign、ribbon、hystrix、mq、turbine、nacos、elk、consul、zookeeper、rocketmq、kafka、分布式事务(RocketMq、LCN、Seata)、分库分表(Sharding-JDBC)、分布式锁(Redis、Guava)、jwt、SkyWalking、Zipkin、bootadmin等使用案例

KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.

A resilient Ethereum event listener that bridges your smart contract events and backend microservices

The Apache Kafka Client SDK

Kafka input and output plugin for Fluentd

Manage your Kafka ACL at scale

Divolte Collector

🎩 Most advanced high level Node.js Kafka client

Terraform provider for managing Apache Kafka Topics + ACLs

Complex Event Processing on top of Kafka Streams

本项目已迁移至 github.com/jetlinks

Easily load data from kafka to ClickHouse

Kafka Source Connector For Oracle

Alink is the Machine Learning algorithm platform based on Flink, developed by the PAI team of Alibaba computing platform.

Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.

Gradle plugin to interact with Confluent Schema-Registry.

Karafka WaterDrop and Sidekiq backend example application

CLI tool and Go client library for the Kafka Connect REST API

Utility tool for managing kafka

A SQL-like language for performing ETL transformations.

SpringCloud(Hoxton.SR5) + SpringBoot(2.3.0.RELEASE)的 SaaS型微服务后端脚手架。授权中心开发完毕。文档地址：https://www.kancloud.cn/hanzo/hanzo

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

Scheduler for delayed messages to Kafka topics

An application that records stats about consumer group offset commits and reports them as prometheus metrics

Showcases how to build a small Event-sourced application using Spring Boot, Spring Kafka, Apache Avro and Apache Kafka

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

springboot集成kafka

Kafka Connector for DynamoDB [unmaintained]

Kafka Flow Retry Patterns Extensions

OAuth2 support for Apache Kafka to work with many OAuth2 authorization servers

Perl implementation of Kafka API (official CPAN module)

Code snippets that demonstrate how to leverage the new Kafka 0.11 APIs

Docker build project to setup a lightweight hadoop cluster containing hadoop, pig, zookeeper, hbase, phoenix, storm, kafka, kafka manager

Sandwich Daemon is the middle man between discord and your microserviced bot. Handles gateway, state and provides a dashboard.