dharmeshkakadia / Awesome Kafka
Everything about Apache Kafka
Stars: ✭ 144
Projects that are alternatives of or similar to Awesome Kafka
Components Contrib
Community driven, reusable components for distributed apps
Stars: ✭ 131 (-9.03%)
Mutual labels: kafka
Kafka Connect Mongodb
**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
Stars: ✭ 137 (-4.86%)
Mutual labels: kafka
Azure Event Hubs Spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Stars: ✭ 140 (-2.78%)
Mutual labels: kafka
Aliyun Emapreduce Datasources
Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.
Stars: ✭ 132 (-8.33%)
Mutual labels: kafka
Secor
Secor is a service implementing Kafka log persistence
Stars: ✭ 1,728 (+1100%)
Mutual labels: kafka
Syslog Gollector
Syslog Collector written in Go, streams to Kafka 0.8
Stars: ✭ 138 (-4.17%)
Mutual labels: kafka
Metronome
Metronome is a distributed and fault-tolerant event scheduler
Stars: ✭ 131 (-9.03%)
Mutual labels: kafka
Oryx
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Stars: ✭ 1,785 (+1139.58%)
Mutual labels: kafka
Waterdrop
WaterDrop is a standalone Karafka component library for generating Kafka messages
Stars: ✭ 136 (-5.56%)
Mutual labels: kafka
Echo
🦄 开源社区系统：基于 SpringBoot + MyBatis + MySQL + Redis + Kafka + Elasticsearch + Spring Security + ... 并提供详细的开发文档和配套教程。包含帖子、评论、私信、系统通知、点赞、关注、搜索、用户设置、数据统计等模块。
Stars: ✭ 129 (-10.42%)
Mutual labels: kafka
Goka
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
Stars: ✭ 1,862 (+1193.06%)
Mutual labels: kafka
Kafka Docker Playground
Playground for Kafka/Confluent Docker experimentations
Stars: ✭ 140 (-2.78%)
Mutual labels: kafka
My Moments
Instagram Clone - Cloning Instagram for learning purpose
Stars: ✭ 140 (-2.78%)
Mutual labels: kafka
awesome-kafka
Everything about Apache Kafka
Share your Kafka ❤️ through pull requests :)
What can you expect to see here?
Development
Client libraries
- Go
- Go
- Go
- Go Kafka streaming
- Node
- Node
- Node
- Node Kafka streams
- Node librdkafka
- Php
- Php
- Perl
- Python (asyncio)
- Python (kafka-python)
- Python (pykafka)
- Ruby
- Phobos - Ruby App framework
- Karafka - Ruby and Rails framework
- Dart
- JRuby
- Elixir
- Erlang
- Rust
- LinkedIn wrapper library
- kasper - a lightweight library for processing Kafka topics
- and others
Kafka Streams Libraries
KSQL
Connectors
- JDBC
- Elasticsearch
- HDFS
- Beast - Kafka to BigQuery Sink
- BigQuery
- SQL
- GCloud pubsub
- BigTable
- Google Cloud Storage (GCS)
- HBase
- FileSystem
- Streaming files from a local filesystem
- kafka-connect-protobuf-converter
- IBM MQ Source
- IBM MQ Sink
- Azure IoT Hub
- Pulsar
- HTTP
Producers
Consumers
Transformations
Testing
- Mocked Streams - Topology testing library for Kafka Streams (no broker required)
- Unit-testing for embedded kafka services
- Synthetic avro message generator for Kafka
- Kafka JUnit
- Kafka Unit
- Kafka for JUnit
- embedded-kafka - in-memory Kafka instance to run your tests against
- Kafka Containers
Operations
CI/CD
Operational Utilities
- Cruise control
- DoctorKafka
- Brucke - Inter-cluster bridge of kafka topics
- Kafka-Kit
- Secor - service for persisting Kafka logs
- kafkabalancer
- Yelp Kafka-Utils
- Cerner Common Kafka utilities
- connectctl - manage kafka connect connectors easily
Monitoring
- Kafka Offset Exporter
- Fluent plugin
- Burrow - Kafka Consumer Lag Checking
- Remora
- Kafka Offset Monitoring
- kafka-eagle
- Kafka-prometheus
- Consumer lag monitoring
Performance tools
Security
Audit
Mirroring
- MirrorMaker
- Message Handler For MirrorMaker to change topic names
- uReplicator
- MirrorTool for Kafka Connect
- Mirus
Backup
Tools
- Karapace - Your Kafka essentials in one tool
- REST-proxy
- Kafka-Pixy - gRPC/REST Proxy
- Kafka Proxy providing SASL/PLAIN authentication and SSL
- Reactive/Akka API
- kafkat
- kt
- kafka-connect-tools
- Node Kafka connect
- Kafka-monitor
- Kafka Auto completion
- Kafka Cheet Sheet
- Kafka Write Protocol encoder/decoder
- Winton Kafka Streams
- Spring-kafka
- Maven quick start for Kafka Connect connectors
- Trifecta
- Kafka Specs
- Strimzi Kafka CLI
Metadata Management
Schema Management
UI
- kafka-manager
- Kafka HQ
- Kafdrop 3.x – web UI for Kafka. For versions older than 0.10.0 use Kafdrop 2.x.
- Kafka Webview
- Kafka Topics UI
- Kafka Connect UI
- Kafka Schema UI
- Kafkawize - self service topic management portal
- Kadmin - Kafka Producer/Consumer UI
- Kowl
- Kafka Streams Topology Sketch Diagram Visualization
- Web based GUI
Deployment
Kubernetes
- Kafka k8s operator
- Strimzi Operator for deploying and running Apache Kafka on Kubernetes
- konsumerator - Kafka Consumer Operator
Docker
Integrations
Alternative Implementations
Unsorted
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].