438 Open source projects that are alternatives of or similar to Pykafka

Framework for Apache Kafka based Ruby and Rails applications development.

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

🚀 Web GUI for Kafka Cluster Management

A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.

Kafka command line tool that likes JSON

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud

Materials (slides and code) for Kafka and Kafka Streams Workshop

Command Line Tool for managing Apache Kafka

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

Apache Kafka Web UI for exploring messages, consumers, configurations and more with a focus on a good UI & UX.

Kafka Tutorials microsite

A REPL for Apache Kafka

Kafka 한국 사용자 모임에서 운영하는 meetup repository

Apache Kafka on Docker

A list about Apache Kafka

Kattlo CLI Project

Azure Event Hubs for Apache Kafka Ecosystems

WaterDrop is a standalone Karafka component library for generating Kafka messages

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Kafka Connect HDFS connector

Modern C++ Apache Kafka client library (wrapper for librdkafka)

The Apache Kafka C/C++ library

Open-Source Web GUI for Apache Kafka Management

Kafka-based Job Queue for Python

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

weiboAd Infrastructure Data Processor : kafka consumer embedded Lua scripting language in data process framework

💥 A simple multi-purpose connection pool client (Kafka & Hbase & Redis & RMDB & Socket & Http)

Sarama is a Go library for Apache Kafka 0.8, and up.

MySQL to NoSQL real time dataflow

CLI tools for monitoring and managing Apache Kafka

必看！java后端，亮剑诛仙。java发展路线技术要点。

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Simple learning project pushing CSV data into Kafka then indexing the data in ElasticSearch

Apache Kafka support for Ruby Object Mapper

Kafka consumer lag monitor

Blockchain data parsing and persisting results

A library provides consumer/producer to work with kafka, avro and schema registry

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Distributed Stream and Batch Processing

Kafka exporter for Prometheus

Kubernetes Universal Declarative Operator (KUDO)

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Demo applications and code examples for Confluent Platform and Apache Kafka

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Kafka connect Elastic sink connector, with just in time index/delete behaviour.

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

GraphQL Rust Demo

Kafka Connect Elasticsearch Source

A resilient and scalable shopping cart system designed using Event Sourcing (ES) and Command Query Responsibility Segregation (CQRS)

A web clone of the card game Cards Against Humanity.

Kafka proxy with a simple API, speaking the Redis protocol

Yet another Web UI for KSQL

Another app which used to monitor the progress of Kafka Producer and Consumer

Read Kafka topics with WebSockets

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Tool to ease and automate Apache Kafka cluster configuration management