infoslack / Awesome Kafka
A list about Apache Kafka
Stars: ✭ 397
Labels
Projects that are alternatives of or similar to Awesome Kafka
Go Streams
A lightweight stream processing library for Go
Stars: ✭ 615 (+54.91%)
Mutual labels: kafka, stream-processing, kafka-streams, streaming-data
Kafka Tutorials
Kafka Tutorials microsite
Stars: ✭ 144 (-63.73%)
Mutual labels: apache-kafka, kafka, stream-processing, kafka-streams
Data Accelerator
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (-37.78%)
Mutual labels: kafka, apache-spark, kafka-streams, streaming-data
Agile data code 2
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Stars: ✭ 413 (+4.03%)
Mutual labels: apache-kafka, kafka, apache-spark
Logisland
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
Stars: ✭ 97 (-75.57%)
Mutual labels: kafka, stream-processing, kafka-streams
Kafka Streams In Action
Source code for the Kafka Streams in Action Book
Stars: ✭ 167 (-57.93%)
Mutual labels: kafka, stream-processing, streaming-data
Kafka Workshop
Materials (slides and code) for Kafka and Kafka Streams Workshop
Stars: ✭ 44 (-88.92%)
Mutual labels: apache-kafka, kafka, kafka-streams
Kafka Storm Starter
Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Stars: ✭ 728 (+83.38%)
Mutual labels: apache-kafka, kafka, apache-spark
Oryx
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Stars: ✭ 1,785 (+349.62%)
Mutual labels: apache-kafka, kafka, apache-spark
Azkarra Streams
🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.
Stars: ✭ 146 (-63.22%)
Mutual labels: apache-kafka, kafka, kafka-streams
Kspp
A high performance/ real-time C++ Kafka streams framework (C++17)
Stars: ✭ 80 (-79.85%)
Mutual labels: kafka, stream-processing, kafka-streams
Examples
Demo applications and code examples for Confluent Platform and Apache Kafka
Stars: ✭ 571 (+43.83%)
Mutual labels: kafka, stream-processing, kafka-streams
Benthos
Fancy stream processing made operationally mundane
Stars: ✭ 3,705 (+833.25%)
Mutual labels: kafka, stream-processing, streaming-data
Faust
Python Stream Processing
Stars: ✭ 5,899 (+1385.89%)
Mutual labels: kafka, stream-processing, kafka-streams
Storm Dynamic Spout
A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.
Stars: ✭ 40 (-89.92%)
Mutual labels: apache-kafka, kafka, stream-processing
Pulsar Spark
When Apache Pulsar meets Apache Spark
Stars: ✭ 55 (-86.15%)
Mutual labels: apache-spark, stream-processing, data-processing
Kafka Streams
equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨
Stars: ✭ 613 (+54.41%)
Mutual labels: kafka, stream-processing, kafka-streams
Kukulcan
A REPL for Apache Kafka
Stars: ✭ 103 (-74.06%)
Mutual labels: apache-kafka, kafka, kafka-streams
Kafka Ui
Open-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (-42.07%)
Mutual labels: apache-kafka, kafka, kafka-streams
awesome-kafka
This list is for anyone wishing to learn about Apache Kafka, but do not have a starting point.
You can help by sending Pull Requests to add more information.
If you're not inclined to make PRs, you can tweet me at @infoslack
Table of Contents
Articles
- http://blog.cloudera.com/blog/2014/09/apache-kafka-for-beginners/ - Apache Kafka for Beginners
- http://sysadvent.blogspot.com.br/2014/12/day-4-introduction-to-kafka.html - Introduction to Kafka
- https://medium.com/@ruurtjan/understanding-kafka-with-factorio-74e8fc9bf181 - Understanding Kafka with Factorio
- http://www.confluent.io/blog/introducing-kafka-streams-stream-processing-made-simple - Introducing Kafka Streams: Stream Processing Made Simple
- https://medium.com/swlh/apache-kafka-in-a-nutshell-5782b01d9ffb - Apache Kafka in a Nutshell
- http://www.confluent.io/blog/apache-kafka-samza-and-the-unix-philosophy-of-distributed-data - Apache Kafka, Samza, and the Unix Philosophy of Distributed Data
- http://www.confluent.io/blog/using-logs-to-build-a-solid-data-infrastructure-or-why-dual-writes-are-a-bad-idea/ - Using logs to build a solid data infrastructure (or: why dual writes are a bad idea)
- http://www.confluent.io/blog/bottled-water-real-time-integration-of-postgresql-and-kafka/ - Bottled Water: Real-time integration of PostgreSQL and Kafka
- http://www.confluent.io/blog/deploying-apache-kafka-on-aws-elastic-block-store-ebs - Deploying Apache Kafka on AWS Elastic Block Store (EBS)
- http://www.confluent.io/blog/how-we-monitor-and-run-kafka-at-scale-signalfx - How We Monitor and Run Kafka At Scale
- https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/ - Monitoring Kafka performance metrics
- http://oobaloo.co.uk/kafka-for-uswitchs-event-pipeline - Kafka for uSwitch's Event Pipeline
- http://blog.infochimps.com/2012/10/30/next-gen-real-time-streaming-storm-kafka-integration/ - Next Gen Real-time Streaming with Storm-Kafka Integration
- https://medium.com/netflix-techblog/search?q=kafka - all netflix tech blog kafka tagged articles
- https://engineering.linkedin.com/blog/topic/kafka - all linked in tech blog kafka tagged articlesEEEEE
- https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into-a-real-time-one-831b48a6ad85 - How to use Apache Kafka to transform a batch pipeline into a real-time one
- https://dev.to/barryosull/event-sourcing-what-it-is-and-why-its-awesome - Event Sourcing: What it is and why it's awesome
- https://www.confluent.io/blog/getting-started-with-rust-and-kafka - Using Kafka with Rust
- https://medium.com/@gayathrisiva8608/apache-kafka-is-a-distributed-streaming-system-that-can-publish-and-subscribe-a-stream-of-records-12af92e2d491 - Apache Kafka-Intro
- https://www.loginradius.com/engineering/blog/stream-processing-using-kafka/ - Introduction to Stream Processing using Kafka Streams
Books
- http://www.confluent.io/making-sense-of-stream-processing-ebook - Making sense of stream processing
- http://shop.oreilly.com/product/0636920032175.do - Designing Data-Intensive Applications
- http://apachekafkabook.com/ - Effective Kafka - A Hands-On Guide to Building Robust and Scalable Event-Driven Applications
- https://www.confluent.io/wp-content/uploads/confluent-kafka-definitive-guide-complete.pdf - Kafka: The Definitive Guide
- https://www.manning.com/books/kafka-in-action - A fast-paced introduction to every aspect of working with Kafka you need to really reap its benefits.
- https://www.manning.com/books/kafka-streams-in-action - By the end of the book, you'll be ready to use Kafka Streams in your projects to reap the benefits of the insight your data holds quickly and easily.
- https://www.manning.com/books/event-streaming-with-kafka-streams-and-ksqldb - The book that teaches you to implement stream processing within the Kafka platform.
Courses
- Udemy Apache Kafka Series - Learning Apache Kafka for Beginners - All Level
- Udemy Apache Kafka Series - Kafka Connect Hands-on Learning - Intermediate
- Udemy Apache Kafka Series - Kafka Streams for Data Processing - Intermediate
- Udemy Apache Kafka Series - Kafka Cluster Setup & Administration - Expert
- Udemy Apache Kafka Series - Confluent Schema Registry & REST Proxy - Intermediate
Papers
- http://www.vldb.org/pvldb/vol8/p1654-wang.pdf - Building a Replicated Logging System with Apache Kafka
- http://research.microsoft.com/en-us/um/people/srikanth/netdb11/netdb11papers/netdb11-final12.pdf - Kafka: a Distributed Messaging System for Log Processing
- http://sites.computer.org/debull/A12june/pipeline.pdf - Building LinkedIn’s Real-time Activity Data Pipeline
- https://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying - The Log: What every software engineer should know about real-time data's unifying abstraction
Presentations
- http://www.slideshare.net/charmalloc/developing-with-the-go-client-for-apache-kafka - Developing with the Go client for Apache Kafka
- http://www.slideshare.net/miguno/apache-kafka-08-basic-training-verisign - Apache Kafka 0.8 basic training - Verisign
- http://www.slideshare.net/charmalloc/developingwithapachekafka-29910685 - Developing Real-Time Data Pipelines with Apache Kafka
- http://www.slideshare.net/AmazonWebServices/infrastructure-at-scale-apache-kafka-twitter-storm-elastic-search-arc303-aws-reinvent-2013 - Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303) | AWS re:Invent 2013
- http://www.slideshare.net/charmalloc/real-timestreamingdata-pipelinesapachekafka - Real-time streaming and data pipelines with Apache Kafka
- http://www.slideshare.net/Hadoop_Summit/building-a-realtime-data-pipeline-apache-kafka-at-linkedin - Building a Real-time Data Pipeline: Apache Kafka at LinkedIn
- http://www.slideshare.net/junrao/kafka-replication-apachecon2013 - Kafka replication apachecon_2013
- http://www.slideshare.net/mumrah/kafka-talk-tri-hug - Introduction and Overview of Apache Kafka
Talks
- https://www.youtube.com/watch?v=qc33qMUvR7c - Introduction to Apache Kafka by Joe Stein
- https://www.youtube.com/watch?v=9RMOc0SwRro - Apache Kafka and the Next 700 Stream Processing Systems by Jay Kreps
- http://www.ustream.tv/recorded/61479591 - Martin Kleppmann (Linkedin) - Using Logs To Build a Solid Data Infrastructure
- https://www.youtube.com/watch?v=aJuo_bLSW6s - I ♥ Logs: Apache Kafka and Real-Time Data Integration
- https://www.youtube.com/watch?v=InAKDEk7H0M - Apache Kafka: Real-time Streaming and Data Pipelines with Apache Kafka by Joe Stein
- https://vimeo.com/63040812 - AJUG - Apache Kafka - Chris Curtin
- https://www.youtube.com/playlist?list=PLkz1SCf5iB4enAR00Z46JwY9GGkaS2NON - Getting started guide on Apache Kafka by Learning Journal
Tools
- https://github.com/Microsoft/Availability-Monitor-for-Kafka
- https://github.com/linkedin/Burrow
- https://github.com/splee/burrower
- https://github.com/yahoo/kafka-manager
- https://github.com/tchiotludo/kafkahq
- https://github.com/SourceLabOrg/kafka-webview
- http://www.kafkatool.com/
- https://github.com/kafka-ops/kafka-topology-builder Gitops and Automation for Apache Kafka
- Strimzi Operator for deploying and running Apache Kafka on Kubernetes and OpenShift
- kafkacat Generic CLI non-JVM Apache Kafka producer and consumer
- connectctl Manage kafka connect connectors easily
- Kafdrop Web UI for browsing Kafka topics and consumer groups
- KokpitBasic Kafka client that does publish subscribe and runs as a Windows application
- Strimzi Kafka CLI A CLI for Strimzi Kafka Operator
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].