906 Open source projects that are alternatives of or similar to Kafka Streams In Action

A list about Apache Kafka

A lightweight stream processing library for Go

Kafka client for functional streams for scala (fs2)

Fancy stream processing made operationally mundane

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Real Time Analytics and Data Pipelines based on Spark Streaming

Window-Based Hybrid CPU/GPU Stream Processing Engine

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

StreamLine - Streaming Analytics

A curated list of awesome big data frameworks, ressources and other awesomeness.

Massively real-time traffic streaming application

Streaming reactive and dataflow graphs in Python

Building event-driven applications the easy way in Go.

Stream Processing Made Easy

The magic message bus

In this repository, I have developed the entire server-side principal architecture for real-time stock market prediction with Machine Learning. I have used Tensorflow.js for constructing ml model architecture, and Kafka for real-time data streaming and pipelining.

Kasper is a lightweight library for processing Kafka topics.

Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

Flexible and efficient data processing engine and an evolution of the popular Scramjet Framework based on node.js. Our Transform Hub was designed specifically for data processing and has its own unique algorithms included.

Kafka Connect connector for JDBC-compatible databases

Python Stream Processing

Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.

Elegant stream processing pipeline written entirely in Golang

Demo applications and code examples for Confluent Platform and Apache Kafka

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

Materialize lets you ask questions of your live data, which it answers and then maintains for you as your data continue to change. The moment you need a refreshed answer, you can get it in milliseconds. Materialize is designed to help you interactively explore your streaming data, perform data warehousing analytics against live relational data, or just increase the freshness and reduce the load of your dashboard and monitoring tasks.

♒︎ [WIP] An experimental ~distributed~ commit-log

Redpanda is the real-time engine for modern apps. Kafka API Compatible; 10x faster 🚀 See more at vectorized.io/redpanda

light, fast, scalable, streaming microservices made easy

a payment application intended for deployment by the united states treasury

Open Source Phasor Data Concentrator

A simple and eloquent workflow for streaming messages to micro-services.

Platform for Situated Intelligence

Kafka Connect HDFS connector

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

The database purpose-built for stream processing applications.

Streaming System 相关的论文读物

The streaming database built for IoT data storage and real-time processing in the 5G Era

Golang Kafka consumer and producer example

A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.

🌊 Online machine learning in Python

A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)

Ship changes in Postgres 🐘 to Kafka 📖

Files needed to try out KSQL Recipes for yourself

A high performance/ real-time C++ Kafka streams framework (C++17)

Machine is a workflow/pipeline library for processing data

This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.

A curated list of awesome big data frameworks, ressources and other awesomeness.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Neo4j Kafka Integrations, Docs =>

Grid Solutions Framework

Utils for streaming large files (S3, HDFS, gzip, bz2...)

Distributed Stream and Batch Processing

Pravega is 100% open source and community-driven. All components are available under Apache 2 License on GitHub.

Samsara is a real-time analytics platform

Kafka Tutorials microsite

How to implement a streaming at scale solution in Azure