All Categories → Data Processing → stream-processing

Top 126 stream-processing open source projects

Python clone of Spark, a MapReduce alike framework in Python
Fluent Bit
Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
Incubator Streampipes
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
Pluck text in a fast and intuitive way 🐓
Flink Sql Cookbook
The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.
Media Stream Library Js
JavaScript library to handle media streams on the command line (Node.js) and in the browser.
High performance data aggregating storage
The streaming database built for IoT data storage and real-time processing in the 5G Era
light, fast, scalable, streaming microservices made easy
VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.
Kafka Streams In Action
Source code for the Kafka Streams in Action Book
fastest JSON encoder/decoder with powerful stream API for Golang
A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.
Dynamic execution framework for your Redis data
面向 OLTP、OLAP、批处理、流处理场景的大一统 SQL 引擎
Awesome Streaming
a curated list of awesome streaming frameworks, applications, etc
Wayeb is a Complex Event Processing and Forecasting (CEP/F) engine written in Scala.
Samsara is a real-time analytics platform
Real Time Sentiment Tracking On Twitter For Brand Improvement And Trend Recognition
A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)
Pulsar Flink
Elastic data processing with Apache Pulsar and Apache Flink
A Python stream processing engine modeled after Yahoo! Pipes
Go Kafka Example
Golang Kafka consumer and producer example
Flink Learning
flink learning blog. 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
Hudi Resources
汇总Apache Hudi相关资料
A high performance/ real-time C++ Kafka streams framework (C++17)
Machine is a workflow/pipeline library for processing data
Fs2 Kafka
Kafka client for functional streams for scala (fs2)
Stream Processing and Complex Event Processing Engine
Ship changes in Postgres 🐘 to Kafka 📖
Elegant stream processing pipeline written entirely in Golang
Storm Dynamic Spout
A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.
Window-Based Hybrid CPU/GPU Stream Processing Engine
Ksql Recipes Try It At Home
Files needed to try out KSQL Recipes for yourself
This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the file for hints to alternative toolkits.
A project for developing tutorials for Streams
This toolkit supports common internet protocols, such as HTTP and WebSockets
Wormhole is a SPaaS (Stream Processing as a Service) Platform
A reliable, high-performance tool for building observability data pipelines.
Spring Cloud Dataflow
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
Lightweight real-time big data streaming engine over Akka
1-60 of 126 stream-processing projects