The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

✭ 189

dockerfile sql stream-processing flink

Media Stream Library Js

JavaScript library to handle media streams on the command line (Node.js) and in the browser.

✭ 192

javascript typescript camera jpeg stream-processing mp4 rtsp video-streaming aac h264 rtp

Logrange

High performance data aggregating storage

✭ 181

go golang database logging stream-processing streams pipelines

Hstream

The streaming database built for IoT data storage and real-time processing in the 5G Era

✭ 166

haskell database iot streaming stream stream-processing

Fero

light, fast, scalable, streaming microservices made easy

✭ 175

javascript microservices kafka fast lightweight stream-processing scalable

Akka Stream Contrib

Add-ons to Akka Stream

✭ 173

scala akka stream-processing akka-streams

Vectorsql

VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.

✭ 171

go iot reactive pipeline stream-processing clickhouse distributed-database olap

Log Anomaly Detector

Log Anomaly Detection - Machine learning to detect abnormal events logs

✭ 169

jupyter-notebook kubernetes artificial-intelligence machine-learning-algorithms log word2vec anomaly-detection stream-processing gensim

Kafka Streams In Action

Source code for the Kafka Streams in Action Book

✭ 167

java kafka streaming stream-processing streaming-data

Gojay

fastest JSON encoder/decoder with powerful stream API for Golang

✭ 2,009

go Makefile json decoder stream-processing encoder perfomance stream-decoder

Dolphinbeat

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

✭ 164

go mysql pipeline mariadb stream-processing

Redisgears

Dynamic execution framework for your Redis data

✭ 152

c redis analytics stream-processing mapreduce

Bats

面向 OLTP、OLAP、批处理、流处理场景的大一统 SQL 引擎

✭ 152

java database sql stream-processing batch-processing olap

Hudi

Upserts, Deletes And Incremental Processing on Big Data.

✭ 2,586

java scala shell ANTLR Dockerfile Mustache bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink

Mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

Kafka Tutorials

Kafka Tutorials microsite

✭ 144

java kafka stream-processing apache-kafka kafka-streams

Awesome Streaming

a curated list of awesome streaming frameworks, applications, etc

✭ 1,879

awesome awesome-list list stream-processing

Wayeb

Wayeb is a Complex Event Processing and Forecasting (CEP/F) engine written in Scala.

✭ 138

scala stream-processing regular-expression forecasting cep

Samsara

Samsara is a real-time analytics platform

✭ 132

clojure iot elasticsearch kafka analytics realtime fast stream-processing

Real Time Sentiment Tracking On Twitter For Brand Improvement And Trend Recognition

A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)

✭ 127

jupyter-notebook dashboard twitter data-analysis dash stream-processing plotly tweets streaming-data

Neo4j Streams

Neo4j Kafka Integrations, Docs =>

✭ 126

kotlin kafka neo4j stream-processing graph-database kafka-producer

Pulsar Flink

Elastic data processing with Apache Pulsar and Apache Flink

✭ 126

java sql schema stream-processing flink data-processing batch-processing

Riko

A Python stream processing engine modeled after Yahoo! Pipes

✭ 1,571

python cli library functional-programming data asynchronous rss etl stream-processing parallelism featured

Wally

Distributed Stream Processing

✭ 1,461

python Pony Makefile javascript shell elixir linux api framework stream-processing pony-language stream-processing-engine stream-processor

Go Kafka Example

Golang Kafka consumer and producer example

✭ 108

go golang kafka examples stream-processing

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

✭ 10,478

awesome awesome-list database data-science data-visualization data bigdata stream-processing distributed-database data-analytics streaming-data data-stream series-database data-warehouse visualize-data

Flink Learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

✭ 11,378

java mysql redis elasticsearch kafka spark streaming rabbitmq influxdb stream-processing flink hbase clickhouse rocketmq opentsdb loki

Gsf

Grid Solutions Framework

✭ 106

time-series stream-processing libraries streaming-data

Logisland

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

✭ 97

java elasticsearch kafka spark analytics big-data influxdb cassandra stream-processing solr kafka-streams

Hudi Resources

汇总Apache Hudi相关资料

✭ 79

apache bigdata stream-processing

Kspp

A high performance/ real-time C++ Kafka streams framework (C++17)

✭ 80

cpp cpp17 kafka stream-processing kafka-streams kafka-connect

Machine

Machine is a workflow/pipeline library for processing data

✭ 78

go golang workflow pipeline stream-processing mit-license workflow-engine streaming-data

Fs2 Kafka

Kafka client for functional streams for scala (fs2)

✭ 75

scala kafka streaming asynchronous stream-processing kafka-client

Siddhi

Stream Processing and Complex Event Processing Engine

✭ 1,185

java library cloud cloud-native cncf stream-processing cep online-learning

Pg2kafka

Ship changes in Postgres 🐘 to Kafka 📖

✭ 61

go golang postgresql kafka stream-processing

Pulsar Spark

When Apache Pulsar meets Apache Spark

✭ 55

scala data-science spark apache-spark stream-processing flink data-processing batch-processing

Examples

Demo applications and code examples for Confluent Platform and Apache Kafka

✭ 571

shell docker kubernetes sql monitoring demo cloud microservices kafka example examples jdbc stream-processing avro kafka-streams quickstart connector confluent

Stream

Elegant stream processing pipeline written entirely in Golang

✭ 45

go streaming stream-processing edge

Storm Dynamic Spout

A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.

✭ 40

java kafka stream-processing salesforce apache-kafka storm

Saber

Window-Based Hybrid CPU/GPU Stream Processing Engine

✭ 35

java gpu streaming stream stream-processing hybrid streaming-data multicore

Ksql Recipes Try It At Home

Files needed to try out KSQL Recipes for yourself

✭ 33

shell kafka stream-processing

Streamsx.messaging

This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.

✭ 31

java kafka mqtt rabbitmq stream-processing iot-platform

Tutorials

A project for developing tutorials for Streams

✭ 14

jupyter-notebook tutorial stream-processing

Streamsx.inet

This toolkit supports common internet protocols, such as HTTP and WebSockets

✭ 11

java http websockets ftp stream-processing

Wormhole

Wormhole is a SPaaS (Stream Processing as a Service) Platform