492 Open source projects that are alternatives of or similar to open-stream-processing-benchmark

An umbrella project for multiple implementations of model serving

StreamLine - Streaming Analytics

Streaming System 相关的论文读物

A list about Apache Kafka

Experiments with Apache Flink.

Schema Registry

seatunnel plugin developing examples.

A high performance/ real-time C++ Kafka streams framework (C++17)

酷玩 Spark: Spark 源代码解析、Spark 类库等

Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/

Event-Driven microservices with Kafka Streams

Production Ready Data Integration Product, documentation：

The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Wormhole is a SPaaS (Stream Processing as a Service) Platform

Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

A lightweight stream processing library for Go

An open source, cloud-native streaming data integration and analytics product optimized for agile digital businesses

Apache Flink connectors for Pravega.

Python Stream Processing

Demo applications and code examples for Confluent Platform and Apache Kafka

Elastic data processing with Apache Pulsar and Apache Flink

Kafka Tutorials microsite

SANSA Query Layer

Open-source distributed computation and storage platform

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Stream computing platform for bigdata

When Apache Pulsar meets Apache Spark

Simple shared surface streaming application

Harmonious distributed data analysis in Rust.

Simple CLI tool for diagnostics and debugging of Cyphal networks

Open Source Phasor Data Concentrator

Optical Flow Dataset and Benchmark for Visual Crowd Analysis

Stream Processors on Kafka in Golang

Counting Tweets Per User in Real-Time

TiDB connectors for Flink/Hive/Presto

A tool that help automate deployment to an Apache Flink cluster

🐧基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)

The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.

Elkeid HUB is a rule/event processing engine maintained by the Elkeid Team that supports streaming/offline (not yet supported by the community edition) data processing. The original intention is to solve complex data/event processing and external system linkage requirements through standardized rules.

MPI Parallel framework for training deep learning models built in Theano

Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake.

基于Apache-bahir-kudu-connector的flink-connector-kudu，支持Flink1.11.x DynamicTableSource/Sink，支持Range分区等

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Astronomy Broker based on Apache Spark

Java library for managing Apache Flink via the Monitoring REST API

基于spark-ml,spark-mllib,spark-streaming的推荐算法实现

Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala

Dockerized Folding@home client with NVIDIA GPU support to help battle COVID-19

A library to compute histograms on distributed environments, on streaming data

Binding the GDELT universe in a Spark environment

Fleex makes it easy to create multiple VPS on cloud providers and use them to distribute workloads.

Event Sourcing(CQRS) and Materialized views with Kafka Streams

从本地IDEA提交Flink/Spark任务到Yarn/k8s集群

Easy parsing of Apache HTTPD and NGINX access logs with Java, Hadoop, Hive, Pig, Flink, Beam, Storm, Drill, ...

A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.