180 Open source projects that are alternatives of or similar to Wormhole

This repository contains the code base for the Open Stream Processing Benchmark.

Streaming System 相关的论文读物

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

A list about Apache Kafka

Readings in Stream Processing

Demos of how to do custom stream processing using the Akka Streams GraphStages API

Open-source distributed computation and storage platform

An opinionated clojure framework for writing kafka machines

Python Stream Processing

Basic framework utilities to quickly start writing production ready Apache Spark applications

A general-purpose data analysis engine radically changing the way batch and stream data is processed

ARTML- Real time learning

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

An open source framework for building data analytic applications.

Flexible and efficient data processing engine and an evolution of the popular Scramjet Framework based on node.js. Our Transform Hub was designed specifically for data processing and has its own unique algorithms included.

Lightweight real-time big data streaming engine over Akka

The Refreshingly Simple Cross-Platform C++ Dataflow / Pipelining / Stream Processing / Reactive Programming Framework

Scala examples for learning to use Spark

Massively real-time traffic streaming application

Demo for Redis Streams

四川大学拓思艾诺广告流量实时分析项目

Efficient, easy-to-use, and fast PHP JSON stream parser

MAGE - Memgraph Advanced Graph Extensions 🔮

A lightweight stream processing library for Go

TalariaDB is a distributed, highly available, and low latency time-series database for Presto

🦖 Streaming-Serverless Framework for Low-latency Edge Computing applications, running atop QUIC protocol, engaging 5G technology.

A curated list of awesome big data frameworks, ressources and other awesomeness.

Distributed KV Streams

Real Time Analytics and Data Pipelines based on Spark Streaming

JPStream: JSONPath Stream Processing in Parallel

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

Live Twitter sentiment analysis using Python, Apache Spark Streaming, Kafka, NLTK, SocketIO

The micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API.

Theodolite is a framework for benchmarking the horizontal and vertical scalability of cloud-native applications.

C# and F# language binding and extensions to Apache Spark

Some class materials for a data processing course using PySpark

The database purpose-built for stream processing applications.

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

Framework for building Event-Driven Microservices

Design/Implement stream/batch architecture on NYC taxi data | #DE

Kasper is a lightweight library for processing Kafka topics.

High-Performance Erlang Stream Processor

Distributed Stream and Batch Processing

Stream Discovery and Stream Orchestration

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

Small and simple stream-based CEP tool for IoT devices connected to an MQTT broker

A stream processing API for Go (alpha)

an online learning algorithm library for Storm

Stream computing platform for bigdata

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

A simple and eloquent workflow for streaming messages to micro-services.

酷玩 Spark: Spark 源代码解析、Spark 类库等

Simple shared surface streaming application

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

🐟 A streaming ETL for fish

A reliable, high-performance tool for building observability data pipelines.

A Flexible and Powerful Parameter Server for large-scale machine learning

An extensible Java framework for building XML and non-XML streaming applications

Stream Processing Library for Go