180 Open source projects that are alternatives of or similar to Wormhole

Kafka Workers is a client library which unifies records consuming from Kafka and processing them by user-defined WorkerTasks.

Real Time Analytics and Data Pipelines based on Spark Streaming

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

JPStream: JSONPath Stream Processing in Parallel

Collection of stream processing / multiplexing / networking libs in Go

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Live Twitter sentiment analysis using Python, Apache Spark Streaming, Kafka, NLTK, SocketIO

Bitnami Docker Image for Apache Spark

The micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API.

The purpose of this project is to apply mediapipe to more AI chips.

Theodolite is a framework for benchmarking the horizontal and vertical scalability of cloud-native applications.

a payment application intended for deployment by the united states treasury

C# and F# language binding and extensions to Apache Spark

seatunnel plugin developing examples.

Some class materials for a data processing course using PySpark

The database purpose-built for stream processing applications.

A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

Counting Tweets Per User in Real-Time

Framework for building Event-Driven Microservices

A high-performance observability data pipeline.

Design/Implement stream/batch architecture on NYC taxi data | #DE

Open Source Phasor Data Concentrator

Kasper is a lightweight library for processing Kafka topics.

Repository for integration with Apache Kafka

High-Performance Erlang Stream Processor

Event-Driven microservices with Kafka Streams

Distributed Stream and Batch Processing

🐧基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)

Stream Discovery and Stream Orchestration

Experiments with Apache Flink.

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

A Redis dehydrator module

Small and simple stream-based CEP tool for IoT devices connected to an MQTT broker

Turns XLSX into a readable stream.

A stream processing API for Go (alpha)

bigdatatutorial

an online learning algorithm library for Storm

Python clone of Spark, a MapReduce alike framework in Python

Stream computing platform for bigdata

Building event-driven applications the easy way in Go.

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

A simple and eloquent workflow for streaming messages to micro-services.

The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

酷玩 Spark: Spark 源代码解析、Spark 类库等

High performance data aggregating storage

Simple shared surface streaming application

light, fast, scalable, streaming microservices made easy

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

Stream Processing Library for Go

🐟 A streaming ETL for fish

A reliable, high-performance tool for building observability data pipelines.

A Flexible and Powerful Parameter Server for large-scale machine learning

Apache Flink connectors for Pravega.

Fancy stream processing made operationally mundane

⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.