224 Open source projects that are alternatives of or similar to Perfect-Kafka

[READ-ONLY] Enterprise queue solutions for PHP. Filesystem transport.

Machine is a workflow/pipeline library for processing data

High-performance time-series aggregation for PostgreSQL

Stream Processing and Complex Event Processing Engine

Repository for integration with Apache Kafka

When Apache Pulsar meets Apache Spark

Pluck text in a fast and intuitive way 🐓

Elegant stream processing pipeline written entirely in Golang

Experiments with Apache Flink.

Window-Based Hybrid CPU/GPU Stream Processing Engine

JavaScript library to handle media streams on the command line (Node.js) and in the browser.

This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.

A library to compute histograms on distributed environments, on streaming data

This toolkit supports common internet protocols, such as HTTP and WebSockets

The streaming database built for IoT data storage and real-time processing in the 5G Era

🐟 A streaming ETL for fish

Simple JSON-based messaging queue for inter service communication

A reliable, high-performance tool for building observability data pipelines.

Add-ons to Akka Stream

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

Event-Driven microservices with Kafka Streams

Framework for building Event-Driven Microservices

Log Anomaly Detection - Machine learning to detect abnormal events logs

A stream processing API for Go (alpha)

Lightweight Component Model and Messaging Framework based on ØMQ

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

fastest JSON encoder/decoder with powerful stream API for Golang

The micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API.

Wrapped message queue which based on rabbitmq,support http protocol

Kasper is a lightweight library for processing Kafka topics.

Dynamic execution framework for your Redis data

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

Micro job queue built on mongo

A general-purpose data analysis engine radically changing the way batch and stream data is processed

Upserts, Deletes And Incremental Processing on Big Data.

AMQP on Pulsar protocol handler

A curated list of awesome big data frameworks, ressources and other awesomeness.

Open-source distributed computation and storage platform

Kafka Tutorials microsite

JPStream: JSONPath Stream Processing in Parallel

The magic message bus

Flexible and efficient data processing engine and an evolution of the popular Scramjet Framework based on node.js. Our Transform Hub was designed specifically for data processing and has its own unique algorithms included.

Wayeb is a Complex Event Processing and Forecasting (CEP/F) engine written in Scala.

Some class materials for a data processing course using PySpark

Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

An opinionated clojure framework for writing kafka machines

A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)

High-Performance Erlang Stream Processor

Platform for Situated Intelligence

Stream Discovery and Stream Orchestration

Elastic data processing with Apache Pulsar and Apache Flink

an online learning algorithm library for Storm

Background job processing for Common Lisp

Distributed Stream Processing

This repository contains the code base for the Open Stream Processing Benchmark.

Simple examle for Spark Streaming over Kafka topic

Open Source Phasor Data Concentrator

Elkeid HUB is a rule/event processing engine maintained by the Elkeid Team that supports streaming/offline (not yet supported by the community edition) data processing. The original intention is to solve complex data/event processing and external system linkage requirements through standardized rules.

Building event-driven applications the easy way in Go.

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》