Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

Stars: ✭ 238 (-40.05%)

Mutual labels: stream-processing, apache-kafka

Miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

Stars: ✭ 4,633 (+1067%)

Mutual labels: data-processing, streaming-data

Azure Event Hubs For Kafka

Azure Event Hubs for Apache Kafka Ecosystems

Stars: ✭ 124 (-68.77%)

Mutual labels: apache-kafka, kafka

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

Stars: ✭ 10,478 (+2539.29%)

Mutual labels: stream-processing, streaming-data

Amadeus

Harmonious distributed data analysis in Rust.

Stars: ✭ 240 (-39.55%)

Mutual labels: stream-processing, data-processing

Gsf

Grid Solutions Framework

Stars: ✭ 106 (-73.3%)

Mutual labels: stream-processing, streaming-data

Kasper

Kasper is a lightweight library for processing Kafka topics.

Stars: ✭ 413 (+4.03%)

Mutual labels: kafka, stream-processing

frizzle

The magic message bus

Stars: ✭ 14 (-96.47%)

Mutual labels: stream-processing, streaming-data

Hazelcast Jet

Distributed Stream and Batch Processing

Stars: ✭ 855 (+115.37%)

Mutual labels: kafka, stream-processing

Demo Scene

👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/

Stars: ✭ 806 (+103.02%)

Mutual labels: kafka, kafka-streams

Cp Docker Images

[DEPRECATED] Docker images for Confluent Platform.

Stars: ✭ 975 (+145.59%)

Mutual labels: kafka, kafka-streams

Kafka Streams Machine Learning Examples

This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leveraging Apache Kafka and its Streams API. Models are built with Python, H2O, TensorFlow, Keras, DeepLearning4 and other technologies.

Stars: ✭ 661 (+66.5%)

Mutual labels: kafka, kafka-streams

Pg2kafka

Ship changes in Postgres 🐘 to Kafka 📖

Stars: ✭ 61 (-84.63%)

Mutual labels: kafka, stream-processing

fink-broker

Astronomy Broker based on Apache Spark

Stars: ✭ 18 (-95.47%)

Mutual labels: apache-spark, apache-kafka

streamsx.kafka

Repository for integration with Apache Kafka

Stars: ✭ 13 (-96.73%)

Mutual labels: apache-spark, stream-processing

open-stream-processing-benchmark

This repository contains the code base for the Open Stream Processing Benchmark.

Stars: ✭ 37 (-90.68%)

Mutual labels: stream-processing, kafka-streams

Go Kafka Example

Golang Kafka consumer and producer example

Stars: ✭ 108 (-72.8%)

Mutual labels: kafka, stream-processing

Flink Learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Stars: ✭ 11,378 (+2765.99%)

Mutual labels: kafka, stream-processing

Samsara

Samsara is a real-time analytics platform

Stars: ✭ 132 (-66.75%)

Mutual labels: kafka, stream-processing

Seldon Server

Machine Learning Platform and Recommendation Engine built on Kubernetes

Stars: ✭ 1,435 (+261.46%)

Mutual labels: kafka, kafka-streams

A Kafka Story

Kafka ecosystem ... but step by step!

Stars: ✭ 148 (-62.72%)

Mutual labels: kafka, kafka-streams

spark-twitter-sentiment-analysis

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Stars: ✭ 55 (-86.15%)

Mutual labels: apache-spark, apache-kafka

mxfactorial

a payment application intended for deployment by the united states treasury

Stars: ✭ 36 (-90.93%)

Mutual labels: stream-processing, streaming-data

makinage

Stream Processing Made Easy

Stars: ✭ 31 (-92.19%)

Mutual labels: stream-processing, streaming-data

Fero

light, fast, scalable, streaming microservices made easy

Stars: ✭ 175 (-55.92%)

Mutual labels: kafka, stream-processing

Kowl

Apache Kafka Web UI for exploring messages, consumers, configurations and more with a focus on a good UI & UX.

Stars: ✭ 1,036 (+160.96%)

Mutual labels: apache-kafka, kafka

Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Stars: ✭ 204 (-48.61%)

Mutual labels: kafka, kafka-streams

Strimzi Kafka Operator

Apache Kafka running on Kubernetes

Stars: ✭ 2,833 (+613.6%)

Mutual labels: kafka, kafka-streams

Kafka-based Job Queue for Python

Stars: ✭ 530 (+33.5%)

Mutual labels: apache-kafka, kafka

godsend

A simple and eloquent workflow for streaming messages to micro-services.

Stars: ✭ 15 (-96.22%)

Mutual labels: stream-processing, streaming-data

Kafka Streams Scala

Thin Scala wrapper around Kafka Streams Java API

Stars: ✭ 192 (-51.64%)

Mutual labels: kafka, kafka-streams

awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

Stars: ✭ 11,093 (+2694.21%)

Mutual labels: stream-processing, streaming-data

Scalatest Embedded Kafka

A library that provides an in-memory Kafka instance to run your tests against.

Stars: ✭ 292 (-26.45%)

Mutual labels: kafka, kafka-streams

Pykafka

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

Stars: ✭ 1,079 (+171.79%)

Mutual labels: apache-kafka, kafka

Bigdata Playground

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Stars: ✭ 177 (-55.42%)

Mutual labels: kafka, apache-spark

amq-examples

This repository contains a set of examples to be used with Red Hat AMQ messaging suite components.

Stars: ✭ 25 (-93.7%)

Mutual labels: apache-kafka, kafka-streams

formula1-telemetry-kafka

No description or website provided.

Stars: ✭ 99 (-75.06%)

Mutual labels: apache-kafka, kafka-streams

pulsar-adapters

Apache Pulsar Adapters

Stars: ✭ 18 (-95.47%)

Mutual labels: apache-spark, apache-kafka

data processing course

Some class materials for a data processing course using PySpark

Stars: ✭ 50 (-87.41%)

Mutual labels: stream-processing, data-processing

Cqrs Manager For Distributed Reactive Services

Experimental CQRS and Event Sourcing service

Stars: ✭ 289 (-27.2%)

Mutual labels: kafka

Bistro

A general-purpose data analysis engine radically changing the way batch and stream data is processed

Stars: ✭ 333 (-16.12%)

Mutual labels: stream-processing

Bee Stylish

🕶 Styleguides da moda (ou não)

Stars: ✭ 286 (-27.96%)

Mutual labels: infrastructure

Wedatasphere

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Stars: ✭ 372 (-6.3%)

Mutual labels: kafka

Treescale

Event/Data distribution system without any configuration, but with data delivery guarantees

Stars: ✭ 286 (-27.96%)

Mutual labels: infrastructure

Cp Ansible

Ansible playbooks for the Confluent Platform

Stars: ✭ 285 (-28.21%)

Mutual labels: kafka

Ziggurat

A stream processing framework to build stateless applications on Kafka