All Projects → bitbouncer → Kspp

bitbouncer / Kspp

Licence: bsl-1.0
A high performance/ real-time C++ Kafka streams framework (C++17)

Programming Languages

cpp
1120 projects
cpp17
186 projects

Projects that are alternatives of or similar to Kspp

Strimzi Kafka Operator
Apache Kafka running on Kubernetes
Stars: ✭ 2,833 (+3441.25%)
Mutual labels:  kafka, kafka-streams, kafka-connect
Faust
Python Stream Processing
Stars: ✭ 5,899 (+7273.75%)
Mutual labels:  kafka, stream-processing, kafka-streams
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
Stars: ✭ 204 (+155%)
Mutual labels:  kafka, kafka-streams, kafka-connect
Logisland
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
Stars: ✭ 97 (+21.25%)
Mutual labels:  kafka, stream-processing, kafka-streams
Ksql
The database purpose-built for stream processing applications.
Stars: ✭ 4,668 (+5735%)
Mutual labels:  kafka, stream-processing, kafka-connect
Kafka Tutorials
Kafka Tutorials microsite
Stars: ✭ 144 (+80%)
Mutual labels:  kafka, stream-processing, kafka-streams
Cp Docker Images
[DEPRECATED] Docker images for Confluent Platform.
Stars: ✭ 975 (+1118.75%)
Mutual labels:  kafka, kafka-streams, kafka-connect
Kukulcan
A REPL for Apache Kafka
Stars: ✭ 103 (+28.75%)
Mutual labels:  kafka, kafka-streams, kafka-connect
Examples
Demo applications and code examples for Confluent Platform and Apache Kafka
Stars: ✭ 571 (+613.75%)
Mutual labels:  kafka, stream-processing, kafka-streams
Awesome Kafka
A list about Apache Kafka
Stars: ✭ 397 (+396.25%)
Mutual labels:  kafka, stream-processing, kafka-streams
Demo Scene
👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Stars: ✭ 806 (+907.5%)
Mutual labels:  kafka, kafka-streams, kafka-connect
Go Streams
A lightweight stream processing library for Go
Stars: ✭ 615 (+668.75%)
Mutual labels:  kafka, stream-processing, kafka-streams
Kafka Ui
Open-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (+187.5%)
Mutual labels:  kafka, kafka-streams, kafka-connect
football-events
Event-Driven microservices with Kafka Streams
Stars: ✭ 57 (-28.75%)
Mutual labels:  stream-processing, kafka-connect, kafka-streams
Kafka Streams
equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨
Stars: ✭ 613 (+666.25%)
Mutual labels:  kafka, stream-processing, kafka-streams
Kattlo Cli
Kattlo CLI Project
Stars: ✭ 58 (-27.5%)
Mutual labels:  kafka, kafka-streams, kafka-connect
Stream Reactor
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
Stars: ✭ 753 (+841.25%)
Mutual labels:  kafka, kafka-connect
Kafkacenter
KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.
Stars: ✭ 896 (+1020%)
Mutual labels:  kafka, kafka-connect
Kafka Connect Elastic Sink
Kafka connect Elastic sink connector, with just in time index/delete behaviour.
Stars: ✭ 23 (-71.25%)
Mutual labels:  kafka, kafka-connect
Kafka Streams Machine Learning Examples
This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leveraging Apache Kafka and its Streams API. Models are built with Python, H2O, TensorFlow, Keras, DeepLearning4 and other technologies.
Stars: ✭ 661 (+726.25%)
Mutual labels:  kafka, kafka-streams

kspp

Join the chat at https://gitter.im/kspp/Lobby

A high performance / realtime C++17 stream-processing framework with avro support. The design is influenced by apache kafka streams library. Change data capture for a postgres and sql server. Export to kafka, mqtt, postgres, elastic search, influxdb and avrofiles

Sources:

  • kafka (uses librdkafka)
  • kafka grpc proxy
  • aws kinesis (experimental, using aws sdk)
  • postgres (uses libpq)
  • microsoft sqlserver (uses freetds)
  • memory stream

Offset storage:

  • kafka
  • file
  • S3 (uses aws sdk)

Sinks:

  • kafka (using librdkafka)
  • mqtt (using paho libraries)
  • postgres (uses libpq)
  • influxdb
  • elastic search
  • files (avro)
  • S3 (avro)
  • memory stream

Statestores:

  • rocksdb
  • memory

Codecs:

  • avro (with confluent schema registry or grpc proxy)
  • text
  • json

Metrics:

  • prometheus

It is intended to be run in kubernetes but works equally well standalone

Platforms: Linux (Windows and Mac build are outdated)

Ubuntu 18.04 x64:

Remove stuff that you should not have...

sudo apt-get purge libprotobuf-dev libgrpc++-dev protobuf-compiler
sudo apt-get purge openssl-dev

Install build tools


sudo apt-get install -y software-properties-common
sudo apt-get update
sudo apt-get install -y g++ sudo pax-utils automake autogen shtool libtool git wget cmake unzip build-essential pkg-config sed bison flex

Install build deps

sudo apt-get install -y python-dev autotools-dev libicu-dev zlib1g-dev openssl libssl-dev libbz2-dev libsnappy-dev liblz4-dev libzstd-dev \
    libgoogle-glog-dev libgflags-dev libcurl4-openssl-dev libc-ares-dev liblzma-dev libpq-dev freetds-dev libxml2-dev \
    libfmt-dev libpcre2-dev libhttp-parser-dev 

install 3rd party deps we need to build from source (you can hack versions - see the file)

./3rdparty_install.sh 

build kspp

mkdir build && cd build
cmake  -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DLINK_SHARED=ON ..
make -j "$(getconf _NPROCESSORS_ONLN)"
sudo make install
cd ..

build docker image / ubuntu 18.04

cd docker-ubuntu
./build_3rdparty.sh
./build.sh
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].