GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → wintoncode → Winton Kafka Streams

wintoncode / Winton Kafka Streams

Licence: apache-2.0
A Python implementation of Apache Kafka Streams

Programming Languages

python
139335 projects - #7 most used programming language

Labels

kafka-streamsstreaming-api

Projects that are alternatives of or similar to Winton Kafka Streams

kafka-streams-example
Kafka Streams based microservice
Stars: ✭ 25 (-91.72%)
Mutual labels:  kafka-streams
kafka-streams-query
Library offering http based query on top of Kafka Streams Interactive Queries
Stars: ✭ 70 (-76.82%)
Mutual labels:  kafka-streams
kafka-streams-scala-examples
No description or website provided.
Stars: ✭ 16 (-94.7%)
Mutual labels:  kafka-streams
marc4js
A Node.js API for handling MARC
Stars: ✭ 35 (-88.41%)
Mutual labels:  streaming-api
amq-examples
This repository contains a set of examples to be used with Red Hat AMQ messaging suite components.
Stars: ✭ 25 (-91.72%)
Mutual labels:  kafka-streams
srtdroid
Secure Reliable Transport (SRT) Protocol for Android
Stars: ✭ 35 (-88.41%)
Mutual labels:  streaming-api
easyvk
This app helps you create an apps with vk api easy!
Stars: ✭ 97 (-67.88%)
Mutual labels:  streaming-api
Google Drive Player Script
Grab google drive streaming links (redirector.googlevideo.com/videoplayback?..)
Stars: ✭ 283 (-6.29%)
Mutual labels:  streaming-api
transit
Massively real-time city transit streaming application
Stars: ✭ 20 (-93.38%)
Mutual labels:  streaming-api
chuck-norris-streams
Kafka, Debezium and Fuse demonstration based on Chuck Norris movies!
Stars: ✭ 25 (-91.72%)
Mutual labels:  kafka-streams
kafka-encryption
Kafka End to End Encryption
Stars: ✭ 44 (-85.43%)
Mutual labels:  kafka-streams
kafka-with-springboot
Demonstrations for Kafka with Spring Boot
Stars: ✭ 17 (-94.37%)
Mutual labels:  kafka-streams
lwc-streaming-api
Lightning Web Component Streaming API
Stars: ✭ 25 (-91.72%)
Mutual labels:  streaming-api
godsend
A simple and eloquent workflow for streaming messages to micro-services.
Stars: ✭ 15 (-95.03%)
Mutual labels:  streaming-api
Kafkastreams Cep
Complex Event Processing on top of Kafka Streams
Stars: ✭ 257 (-14.9%)
Mutual labels:  kafka-streams
formula1-telemetry-kafka
No description or website provided.
Stars: ✭ 99 (-67.22%)
Mutual labels:  kafka-streams
live-rates.com
Forex Real-time Streaming, Web-service & Rest API
Stars: ✭ 30 (-90.07%)
Mutual labels:  streaming-api
Scalatest Embedded Kafka
A library that provides an in-memory Kafka instance to run your tests against.
Stars: ✭ 292 (-3.31%)
Mutual labels:  kafka-streams
Ziggurat
A stream processing framework to build stateless applications on Kafka
Stars: ✭ 282 (-6.62%)
Mutual labels:  kafka-streams
typebus
Framework for building distributed microserviceies in scala with akka-streams and kafka
Stars: ✭ 14 (-95.36%)
Mutual labels:  kafka-streams
View All Similar Projects ➔

Winton Kafka Streams

Build Status

Implementation of Apache Kafka's Streams API in Python.

What and why?

Apache Kafka is an open-source stream processing platform developed by the Apache Software Foundation written in Scala and Java. Kafka has Streams API added for building stream processing applications using Apache Kafka. Applications built with Kafka's Streams API do not require any setup beyond the provision of a Kafka cluster.

Winton Kafka Streams is a Python implementation of Apache Kafka's Streams API. It builds on Confluent's librdkafka (a high performance C library implementing the Kafka protocol) and the Confluent Python Kafka library to achieve this.

The power and simplicity of both Python and Kafka's Streams API combined opens the streaming model to many more people and applications.

Getting started

Dependencies

The minimum Python version is currently 3.6 and a working Kafka cluster (a single replica is sufficient for testing) are required.

You will require librdkafka. On Mac OS, we recommend installing this via HomeBrew and setting CFLAGS=-I/usr/local/include and LDFLAGS=-L/usr/local/lib is when installing Confluent Python Kafka (see below). The librdkafka GitHub page lists packages available for Debian and Ubuntu, as well as RPMS. For Arch Linux it is available via AUR.

Confluent Python Kafka is also required and it should be installed as a dependency by pip.

Installing

Cloning the Winton Kafka Streams repository from GitHub is recommended if you want to contribute to the project. Then use pip install --editable <path/to/winton_kafka_streams>[develop] to install as an editable workspace with additional dependencies required for development. You may need to do this using sudo on Linux.

If you want to install the code and get a feel for it as a user then we recommend using pip install git+https://github.com/wintoncode/winton-kafka-streams.

Running tests

Tests will run when py.test is called in the root of the repository.

Running examples

To run examples, you must have cloned the code locally from GitHub.

The debug and wordcount examples will run without further additional requirements.

The Jupyter notebook in the binning example requires some additional packages. Install these with the command:

pip install <path/to/winton_kafka_streams>[binning_example]

Contributing

Please see the CONTRIBUTING.md document for more details on getting involved.

Contact

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].