All Projects → simplesteph → kafka-0.11-examples

simplesteph / kafka-0.11-examples

Licence: other
Code snippets that demonstrate how to leverage the new Kafka 0.11 APIs

Programming Languages

scala
5932 projects

Projects that are alternatives of or similar to kafka-0.11-examples

Rafka
Kafka proxy with a simple API, speaking the Redis protocol
Stars: ✭ 49 (+188.24%)
Mutual labels:  kafka-consumer, kafka-producer, kafka-client
Karafka
Framework for Apache Kafka based Ruby and Rails applications development.
Stars: ✭ 1,223 (+7094.12%)
Mutual labels:  kafka-consumer, kafka-producer, kafka-client
Apachekafkatutorials
Example Code for Kafka Tutorials @ Learning Journal
Stars: ✭ 155 (+811.76%)
Mutual labels:  kafka-consumer, kafka-producer, kafka-client
Strimzi Kafka Bridge
Apache Kafka bridge
Stars: ✭ 137 (+705.88%)
Mutual labels:  kafka-consumer, kafka-producer, kafka-client
Kq
Kafka-based Job Queue for Python
Stars: ✭ 530 (+3017.65%)
Mutual labels:  kafka-consumer, kafka-producer, kafka-client
Kafka Ui
Open-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (+1252.94%)
Mutual labels:  kafka-producer, kafka-client
Qbusbridge
The Apache Kafka Client SDK
Stars: ✭ 272 (+1500%)
Mutual labels:  kafka-consumer, kafka-producer
Topos
🌀 .NET Event Processing library
Stars: ✭ 22 (+29.41%)
Mutual labels:  kafka-consumer, kafka-producer
qwery
A SQL-like language for performing ETL transformations.
Stars: ✭ 28 (+64.71%)
Mutual labels:  kafka-consumer, kafka-producer
Trubka
A CLI tool for Kafka
Stars: ✭ 296 (+1641.18%)
Mutual labels:  kafka-consumer, kafka-producer
Librdkafka
The Apache Kafka C/C++ library
Stars: ✭ 5,617 (+32941.18%)
Mutual labels:  kafka-consumer, kafka-producer
Kukulcan
A REPL for Apache Kafka
Stars: ✭ 103 (+505.88%)
Mutual labels:  kafka-consumer, kafka-producer
Flogo
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
Stars: ✭ 1,891 (+11023.53%)
Mutual labels:  kafka-producer, kafka-client
Kattlo Cli
Kattlo CLI Project
Stars: ✭ 58 (+241.18%)
Mutual labels:  kafka-consumer, kafka-producer
Kafka-quickstart
Kafka Examples focusing on Producer, Consumer, KStreams, KTable, Global KTable using Spring, Kafka Cluster Setup & Monitoring. Implementing Event Sourcing and CQRS Design Pattern using Kafka
Stars: ✭ 31 (+82.35%)
Mutual labels:  kafka-consumer, kafka-producer
kafka-encryption
Kafka End to End Encryption
Stars: ✭ 44 (+158.82%)
Mutual labels:  kafka-consumer, kafka-producer
kafkaSaur
Apache Kafka client for Deno
Stars: ✭ 42 (+147.06%)
Mutual labels:  kafka-client
Spark
Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .
Stars: ✭ 55 (+223.53%)
Mutual labels:  kafka-producer
ansible-kafka-admin
Manage your topic's configuration (partitions, replication factor, parameters), ACLs, quotas, and get stats, without any effort with this library. It does not use the Kafka scripts and does not require ssh connection to the remote broker.
Stars: ✭ 109 (+541.18%)
Mutual labels:  kafka-client
Insulator
A client UI to inspect Kafka topics, consume, produce and much more
Stars: ✭ 53 (+211.76%)
Mutual labels:  kafka-consumer

Kafka 0.11 Demo

This repository contains code snippets in Scala, using the Java clients, that demonstrate how to use the Kafka 0.11 new APIs. The code is incomplete, and that's intended: the goal is to bring the focus on the new APIs only.

For more information, you can find the Kafka 0.11 release notes here: https://archive.apache.org/dist/kafka/0.11.0.0/RELEASE_NOTES.html

In this Repository

  • Idempotent Producer
  • Transactional Producer
  • Transactional Consumer
  • Exactly Once Low Level
  • Kafka Admin Client
  • Headers on Producer Record (new message type)

And Kafka Streams?

Kafka 0.11 has exactly once semantics support for Kafka Streams. To learn about it, I'd recommend my other repo:

https://github.com/simplesteph/kafka-streams-course

Contributions

Feel free to do PR if you see something missing, or if there's a new feature I've missed, or you feel like re-writing things in Java. It's always appreciated

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].