213 Open source projects that are alternatives of or similar to kafka-scala-examples

Demo applications and code examples for Confluent Platform and Apache Kafka

An avro converter for Kafka Connect without a Schema Registry

CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)

🎼 Docker compose files for various kafka stacks

Confluent Schema Registry for Kafka

Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.

Event-Driven microservices with Kafka Streams

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

A high performance/ real-time C++ Kafka streams framework (C++17)

Event Sourcing(CQRS) and Materialized views with Kafka Streams

Demonstrations for Kafka with Spring Boot

Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for integration testing.

MongoDB Kafka Connector

A library that makes it easier to use the Avro serialization format from Ruby.

📙 json & avro http schema registry backed by Kafka

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Kattlo CLI Project

Apache Kafka running on Kubernetes

Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.

👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/

[DEPRECATED] Docker images for Confluent Platform.

Open-Source Web GUI for Apache Kafka Management

A REPL for Apache Kafka

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry

Standalone alternatives to Kafka Connect Connectors

An Avro implementation for .NET

A PHP 7.3+ API client for the Confluent Schema Registry REST API based on Guzzle 6 - http://docs.confluent.io/current/schema-registry/docs/index.html

Avro support for kotlinx.serialization

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.

Plumber, for your dirtiest Kafka streaming jobs

Apache Avro is a data serialization system.

Ruby DSL to create Avro schemas

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

GCS support for avro-tools, parquet-tools and protobuf

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

Flexible, Fast & Compact Serialization with RPC

The metrics pipeline for DC/OS 1.9-1.11

A library provides consumer/producer to work with kafka, avro and schema registry

Avrocado is a convenience library to handle Avro in Golang

Avro for JavaScript ⚡️

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Record Query - A tool for doing record analysis and transformation

☀️ Avro, Protobuf, Thrift on Swagger

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

A fast Go Avro codec

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Avro schema generation and serialization / deserialization for Scala

Kafka Streams DSL vs Processor API

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

Avro SerDe for Apache Spark structured APIs.

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

Iceberg is a table format for large, slow-moving tabular data

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Mu (μ) is a purely functional framework for building micro services.