469 Open source projects that are alternatives of or similar to Go Kafka Avro

Avro SerDe for Apache Spark structured APIs.

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Divolte Collector

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Kafka backed service library.

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

MongoDB Kafka Connector

Confluent Schema Registry for Kafka

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Demo applications and code examples for Confluent Platform and Apache Kafka

A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.

Command Line Tool for managing Apache Kafka

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

A CLI and Go client for Kafka Schema Registry

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Web tool for Avro Schema Registry |

KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.

CLI tools for monitoring and managing Apache Kafka

Very simplified shop sales system made in a microservices architecture using quarkus

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Files needed to try out KSQL Recipes for yourself

Simple learning project pushing CSV data into Kafka then indexing the data in ElasticSearch

Kafka command line tool that likes JSON

SiteWhere is an industrial strength open-source application enablement platform for the Internet of Things (IoT). It provides a multi-tenant microservice-based infrastructure that includes device/asset management, data ingestion, big-data storage, and integration through a modern, scalable architecture. SiteWhere provides REST APIs for all system functionality. SiteWhere provides SDKs for many common device platforms including Android, iOS, Arduino, and any Java-capable platform such as Raspberry Pi rapidly accelerating the speed of innovation.

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Enterprise Network Flow Collector (IPFIX, sFlow, Netflow) from Verizon Media

Kafka Development Tool

MySQL to NoSQL real time dataflow

☀️ Avro, Protobuf, Thrift on Swagger

Cluster extensions for Sarama, the Go client library for Apache Kafka 0.9 [DEPRECATED]

深圳地铁大数据客流分析系统🚇🚄🌟

必看！java后端，亮剑诛仙。java发展路线技术要点。

👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/

Another app which used to monitor the progress of Kafka Producer and Consumer

Spring Boot 学习教程

Apache Kafka support for Ruby Object Mapper

🐂基于springcloud +dubbo构建的模拟秒杀项目，模块化设计，集成了分库分表、elasticsearch🔍、gateway、mybatis-plus、spring-session等常用开源组件

De-/Serialization wrapper for Kafka to accomplish end to end encryption

Distributed Stream and Batch Processing

Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.

Open source Observability Platform. 👉 SigNoz helps developers find issues in their deployed applications & solve them quickly

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Tool to ease and automate Apache Kafka cluster configuration management

This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.

Kubernetes Universal Declarative Operator (KUDO)

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues

High performance mqtt broker

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Kafka Connect connector for JDBC-compatible databases

A real time Tweet Trend Map and Sentiment Analysis web application with kafka, Angular, Spring Boot, Flink, Elasticsearch, Kibana, Docker and Kubernetes deployed on the cloud

Avro for JavaScript ⚡️

a fast and simple distributed publish-subscribe messaging system (mq)

Free and open source log management

Kafka connect Elastic sink connector, with just in time index/delete behaviour.

An extensible distributed system for reliable nearline data streaming at scale

Fast and reliable message broker built on top of Kafka.

基于utgard的OPC DA客户端

Avrocado is a convenience library to handle Avro in Golang

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leveraging Apache Kafka and its Streams API. Models are built with Python, H2O, TensorFlow, Keras, DeepLearning4 and other technologies.