dangkaka / Go Kafka Avro
Licence: apache-2.0
A library provides consumer/producer to work with kafka, avro and schema registry
Stars: ✭ 39
Programming Languages
go
31211 projects - #10 most used programming language
Projects that are alternatives of or similar to Go Kafka Avro
Schema Registry
Confluent Schema Registry for Kafka
Stars: ✭ 1,647 (+4123.08%)
Mutual labels: kafka, avro
Slimmessagebus
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Stars: ✭ 120 (+207.69%)
Mutual labels: kafka, avro
Open Bank Mark
A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.
Stars: ✭ 81 (+107.69%)
Mutual labels: kafka, avro
Schema Registry
A CLI and Go client for Kafka Schema Registry
Stars: ✭ 105 (+169.23%)
Mutual labels: kafka, avro
Kafka Connect Mongodb
**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
Stars: ✭ 137 (+251.28%)
Mutual labels: kafka, avro
Storagetapper
StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Stars: ✭ 232 (+494.87%)
Mutual labels: kafka, avro
Kafkactl
Command Line Tool for managing Apache Kafka
Stars: ✭ 177 (+353.85%)
Mutual labels: kafka, avro
Examples
Demo applications and code examples for Confluent Platform and Apache Kafka
Stars: ✭ 571 (+1364.1%)
Mutual labels: kafka, avro
Pmacct
pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
Stars: ✭ 677 (+1635.9%)
Mutual labels: kafka, avro
Bigdata Playground
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Stars: ✭ 177 (+353.85%)
Mutual labels: kafka, avro
Schema Registry Ui
Web tool for Avro Schema Registry |
Stars: ✭ 358 (+817.95%)
Mutual labels: kafka, avro
Kafka Storm Starter
Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Stars: ✭ 728 (+1766.67%)
Mutual labels: kafka, avro
Sarama Cluster
Cluster extensions for Sarama, the Go client library for Apache Kafka 0.9 [DEPRECATED]
Stars: ✭ 969 (+2384.62%)
Mutual labels: kafka
Kafkatools
CLI tools for monitoring and managing Apache Kafka
Stars: ✭ 13 (-66.67%)
Mutual labels: kafka
go-kafka-avro
A library provides consumer/producer to work with kafka, avro and schema registry
Installation
$ go get github.com/dangkaka/go-kafka-avro
Usage
Consumer/producer examples stay here
cd dangkaka/go-kafka-avro/examples
-
Setup kafka, schema-registry
docker-compose up -d -
Add test messages
go run producer/main.go -n 10 -
Run consumer
go run consumer/main.go
References
- Kafka sarama
- Encodes and decodes Avro data goavro
- Consumer group sarama-cluster
- schema-registry
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].