95 Open source projects that are alternatives of or similar to dotnet-avro

Scala library to eliminate boilerplate

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

A CLI and Go client for Kafka Schema Registry

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

A collection of Magnolia add-on modules

Kafka backed service library.

Avro support for kotlinx.serialization

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.

Ruby DSL to create Avro schemas

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

GCS support for avro-tools, parquet-tools and protobuf

The metrics pipeline for DC/OS 1.9-1.11

Demo applications and code examples for Confluent Platform and Apache Kafka

A library provides consumer/producer to work with kafka, avro and schema registry

Avrocado is a convenience library to handle Avro in Golang

Avro for JavaScript ⚡️

☀️ Avro, Protobuf, Thrift on Swagger

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Avro schema generation and serialization / deserialization for Scala

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Iceberg is a table format for large, slow-moving tabular data

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Web tool for Avro Schema Registry |

A tool for data sampling, data generation, and data diffing

Divolte Collector

Gradle plugin to interact with Confluent Schema-Registry.

A SQL-like language for performing ETL transformations.

Showcases how to build a small Event-sourced application using Spring Boot, Spring Kafka, Apache Avro and Apache Kafka

Library for generating avro schema files (.avsc) based on DB tables structure

Apache Avro serializer for .NET

Confluent REST Proxy for Kafka

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors