95 Open source projects that are alternatives of or similar to dotnet-avro

Standalone alternatives to Kafka Connect Connectors

Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala

Confluent Schema Registry for Kafka

Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for integration testing.

Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.

📙 json & avro http schema registry backed by Kafka

A PHP 7.3+ API client for the Confluent Schema Registry REST API based on Guzzle 6 - http://docs.confluent.io/current/schema-registry/docs/index.html

A library that makes it easier to use the Avro serialization format from Ruby.

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry

Writing an Avro file is not as fast as you might want it. This is a library to write considerably faster to an avro file.

Pulsar IO Kafka Connector

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

A client UI to inspect Kafka topics, consume, produce and much more

How to use Parquet in Flink

An avro converter for Kafka Connect without a Schema Registry

What's in your data? Extract schema, statistics and entities from datasets

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

Avro Schema Evolution made easy

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Mu (μ) is a purely functional framework for building micro services.

Comparison and benchmark of JavaScript serialization libraries (Protocol Buffer, Avro, BSON, etc.)

Convert XSD -> AVSC and XML -> AVRO

Generate json-schemas for flowtype definitions

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

MongoDB Kafka Connector

A collection of Apache Parquet add-on modules

Count records in Avro files efficiently

Puppet Module for installing and configuring the Confluent Platform

A library for strong, schema based conversion between 'natural' JSON documents and Avro

Event Sourcing(CQRS) and Materialized views with Kafka Streams

Lego bricks to build Apache Kafka serializers and deserializers

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Language definition and parser for AVRO (.avdl) files.

Kafka De/Serializer using avro and Confluent's Schema Registry

A fast Go Avro codec

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

Wrangler Transform: A DMD system for transforming Big Data

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)

Command Line Tool for managing Apache Kafka

TypeScript Code Generator for Apache Avro Schema Types

A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.

PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka

Apache Avro is a data serialization system.

Compile Apache Avro schema files to TypeScript classes

Flexible, Fast & Compact Serialization with RPC

Make record oriented data to columnar format.

Record Query - A tool for doing record analysis and transformation

Goavro translates between Go native types and binary and textual Avro data

Avro SerDe for Apache Spark structured APIs.

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

Scala library to eliminate boilerplate

Getting Confluent Kafka components to work on Mac OS X

Scalable package delivery logistics simulator built using SingleStore and Vectorized Redpanda

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

🎼 Docker compose files for various kafka stacks

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

An Avro Library that emphasizes testability and ease of use.