87 Open source projects that are alternatives of or similar to Avrocado

Avro Schema Evolution made easy

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

A PHP 7.3+ API client for the Confluent Schema Registry REST API based on Guzzle 6 - http://docs.confluent.io/current/schema-registry/docs/index.html

Apache Avro serializer for .NET

Make record oriented data to columnar format.

A tool for data sampling, data generation, and data diffing

How to use Parquet in Flink

An Avro Library that emphasizes testability and ease of use.

Language definition and parser for AVRO (.avdl) files.

Mu (μ) is a purely functional framework for building micro services.

Library for generating avro schema files (.avsc) based on DB tables structure

What's in your data? Extract schema, statistics and entities from datasets

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka

🎼 Docker compose files for various kafka stacks

Standalone alternatives to Kafka Connect Connectors

Avro schema generation and serialization / deserialization for Scala

A collection of Apache Parquet add-on modules

Comparison and benchmark of JavaScript serialization libraries (Protocol Buffer, Avro, BSON, etc.)

Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.

Gradle plugin to interact with Confluent Schema-Registry.

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

An avro converter for Kafka Connect without a Schema Registry

Compile Apache Avro schema files to TypeScript classes

Command Line Tool for managing Apache Kafka

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

Count records in Avro files efficiently

Iceberg is a table format for large, slow-moving tabular data

📙 json & avro http schema registry backed by Kafka

Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for integration testing.

A library that makes it easier to use the Avro serialization format from Ruby.

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Generate json-schemas for flowtype definitions

An Avro implementation for .NET

Lego bricks to build Apache Kafka serializers and deserializers

Web tool for Avro Schema Registry |

Kafka De/Serializer using avro and Confluent's Schema Registry

TypeScript Code Generator for Apache Avro Schema Types

Scalable package delivery logistics simulator built using SingleStore and Vectorized Redpanda

☀️ Avro, Protobuf, Thrift on Swagger

Golang Client for Schema Registry

A client UI to inspect Kafka topics, consume, produce and much more

Writing an Avro file is not as fast as you might want it. This is a library to write considerably faster to an avro file.

Divolte Collector

Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala

Goavro translates between Go native types and binary and textual Avro data

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

A library for strong, schema based conversion between 'natural' JSON documents and Avro

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

A SQL-like language for performing ETL transformations.

Wrangler Transform: A DMD system for transforming Big Data

Avro for JavaScript ⚡️

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Showcases how to build a small Event-sourced application using Spring Boot, Spring Kafka, Apache Avro and Apache Kafka

Convert XSD -> AVSC and XML -> AVRO