87 Open source projects that are alternatives of or similar to goavro

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

A collection of Apache Parquet add-on modules

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.

Standalone alternatives to Kafka Connect Connectors

A fast Go Avro codec

What's in your data? Extract schema, statistics and entities from datasets

A collection of Magnolia add-on modules

Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.

Mu (μ) is a purely functional framework for building micro services.

The metrics pipeline for DC/OS 1.9-1.11

Make record oriented data to columnar format.

MongoDB Kafka Connector

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

Convert XSD -> AVSC and XML -> AVRO

A CLI and Go client for Kafka Schema Registry

How to use Parquet in Flink

Avro support for kotlinx.serialization

Avro Schema Evolution made easy

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

A PHP 7.3+ API client for the Confluent Schema Registry REST API based on Guzzle 6 - http://docs.confluent.io/current/schema-registry/docs/index.html

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

Demo applications and code examples for Confluent Platform and Apache Kafka

Lego bricks to build Apache Kafka serializers and deserializers

Command Line Tool for managing Apache Kafka

Count records in Avro files efficiently

A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.

Kafka De/Serializer using avro and Confluent's Schema Registry

Apache Avro is a data serialization system.

Wrangler Transform: A DMD system for transforming Big Data

Flexible, Fast & Compact Serialization with RPC

Scalable package delivery logistics simulator built using SingleStore and Vectorized Redpanda

Record Query - A tool for doing record analysis and transformation

📙 json & avro http schema registry backed by Kafka

Avro SerDe for Apache Spark structured APIs.

Golang Client for Schema Registry

Scala library to eliminate boilerplate

A library for strong, schema based conversion between 'natural' JSON documents and Avro

Confluent Schema Registry for Kafka

Writing an Avro file is not as fast as you might want it. This is a library to write considerably faster to an avro file.

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

A library that makes it easier to use the Avro serialization format from Ruby.

Kafka backed service library.

Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Compile Apache Avro schema files to TypeScript classes

Ruby DSL to create Avro schemas

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

GCS support for avro-tools, parquet-tools and protobuf

Generate json-schemas for flowtype definitions

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

An Avro Library that emphasizes testability and ease of use.

An avro converter for Kafka Connect without a Schema Registry

Language definition and parser for AVRO (.avdl) files.

PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service