157 Open source projects that are alternatives of or similar to registryless-avro-converter

Avro SerDe for Apache Spark structured APIs.

Scala library to eliminate boilerplate

☁️ nodejs kafka connect connector for Google BigQuery

Golang Client for Schema Registry

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Enables you to start and stop a fully-fledged embedded Kafka cluster from within JUnit and provides a rich set of convenient accessors and fault injectors through a lean API. Supports working against external clusters as well.

Kafka backed service library.

Create Kafka-Connect clusters with docker . You put the Kafka, we put the Connect.

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Ruby DSL to create Avro schemas

Writing an Avro file is not as fast as you might want it. This is a library to write considerably faster to an avro file.

GCS support for avro-tools, parquet-tools and protobuf

A Kafka source connector capturing Scylla CDC changes

Demo applications and code examples for Confluent Platform and Apache Kafka

This repository contains a Kafka Connect sink connector for copying data from Apache Kafka into IBM MQ.

Avrocado is a convenience library to handle Avro in Golang

Kafka Connect Connector for Jenkins Open Source Continuous Integration Tool

☀️ Avro, Protobuf, Thrift on Swagger

How to use Parquet in Flink

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Iceberg is a table format for large, slow-moving tabular data

PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka

Web tool for Avro Schema Registry |

Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.

Apache Kafka running on Kubernetes

Mirus is a cross data-center data replication tool for Apache Kafka

A SQL-like language for performing ETL transformations.

Kafka Connect FileSystem Connector

Playground for Kafka/Confluent Docker experimentations

Data model generator based on Scala case classes

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

Kafka Connect Tooling

Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for integration testing.

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Flexible, Fast & Compact Serialization with RPC

A REPL for Apache Kafka

A client UI to inspect Kafka topics, consume, produce and much more

Kafka Connect connectors for Azure Cosmos DB

Command Line Tool for managing Apache Kafka

A library for strong, schema based conversion between 'natural' JSON documents and Avro

Compile Apache Avro schema files to TypeScript classes

Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data

A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.

Kafka De/Serializer using avro and Confluent's Schema Registry

Record Query - A tool for doing record analysis and transformation

Kafka Connect suite of connectors for Cloud storage (Amazon S3)

Apache Avro is a data serialization system.

Kafka Connect connector for reading CSV files into Kafka.

What's in your data? Extract schema, statistics and entities from datasets

Standalone alternatives to Kafka Connect Connectors

Demonstrations for Kafka with Spring Boot

Wrangler Transform: A DMD system for transforming Big Data

Language definition and parser for AVRO (.avdl) files.

🥑 Kafka connect sink connector for ArangoDB

Scalable package delivery logistics simulator built using SingleStore and Vectorized Redpanda

A fast Go Avro codec