117 Open source projects that are alternatives of or similar to avrora

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.

MongoDB Kafka Connector

Apache Avro is a data serialization system.

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

Flexible, Fast & Compact Serialization with RPC

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Record Query - A tool for doing record analysis and transformation

A fast Go Avro codec

Avro SerDe for Apache Spark structured APIs.

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

Scala library to eliminate boilerplate

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

A collection of Magnolia add-on modules

Kafka backed service library.

Avro support for kotlinx.serialization

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Ruby DSL to create Avro schemas

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

GCS support for avro-tools, parquet-tools and protobuf

The metrics pipeline for DC/OS 1.9-1.11

A library provides consumer/producer to work with kafka, avro and schema registry

Avrocado is a convenience library to handle Avro in Golang

Avro for JavaScript ⚡️

☀️ Avro, Protobuf, Thrift on Swagger

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Avro schema generation and serialization / deserialization for Scala

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Iceberg is a table format for large, slow-moving tabular data

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Web tool for Avro Schema Registry |

A tool for data sampling, data generation, and data diffing

Divolte Collector

Gradle plugin to interact with Confluent Schema-Registry.

A SQL-like language for performing ETL transformations.

Showcases how to build a small Event-sourced application using Spring Boot, Spring Kafka, Apache Avro and Apache Kafka

Apache Avro serializer for .NET

🎼 Docker compose files for various kafka stacks

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors

Confluent's Apache Kafka Golang client

Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Confluent's Kafka Python Client

Confluent's Apache Kafka .NET client

Kafka Connect suite of connectors for Cloud storage (Amazon S3)

Mirror of Linkedin's Camus

[DEPRECATED] Docker images for Confluent Platform.

Kafka Connect connector for JDBC-compatible databases

Kafka Connect Elasticsearch connector

Kafka Connect HDFS connector

Ansible playbooks for the Confluent Platform

Confluent Platform Demo including Apache Kafka, ksqlDB, Control Center, Replicator, Confluent Schema Registry, Security

System integration and performance tests

KLoadGen is kafka load generator plugin for jmeter designed to work with AVRO and JSON schema Registries.