248 Open source projects that are alternatives of or similar to Avro

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Make record oriented data to columnar format.

A project to help people stand in line at the market as little as possible

Confluent Schema Registry for Kafka

The Programming Language Designed For Big Data and AI

liteflow是一个基于任务版本来实现的分布式任务流调度系统

All code samples, scripts and more in-depth examples for the book high performance in-memory computing with Apache Ignite. Please use the repository "the-apache-ignite-book" for Ignite version 2.6 or above.

Avro SerDe for Apache Spark structured APIs.

汇总Apache Hudi相关资料

🌲 Configuration flaws detector for Hadoop, MongoDB, MySQL, and more!

Big Data for Data Engineers Coursera Specialization from Yandex

Source code for James Lee's Aparch Spark with Java course

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Monitor twitter stream

Apache Mnemonic - A non-volatile hybrid memory storage oriented library

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

Avro support for kotlinx.serialization

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.

基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法

type-class based data cleansing library for Apache Spark SQL

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction

The metrics pipeline for DC/OS 1.9-1.11

A CLI and Go client for Kafka Schema Registry

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Record Query - A tool for doing record analysis and transformation

大数据入门指南 ⭐

Scala library to eliminate boilerplate

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

A collection of Magnolia add-on modules

Distributed Big Data Orchestration Service

biglasso: Extending Lasso Model Fitting to Big Data in R

A fast Go Avro codec

Kafka backed service library.

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

Presto-like CLI tool for AWS Athena

技术书籍等

Ruby DSL to create Avro schemas

TipDM建模平台，开源的数据挖掘工具。

ROOT I/O in pure Python and NumPy.

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Flexible, Fast & Compact Serialization with RPC

Countly Product Analytics SDK for Cordova, Icenium and Phonegap

A curated list of awesome big data frameworks, ressources and other awesomeness.

GCS support for avro-tools, parquet-tools and protobuf

Sort files and pack them into partitions

Demo applications and code examples for Confluent Platform and Apache Kafka

GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

🐳 big data study

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

A Cloud Native Batch System (Project under CNCF)