148 Open source projects that are alternatives of or similar to Avro

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Apache Avro serializer for .NET

☀️ Avro, Protobuf, Thrift on Swagger

🎼 Docker compose files for various kafka stacks

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

TypeScript Code Generator for Apache Avro Schema Types

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Image captioning using attention models

This is an ongoing re-implementation of DeepLab_v3_plus on pytorch which is trained on VOC2012 and use ResNet101 for backbone.

A client UI to inspect Kafka topics, consume, produce and much more

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

Using LSTM or Transformer to solve Image Captioning in Pytorch

Demo code of the paper: "Deep Image Harmonization", Y.-H. Tsai, X. Shen, Z. Lin, K. Sunkavalli, X. Lu and M.-H. Yang, CVPR 2017

Embedding模型代码和学习笔记总结

最新版ffmpeg3.3-android，并通过CMake方式移植到Android中,并实现编解码，转码，推拉流，滤镜等各种功能

eForest: Reversible mapping between high-dimensional data and path rule identifiers using trees embedding

Ruby DSL to create Avro schemas

[AAAI'20] Segmenting Medical MRI via Recurrent Decoding Cell (Spotlight)

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

A library for strong, schema based conversion between 'natural' JSON documents and Avro

A CLI and Go client for Kafka Schema Registry

A correct and safe JSON parser.

FFmpegCommand适用于Android的FFmpeg命令库，实现了对音视频相关的处理，能够快速的处理音视频，大概功能包括：音视频剪切，音视频转码，音视频解码原始数据，音视频编码，视频转图片或gif，视频添加水印，多画面拼接，音频混音，视频亮度和对比度，音频淡入和淡出效果等

Wrangler Transform: A DMD system for transforming Big Data

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Compile Apache Avro schema files to TypeScript classes

Sequence to sequence learning using TensorFlow.

The official BaDSV specification and CLI. Ascend from your puny DSV files!

Implementation of abstractive summarization using LSTM in the encoder-decoder architecture with local attention.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

What's in your data? Extract schema, statistics and entities from datasets

The metrics pipeline for DC/OS 1.9-1.11

A library that makes it easier to use the Avro serialization format from Ruby.

Web tool for Avro Schema Registry |

Avro Schema Evolution made easy

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Generate json-schemas for flowtype definitions

slot filling, intent detection, joint training, ATIS & SNIPS datasets, the Facebook’s multilingual dataset, MIT corpus, E-commerce Shopping Assistant (ECSA) dataset, CoNLL2003 NER, ELMo, BERT, XLNet

封装了一些Java常用的功能

Repository of "An Empirical Study of Incorporating Pseudo Data into Grammatical Error Correction" (EMNLP-IJCNLP 2019)

Make record oriented data to columnar format.

A tool for data sampling, data generation, and data diffing

Standalone alternatives to Kafka Connect Connectors

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

Four styles of encoder decoder model by Python, Theano, Keras and Seq2Seq

A collection of Apache Parquet add-on modules

A library provides consumer/producer to work with kafka, avro and schema registry

Writing an Avro file is not as fast as you might want it. This is a library to write considerably faster to an avro file.

TextBox is an open-source library for building text generation system.

Code and data form the paper BERT Got a Date: Introducing Transformers to Temporal Tagging

Kafka backed service library.

A SQL-like language for performing ETL transformations.

Avro SerDe for Apache Spark structured APIs.

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

Scala library to eliminate boilerplate

Avro support for kotlinx.serialization

Bangla Machine Translator

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.