581 Open source projects that are alternatives of or similar to Ratatool

GCS support for avro-tools, parquet-tools and protobuf

A collection of Magnolia add-on modules

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

Record Query - A tool for doing record analysis and transformation

Iceberg is a table format for large, slow-moving tabular data

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

How to use Parquet in Flink

Read SparkSQL parquet file as RDD[Protobuf]

A collection of Apache Parquet add-on modules

Confluent Schema Registry for Kafka

Make record oriented data to columnar format.

Comparison and benchmark of JavaScript serialization libraries (Protocol Buffer, Avro, BSON, etc.)

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

googleapis generated with gogoprotobuf

Spring Boot-based gRPC server with gRPC endpoints secured by Spring Security

📥 Game Tracker: SteamVR Home

Sync files and directories from a remote Git repo. CLI and Gradle Plugin.

Gradle plugin to interact with Confluent Schema-Registry.

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

简单的Buffer编码/解析模块

This service is meant to simplify running Google Cloud operations, especially BigQuery tasks. This means you do not have to worry about installation, configuration or ongoing maintenance related to an SDK environment. This can be helpful to those who would prefer to not to be responsible for those activities.

A high-performance async/non-blocking redis client components for dotnet core,default data formater json protobuf and messagepack,support ssl

High performance sFlow/IPFIX/NetFlow Collector

Create full-fledged APIs for static datasets without writing a single line of code.

Open Source Feature Flagging and A/B Testing Platform

An all-inclusive protoc Docker image

It is used to define the format of the data and validate it in the Ulord blockchain.

All inclusive Protocol Buffer and gRPC suite, powered by Docker and Alpine

An exporter for converting BigQuery results into Prometheus metrics

🎲 Simple tic tac toe game for Android

Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for integration testing.

📥 Game Tracker: Team Fortress 2

A SQL-like language for performing ETL transformations.

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

BigQuery Foreign Data Wrapper for PostgreSQL

A protobuf linter for visual studio code

Fast and Scalable RPC Framework

parse interface to pinus-protobuf JSON

A protoc plugin for generating OCaml code from protobuf (.proto) files.

Kotlin multiplatform / multi-format serialization

Protobuf code generation for Micro. Moved to go-micro/cmd/protoc-gen-micro.

Generate Python API client libraries from Protocol Buffers.

AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery

Netty Chat tutorial with Protobuf

The data structure for unstructured data

Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.

A Protocol Buffers codec generator for OCaml

Google BigQuery for Laravel

Protoc compiler for Go kit code

gRPC library for Cisco IOS XR

🎣 List of `pre-commit` hooks to ensure the quality of your `dbt` projects.

Protobuf code generation