1760 Open source projects that are alternatives of or similar to Schemer

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

Iceberg is a table format for large, slow-moving tabular data

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

A SQL-like language for performing ETL transformations.

A list of command line tools for manipulating structured text data

A CLI tool to convert CSV / Excel / HTML / JSON / Jupyter Notebook / LDJSON / LTSV / Markdown / SQLite / SSV / TSV / Google-Sheets to a SQLite database file.

Record Query - A tool for doing record analysis and transformation

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

CSVs sliced, diced & analyzed.

Parquet file generator

Code examples for my blog posts

A collection of Apache Parquet add-on modules

Make record oriented data to columnar format.

A large-scale entity and relation database supporting aggregation of properties

Avro SerDe for Apache Spark structured APIs.

🧚 pxi (pixie) is a small, fast, and magical command-line data processor similar to jq, mlr, and awk.

Confluent Schema Registry for Kafka

🎼 Docker compose files for various kafka stacks

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

Like Awk but with SQL and table joins

A tool for data sampling, data generation, and data diffing

swiss-army knife for data

Optimized Analytics Package for Spark* Platform

Flexible, Fast & Compact Serialization with RPC

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

A tool for batch loading data files (json, parquet, csv, tsv) into ElasticSearch

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Bucketing and partitioning system for Parquet

pytablewriter is a Python library to write a table in various formats: CSV / Elasticsearch / HTML / JavaScript / JSON / LaTeX / LDJSON / LTSV / Markdown / MediaWiki / NumPy / Excel / Pandas / Python / reStructuredText / SQLite / TOML / TSV.

Spark SQL index for Parquet tables

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

How to use Parquet in Flink

A terminal spreadsheet multitool for discovering and arranging data

GCS support for avro-tools, parquet-tools and protobuf

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Map nested JSON structures onto PHP classes

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

高性能表格数据导出器

A Boilerplate of GraphQL API built in Rust + Warp + Juniper + Diesel

circe for play

nativejson-benchmark in Rust

Displays JSON files in a flat format.

Flexible, reusable and concise configuration for Kubernetes

Powerful java configuration library for toml, yaml, hocon, json and in-memory configurations

Gson TypeAdapter & Factory generator for Kotlin data classes

simdjson_php bindings for the simdjson project. https://github.com/lemire/simdjson

Relation Extraction using Deep learning(CNN)

A simple Swift library for working with generic JSON structures

spark summit 2017 SanFrancisco

Use JSONPath to selectively extract data from any JSON or GraphQL API directly into Google Sheets.

In-memory NoSQL database with ACID transactions, Raft consensus, and Redis API

🔧 Use dplyr to analyze Big Data 🐘

Code and projects from my blog posts.

An extension to redis-py for using Redis' ReJSON module

Replace fields in json, replacing by something, don't care if property is in depth objects. Very useful to replace passwords credit card number, etc.