310 Open source projects that are alternatives of or similar to Parquet Go

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Big Data Ecosystem Docker

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

Apache Parquet implementation in Rust

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

Alluxio, data orchestration for analytics and machine learning in the cloud

Apache Drill is a distributed MPP query layer for self describing data

The official home of the Presto distributed SQL query engine for big data

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Iceberg is a table format for large, slow-moving tabular data

OLAP and ETL of Big Data

A large-scale entity and relation database supporting aggregation of properties

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Big Data Toolkit for the JVM

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Hive UDFs for funnel analysis

Python client for Hadoop® YARN API

A light-weight distributed stream computing framework for Golang

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

Apache Parquet

An implementation of locality sensitive hashing with Hadoop

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

基于wifi抓取信息的大数据查询分析系统

Axibase Time Series Database Documentation

Python interface to Hive and Presto. 🐝

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

Mirror of Apache Hadoop MapReduce

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Production Ready Data Integration Product, documentation：

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

GCS support for avro-tools, parquet-tools and protobuf

A Spark cluster setup running on Docker containers

Cookbook to install Hadoop 2.0+ using Chef

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Code to index HDFS to Solr using MapReduce

Read SparkSQL parquet file as RDD[Protobuf]

https://www.researchgate.net/profile/Rajah_Iyer

NodeJS module to access apache parquet format files

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Spark SQL index for Parquet tables

大数据入门指南 ⭐

Multiple node cluster on Docker for self development.

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Quilt is a self-organizing data hub for S3

Mirror of Linkedin's Camus

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

A big data platform for analyzing web access logs

AntsDB is a low latency, high concurrency, MySQL compliant SQL layer for HBase

Multiple node presto cluster on docker container

零基础学习spark，大数据学习

A Java NIO file system provider for HDFS

Road to Machine Learning

An easy way to deploy your Akka services to a distributed environment.