310 Open source projects that are alternatives of or similar to Parquet Go

基于wifi抓取信息的大数据查询分析系统

深圳地铁大数据客流分析系统🚇🚄🌟

Axibase Time Series Database Documentation

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Python interface to Hive and Presto. 🐝

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Mirror of Apache Hadoop MapReduce

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Gathers scalable tensorflow and infrastructure deployment

Production Ready Data Integration Product, documentation：

💎🔥大数据学习笔记

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Presto Ethereum Connector -- SQL on Ethereum

A Spark cluster setup running on Docker containers

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Code to index HDFS to Solr using MapReduce

An easy way to deploy your Akka services to a distributed environment.

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster. See https://github.com/Cascading/cascading for the release repository.

Kafka Connect HDFS connector

Read SparkSQL parquet file as RDD[Protobuf]

NodeJS module to access apache parquet format files

High performance distributed data processing engine

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Building Large-Scale AI Applications for Distributed Big Data

Quilt is a self-organizing data hub for S3

Web-based SQL editor run in your own private cloud. Supports MySQL, Postgres, SQL Server, Vertica, Crate, ClickHouse, Trino, Presto, SAP HANA, Cassandra, Snowflake, BigQuery, SQLite, and more with ODBC

Mirror of Linkedin's Camus

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

A big data platform for analyzing web access logs

Apache Parquet

AntsDB is a low latency, high concurrency, MySQL compliant SQL layer for HBase

Scalable, redundant, and distributed object store for Apache Hadoop

A Java NIO file system provider for HDFS

Fast data store for Pandas time-series data

Road to Machine Learning

Bucketing and partitioning system for Parquet

Apache Tez

Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White

Data Lineage Tracking And Visualization Solution

Graph-Based Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries – atop Pandas, RDFlib, pySHACL, RAPIDS, NetworkX, iGraph, PyVis, pslpython, pyarrow, etc.

🚢 Docker image for Apache Spark

MapReduce, Spark, Java, and Scala for Data Algorithms Book

A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.

A tool for batch loading data files (json, parquet, csv, tsv) into ElasticSearch

Real-time analysis and visualization with Storm-AMQ-Camel-Websockets-Highcharts integration.

Create clusters of VMs on the cloud and configure them with Ansible.

Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.

Mirror of Apache Chukwa

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Lightweight, simple structured NoSQL database for Android

MySQL to NoSQL real time dataflow

A tool for data sampling, data generation, and data diffing

🏐 Apache Parquet for modern .NET

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.