282 Open source projects that are alternatives of or similar to Parquet Rs

A pandas-like deferred expression system, with first-class SQL support

零基础学习spark，大数据学习

基于wifi抓取信息的大数据查询分析系统

An easy way to deploy your Akka services to a distributed environment.

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

MapReduce, Spark, Java, and Scala for Data Algorithms Book

Mirror of Apache Hadoop MapReduce

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

A scalable Apache Hadoop-based implementation of the Pooled Time Series video similarity algorithm based on M. Ryoo et al paper CVPR 2015.

HBase客户端数据管理软件

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

Read SparkSQL parquet file as RDD[Protobuf]

Parquet file generator

Support TensorFlow on YARN

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Mirror of Linkedin's Camus

Griffon Data Science Virtual Machine

Optimized Analytics Package for Spark* Platform

电商用户行为分析大数据平台

🚢 Docker image for Apache Spark

🍣100本 Java电子书 技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)

extremely distributed machine learning

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

Train TensorFlow models on YARN in just a few lines of code!

定期更新Hadoop生态圈中常用大数据组件文档 重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图 印象笔记 Scala版本简单demo 常用工具类 去敏后的train code 持续更新!!!)

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.

Apache Hadoop docker image

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

🐘 Source code for assignments of Udacity course "Introduction to Hadoop and MapReduce"

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Hive UDFs for funnel analysis

Gathers scalable tensorflow and infrastructure deployment

A light-weight distributed stream computing framework for Golang

大数据入门指南 ⭐

A Spark cluster setup running on Docker containers

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster. See https://github.com/Cascading/cascading for the release repository.

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

Spark SQL index for Parquet tables

Apache Ignite

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Mirror of Apache Calcite - Avatica

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

An implementation of locality sensitive hashing with Hadoop

Apache Parquet

Scalable, redundant, and distributed object store for Apache Hadoop

GCS support for avro-tools, parquet-tools and protobuf

Fast data store for Pandas time-series data

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Apache Tez

AntsDB is a low latency, high concurrency, MySQL compliant SQL layer for HBase

Code to index HDFS to Solr using MapReduce

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

A consistent table management library in python