824 Open source projects that are alternatives of or similar to Drill

Apache Parquet

💎🔥大数据学习笔记

Apache Ignite

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

Apache Parquet implementation in Rust

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

Big Data Ecosystem Docker

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Simple windows desktop application for viewing & querying Apache Parquet files

Building Large-Scale AI Applications for Distributed Big Data

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Manipulate arrays of complex data structures as easily as Numpy.

Smart Automation Tool for building modern Data Lakes and Data Pipelines

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Iceberg is a table format for large, slow-moving tabular data

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

同步Hive数据仓库数据到Elasticsearch的小工具

Hive Storage Handler for interoperability between BigQuery and Apache Hive

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

深圳地铁大数据客流分析系统🚇🚄🌟

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Manage Apache Atlas and Ranger configuration for your Hadoop environment.

一个对用户行为日志进行分析的大数据项目

Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

No description or website provided.

ACID Data Source for Apache Spark based on Hive ACID

Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

OLAP and ETL of Big Data

🏐 Apache Parquet for modern .NET

A complete (distributed) BigData stack, running in containers

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

SQL backend to dplyr for Impala

Apache Tez

Apache Parquet

Apache Spark - A unified analytics engine for large-scale data processing

A Spark cluster setup running on Docker containers

The most complete and powerful data-binding library and persistence infra for Kotlin 1.3, Android & Splitties Views DSL, JavaFX & TornadoFX, JSON, JDBC & SQLite, SharedPreferences.

Example end to end data engineering project.

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Distributed Big Data Orchestration Service

Python interface to Hive and Presto. 🐝

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

Snowflake JDBC Driver

Read SparkSQL parquet file as RDD[Protobuf]

Multiple node cluster on Docker for self development.

Mirror of Linkedin's Camus