1515 Open source projects that are alternatives of or similar to hadoop-data-ingestion-tool

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

大数据入门指南 ⭐

Fundamentals of Spark with Python (using PySpark), code examples

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

The official home of the Presto distributed SQL query engine for big data

SQL backend to dplyr for Impala

TT Tech Research Notes

Apache Hive

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Apache Tez

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Asakusa Framework

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Apache Drill is a distributed MPP query layer for self describing data

Griffon Data Science Virtual Machine

Easily make RESTful web services for time series reporting with Big Data analytics engines like Druid and SQL Databases.

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

A large-scale entity and relation database supporting aggregation of properties

A Presto client for the Go programming language.

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

ClickHouse® is a free analytics DBMS for big data

Kafka Connect HDFS connector

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Apache Ignite

Microsoft's contributions for Spark with Apache Accumulo

A Spark cluster setup running on Docker containers

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Apache Phoenix / Hbase Spring Boot Microservices

An Apache Phoenix Hibernate dialect

Big Data Toolkit for the JVM

Mirror of Apache Calcite - Avatica

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Apache Calcite

Semi-official Apache CouchDB Docker images

An easy to use, self-service open BI reporting and BI dashboard platform.

Scalable, redundant, and distributed object store for Apache Hadoop

Samples to the Oracle Big Data Lite VM

bigdatatutorial

Export Hadoop YARN (resource-manager) metrics in prometheus format

The metrics layer for your data. Join us at https://metriql.com/slack

Information Inference Service of the OpenAIRE system

Apache Phoenix Query Server

Apache CouchDB Packaging support files

同步Hive数据仓库数据到Elasticsearch的小工具

Mirror of Apache Phoenix

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Deploy a secured, clustered, auto-scaling NiFi service in AWS.

Liquibase extension to add Impala Database support

Apache Arrow DataFusion SQL Query Engine

A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

深圳地铁大数据客流分析系统🚇🚄🌟