231 Open source projects that are alternatives of or similar to Hadoop Common

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

基于wifi抓取信息的大数据查询分析系统

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

HBase客户端数据管理软件

Docker containers for Hadoop.

Mirror of Apache Hadoop MapReduce

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

Multiple node cluster on Docker for self development.

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Apache Hadoop

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Road to Machine Learning

Alluxio, data orchestration for analytics and machine learning in the cloud

A pandas-like deferred expression system, with first-class SQL support

💎🔥大数据学习笔记

Mirror of Apache Chukwa

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

Mirror of Apache Calcite - Avatica

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Generic Data Ingestion & Dispersal Library for Hadoop

Asakusa Framework

Kafka Connect HDFS connector

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Iceberg is a table format for large, slow-moving tabular data

Mirror of Apache Hadoop HDFS

Apache Ignite

Axibase Time Series Database Documentation

Apache Hive

Go package to read and write parquet files. parquet is a file format to store nested data structures in a flat columnar data format. It can be used in the Hadoop ecosystem and with tools such as Presto and AWS Athena.

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

Gathers scalable tensorflow and infrastructure deployment

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Apache Tez

An implementation of locality sensitive hashing with Hadoop

Data Lineage Tracking And Visualization Solution

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Create clusters of VMs on the cloud and configure them with Ansible.

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Lightweight, simple structured NoSQL database for Android

Big Data Toolkit for the JVM

hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE

https://www.researchgate.net/profile/Rajah_Iyer

phData Pulse application log aggregation and monitoring

Production Ready Data Integration Product, documentation：

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

A complete (distributed) BigData stack, running in containers

Griffon Data Science Virtual Machine

零基础学习spark，大数据学习

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Fundamentals of Spark with Python (using PySpark), code examples

AI on Hadoop

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

大数据入门指南 ⭐

MapReduce, Spark, Java, and Scala for Data Algorithms Book