231 Open source projects that are alternatives of or similar to Hadoop

Train TensorFlow models on YARN in just a few lines of code!

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

🐘 Source code for assignments of Udacity course "Introduction to Hadoop and MapReduce"

Mirror of Linkedin's Camus

A big data platform for analyzing web access logs

Support TensorFlow on YARN

Hive UDFs for funnel analysis

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Code to index HDFS to Solr using MapReduce

大数据入门指南 ⭐

Cookbook to install Hadoop 2.0+ using Chef

MapReduce, Spark, Java, and Scala for Data Algorithms Book

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

🚢 Docker image for Apache Spark

Ephemeral Hadoop clusters using Google Compute Platform

Apache Hadoop docker image

extremely distributed machine learning

A light-weight distributed stream computing framework for Golang

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

A Spark cluster setup running on Docker containers

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

A Java NIO file system provider for HDFS

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Mirror of Apache Hadoop MapReduce

Real-time analysis and visualization with Storm-AMQ-Camel-Websockets-Highcharts integration.

A pandas-like deferred expression system, with first-class SQL support

Multiple node cluster on Docker for self development.

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Road to Machine Learning

Asakusa Framework

Mirror of Apache Chukwa

HBase客户端数据管理软件

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Go package to read and write parquet files. parquet is a file format to store nested data structures in a flat columnar data format. It can be used in the Hadoop ecosystem and with tools such as Presto and AWS Athena.

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Griffon Data Science Virtual Machine

Axibase Time Series Database Documentation

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

Big Data Toolkit for the JVM

An implementation of locality sensitive hashing with Hadoop

Production Ready Data Integration Product, documentation：

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

https://www.researchgate.net/profile/Rajah_Iyer

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Mirror of Apache Calcite - Avatica

零基础学习spark，大数据学习

AntsDB is a low latency, high concurrency, MySQL compliant SQL layer for HBase

An easy way to deploy your Akka services to a distributed environment.

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

基于wifi抓取信息的大数据查询分析系统

Apache Parquet implementation in Rust

AI on Hadoop

A large-scale entity and relation database supporting aggregation of properties

Apache Drill is a distributed MPP query layer for self describing data

Python client for Hadoop® YARN API