231 Open source projects that are alternatives of or similar to Hadoop Hdfs

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

Mirror of Apache Hadoop MapReduce

Docker containers for Hadoop.

Mirror of Apache Calcite - Avatica

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Multiple node cluster on Docker for self development.

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

A pandas-like deferred expression system, with first-class SQL support

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Road to Machine Learning

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Big Data Toolkit for the JVM

Alluxio, data orchestration for analytics and machine learning in the cloud

Mirror of Apache Chukwa

💎🔥大数据学习笔记

Asakusa Framework

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Generic Data Ingestion & Dispersal Library for Hadoop

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Kafka Connect HDFS connector

Go package to read and write parquet files. parquet is a file format to store nested data structures in a flat columnar data format. It can be used in the Hadoop ecosystem and with tools such as Presto and AWS Athena.

Iceberg is a table format for large, slow-moving tabular data

Axibase Time Series Database Documentation

Apache Ignite

Apache Hadoop

Apache Hive

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Gathers scalable tensorflow and infrastructure deployment

An implementation of locality sensitive hashing with Hadoop

Apache Tez

Griffon Data Science Virtual Machine

Data Lineage Tracking And Visualization Solution

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Create clusters of VMs on the cloud and configure them with Ansible.

Production Ready Data Integration Product, documentation：

Lightweight, simple structured NoSQL database for Android

https://www.researchgate.net/profile/Rajah_Iyer

hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE

HBase客户端数据管理软件

phData Pulse application log aggregation and monitoring

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

A complete (distributed) BigData stack, running in containers

零基础学习spark，大数据学习

qihoo360 xlearning with GPU support; AI on Hadoop

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

An easy way to deploy your Akka services to a distributed environment.

Fundamentals of Spark with Python (using PySpark), code examples

Apache Parquet implementation in Rust

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等