231 Open source projects that are alternatives of or similar to Hadoop Mapreduce

An implementation of locality sensitive hashing with Hadoop

Apache Tez

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

Data Lineage Tracking And Visualization Solution

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Create clusters of VMs on the cloud and configure them with Ansible.

Docker containers for Hadoop.

Lightweight, simple structured NoSQL database for Android

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

phData Pulse application log aggregation and monitoring

Road to Machine Learning

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

A complete (distributed) BigData stack, running in containers

https://www.researchgate.net/profile/Rajah_Iyer

qihoo360 xlearning with GPU support; AI on Hadoop

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Hadoop WebHDFS output plugin for Fluentd

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

OLAP and ETL of Big Data

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Open-source distribute workflow schedule tools, also support streaming task.

Alluxio, data orchestration for analytics and machine learning in the cloud

🐘 A local Hadoop cluster bootstrapper using Vagrant, Ansible, and Ambari.

Multiple node cluster on Docker for self development.

Today I Learned

💎🔥大数据学习笔记

DataFibers Data Service

零基础学习spark，大数据学习

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

Learn by doing projects

Axibase Time Series Database Documentation

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

A set of commands for managing CDH clusters using Cloudera Manager REST API.

An easy way to deploy your Akka services to a distributed environment.

Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....

Generic Data Ingestion & Dispersal Library for Hadoop

Docker file for Hadoop 3

Mirror of Apache Chukwa

clusterdock is a framework for creating Docker-based container clusters

Kafka Connect HDFS connector

Fast desktop client for Hadoop Distributed File System

Real-time analysis and visualization with Storm-AMQ-Camel-Websockets-Highcharts integration.

网站点击流离线日志分析

Iceberg is a table format for large, slow-moving tabular data

Import data from clickhouse to hadoop with pure SQL

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

Apache Ignite

Cookbook to install Hadoop 2.0+ using Chef

Mirror of Linkedin's Camus

Train TensorFlow models on YARN in just a few lines of code!

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!