231 Open source projects that are alternatives of or similar to Hadoop Mapreduce

Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

Visualizations of the Hadoop Ecosystem

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Gathers scalable tensorflow and infrastructure deployment

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

An implementation of locality sensitive hashing with Hadoop

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

Apache Tez

Terraform module to deploy Cloudera on Oracle Cloud Infrastructure (OCI)

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

A tool and library for easily deploying applications on Apache YARN

Data Lineage Tracking And Visualization Solution

A library for manipulating bioinformatics sequencing formats in Apache Spark

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix

Create clusters of VMs on the cloud and configure them with Ansible.

基于hadoop+hbase+springboot实现分布式网盘系统

Docker containers for Hadoop.

论坛日志分析系统清洗程序(包含IP规则库，UDF开发，MapReduce程序，日志数据)

Lightweight, simple structured NoSQL database for Android

大数据生态圈学习

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Data pipeline project

hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE

Hive Storage Handler for interoperability between BigQuery and Apache Hive

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

同步Hive数据仓库数据到Elasticsearch的小工具

phData Pulse application log aggregation and monitoring

Smart Automation Tool for building modern Data Lakes and Data Pipelines

Road to Machine Learning

大数据学习笔记，学习路线，技术案例整理。

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

Node.js WebHDFS REST API client

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

A complete (distributed) BigData stack, running in containers

gomrjob - a Go Framework for Hadoop Map Reduce Jobs

https://www.researchgate.net/profile/Rajah_Iyer

Simple Java Framework,designed for easily develop Spring based java program.Support Bigdata And metadata management.A common elasticsearch comm query tool and so on.

qihoo360 xlearning with GPU support; AI on Hadoop

Management and automation platform for Stateful Distributed Systems

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Source code and dataset for paper "CBMR: An optimized MapReduce for item‐based collaborative filtering recommendation algorithm with empirical analysis"

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Kafka Connect FileSystem Connector

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

bigdatatutorial

Hadoop WebHDFS output plugin for Fluentd

550+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Kafka, Docker, APIs, Hadoop, SQL, PostgreSQL, MySQL, Hive, Impala, Travis CI, Jenkins, Concourse, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, .tmux.conf, .psqlrc ...

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

OLAP and ETL of Big Data

Cookbook to install Hadoop 2.0+ using Chef

Mirror of Linkedin's Camus

Train TensorFlow models on YARN in just a few lines of code!

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Hadoop utility to compact small files