231 Open source projects that are alternatives of or similar to Hadoop Common

OLAP and ETL of Big Data

Real-time analysis and visualization with Storm-AMQ-Camel-Websockets-Highcharts integration.

🐘 A local Hadoop cluster bootstrapper using Vagrant, Ansible, and Ambari.

AntsDB is a low latency, high concurrency, MySQL compliant SQL layer for HBase

Today I Learned

MySQL to NoSQL real time dataflow

DataFibers Data Service

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Learn by doing projects

基于wifi抓取信息的大数据查询分析系统

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

A set of commands for managing CDH clusters using Cloudera Manager REST API.

HBase客户端数据管理软件

Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....

Docker containers for Hadoop.

Docker file for Hadoop 3

Mirror of Apache Hadoop MapReduce

clusterdock is a framework for creating Docker-based container clusters

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Fast desktop client for Hadoop Distributed File System

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

网站点击流离线日志分析

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

Import data from clickhouse to hadoop with pure SQL

Multiple node cluster on Docker for self development.

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Avro Schema Evolution made easy

Apache Hadoop

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.

Road to Machine Learning

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Alluxio, data orchestration for analytics and machine learning in the cloud

Visualizations of the Hadoop Ecosystem

A pandas-like deferred expression system, with first-class SQL support

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

💎🔥大数据学习笔记

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Mirror of Apache Chukwa

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

Terraform module to deploy Cloudera on Oracle Cloud Infrastructure (OCI)

Mirror of Apache Calcite - Avatica

A tool and library for easily deploying applications on Apache YARN

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

A library for manipulating bioinformatics sequencing formats in Apache Spark

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Generic Data Ingestion & Dispersal Library for Hadoop

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Fundamentals of Spark with Python (using PySpark), code examples

AI on Hadoop

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

大数据入门指南 ⭐

MapReduce, Spark, Java, and Scala for Data Algorithms Book

low-level helpers for Apache Spark libraries and tests