230 Open source projects that are alternatives of or similar to MLHadoop

同步Hive数据仓库数据到Elasticsearch的小工具

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

A tool and library for easily deploying applications on Apache YARN

Data pipeline project

Source code and dataset for paper "CBMR: An optimized MapReduce for item‐based collaborative filtering recommendation algorithm with empirical analysis"

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

大数据学习笔记，学习路线，技术案例整理。

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Simple Java Framework,designed for easily develop Spring based java program.Support Bigdata And metadata management.A common elasticsearch comm query tool and so on.

Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix

大数据生态圈学习

bigdatatutorial

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Hive Storage Handler for interoperability between BigQuery and Apache Hive

Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.

Smart Automation Tool for building modern Data Lakes and Data Pipelines

Terraform module to deploy Cloudera on Oracle Cloud Infrastructure (OCI)

Node.js WebHDFS REST API client

Avro Schema Evolution made easy

gomrjob - a Go Framework for Hadoop Map Reduce Jobs

A library for manipulating bioinformatics sequencing formats in Apache Spark

Management and automation platform for Stateful Distributed Systems

Visualizations of the Hadoop Ecosystem

Kafka Connect FileSystem Connector

基于hadoop+hbase+springboot实现分布式网盘系统

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Docker image for main Apache Hadoop components (Yarn/Hdfs)

General Architecture for Text Engineering

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

SQL backend to dplyr for Impala

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

Information Inference Service of the OpenAIRE system

一个对用户行为日志进行分析的大数据项目

基于Hadoop的分布式云存储系统 🌴

Tidy up Spark and Hadoop tutorials.

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

Hadoop utility to compact small files

Open Source Phasor Data Concentrator

Prometheus jmx_exporter configurations for Cloudera Hadoop

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Export Hadoop YARN (resource-manager) metrics in prometheus format

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Scalable data processing pipelines in JavaScript

Teradata Distribution of Presto -- A Distributed SQL Query Engine for Big Data

Distributed Java micro-services using ZooKeeper

An ORC File Scheme for the Cascading data processing platform.

Install hadoop cluster with ansible

UEBA Solution for Insider Security. This repo is archived. Thanks!

Dockerfiles and Docker Compose for HDP 2.6 with Blueprints

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

Apache Phoenix / Hbase Spring Boot Microservices

Liquibase extension to add Impala Database support

[Archive] Intern project - Big Data Exploration using MongoDB - This Repository is NOT a supported MongoDB product

Import data from clickhouse to hadoop with pure SQL

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

论坛日志分析系统清洗程序(包含IP规则库，UDF开发，MapReduce程序，日志数据)