233 Open source projects that are alternatives of or similar to hadoop-deployment-bash

Terraform module to deploy Cloudera on Oracle Cloud Infrastructure (OCI)

CDH安装手册

Apache Phoenix / Hbase Spring Boot Microservices

Hive Storage Handler for interoperability between BigQuery and Apache Hive

大数据生态圈学习

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.

基于Hadoop的分布式云存储系统 🌴

大数据学习笔记，学习路线，技术案例整理。

Open Source Phasor Data Concentrator

Export Hadoop YARN (resource-manager) metrics in prometheus format

论坛日志分析系统清洗程序(包含IP规则库，UDF开发，MapReduce程序，日志数据)

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Data pipeline project

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

Information Inference Service of the OpenAIRE system

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

A tool and library for easily deploying applications on Apache YARN

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Scalable data processing pipelines in JavaScript

A library for manipulating bioinformatics sequencing formats in Apache Spark

Distributed Java micro-services using ZooKeeper

Install hadoop cluster with ansible

[Archive] Intern project - Big Data Exploration using MongoDB - This Repository is NOT a supported MongoDB product

Liquibase extension to add Impala Database support

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

UEBA Solution for Insider Security. This repo is archived. Thanks!

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

General Architecture for Text Engineering

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Parcel for Apache Airflow

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

同步Hive数据仓库数据到Elasticsearch的小工具

SQL backend to dplyr for Impala

Smart Automation Tool for building modern Data Lakes and Data Pipelines

Tidy up Spark and Hadoop tutorials.

This repository contains Machine-Learning MapReduce codes for Hadoop which are written from scratch (without using any package or library). E.g. Prediction (Linear and Logistic Regression), Clustering (K-Means), Classification (KNN) etc.

Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix

Dockerfiles and Docker Compose for HDP 2.6 with Blueprints

Node.js WebHDFS REST API client

Prometheus jmx_exporter configurations for Cloudera Hadoop

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Hadoop utility to compact small files

gomrjob - a Go Framework for Hadoop Map Reduce Jobs

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Simple Java Framework,designed for easily develop Spring based java program.Support Bigdata And metadata management.A common elasticsearch comm query tool and so on.

一个对用户行为日志进行分析的大数据项目

Management and automation platform for Stateful Distributed Systems

An ORC File Scheme for the Cascading data processing platform.

Source code and dataset for paper "CBMR: An optimized MapReduce for item‐based collaborative filtering recommendation algorithm with empirical analysis"

Teradata Distribution of Presto -- A Distributed SQL Query Engine for Big Data

Kafka Connect FileSystem Connector

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

网站点击流离线日志分析

Import data from clickhouse to hadoop with pure SQL

Avro Schema Evolution made easy