230 Open source projects that are alternatives of or similar to platys-modern-data-platform

[Archive] Intern project - Big Data Exploration using MongoDB - This Repository is NOT a supported MongoDB product

Information Inference Service of the OpenAIRE system

Liquibase extension to add Impala Database support

An ORC File Scheme for the Cascading data processing platform.

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Hadoop utility to compact small files

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Scalable data processing pipelines in JavaScript

SQL backend to dplyr for Impala

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

This repository contains Machine-Learning MapReduce codes for Hadoop which are written from scratch (without using any package or library). E.g. Prediction (Linear and Logistic Regression), Clustering (K-Means), Classification (KNN) etc.

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Teradata Distribution of Presto -- A Distributed SQL Query Engine for Big Data

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

Documentation placeholder and utilities for all the other containers.

基于Hadoop的分布式云存储系统 🌴

General Architecture for Text Engineering

Open Source Phasor Data Concentrator

一个对用户行为日志进行分析的大数据项目

Export Hadoop YARN (resource-manager) metrics in prometheus format

Tidy up Spark and Hadoop tutorials.

A tool and library for easily deploying applications on Apache YARN

Simple Java Framework,designed for easily develop Spring based java program.Support Bigdata And metadata management.A common elasticsearch comm query tool and so on.

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

A library for manipulating bioinformatics sequencing formats in Apache Spark

网站点击流离线日志分析

Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix

Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.

基于hadoop+hbase+springboot实现分布式网盘系统

clusterdock is a framework for creating Docker-based container clusters

论坛日志分析系统清洗程序(包含IP规则库，UDF开发，MapReduce程序，日志数据)

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

大数据生态圈学习

Import data from clickhouse to hadoop with pure SQL

Data pipeline project

Visualizations of the Hadoop Ecosystem

Hive Storage Handler for interoperability between BigQuery and Apache Hive

Docker file for Hadoop 3

同步Hive数据仓库数据到Elasticsearch的小工具

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Smart Automation Tool for building modern Data Lakes and Data Pipelines

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

大数据学习笔记，学习路线，技术案例整理。

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Node.js WebHDFS REST API client

Fast desktop client for Hadoop Distributed File System

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

gomrjob - a Go Framework for Hadoop Map Reduce Jobs

Avro Schema Evolution made easy

Terraform module to deploy Cloudera on Oracle Cloud Infrastructure (OCI)

Hadoop splittable InputFormat for ROS. Process rosbag with Hadoop Spark and other HDFS compatible systems.

Manage Apache Atlas and Ranger configuration for your Hadoop environment.

Code for the deployment of Hadoop clusters, written in Bourne or Bourne Again shell.

UEBA Solution for Insider Security. This repo is archived. Thanks!

Prometheus jmx_exporter configurations for Cloudera Hadoop