1356 Open source projects that are alternatives of or similar to God Of Bigdata

Data Lineage Tracking And Visualization Solution

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Real Time Analytics and Data Pipelines based on Spark Streaming

Mirror of Linkedin's Camus

Fundamentals of Spark with Python (using PySpark), code examples

Code and presentation for Strata Model Serving tutorial

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

📁 Extract, Transform, Load (ETL) 👷 refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.

汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识

大数据分析可视化实践

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

A pandas-like deferred expression system, with first-class SQL support

Big Data Toolkit for the JVM

Big Data Processing Framework - Unified Data API or SQL on Any Storage

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Kafka Connect HDFS connector

DeviceHive Java Server

Docker image for main Apache Hadoop components (Yarn/Hdfs)

Apache Phoenix / Hbase Spring Boot Microservices

⚡️ Nepxion Thunder is a distribution RPC framework based on Netty + Hessian + Kafka + ActiveMQ + Tibco + Zookeeper + Redis + Spring Web MVC + Spring Boot + Docker 多协议、多组件、多序列化的分布式RPC调用框架

bigdatatutorial

Kafka Connect FileSystem Connector

Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

Management and automation platform for Stateful Distributed Systems

Scalable data processing pipelines in JavaScript

Serverless Platform for the stateful services

大型分布式系统实时监控平台

🐧基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)

Easy parsing of Apache HTTPD and NGINX access logs with Java, Hadoop, Hive, Pig, Flink, Beam, Storm, Drill, ...

Smart Automation Tool for building modern Data Lakes and Data Pipelines

基于Hadoop的分布式云存储系统 🌴

Hive Storage Handler for interoperability between BigQuery and Apache Hive

Iceberg is a table format for large, slow-moving tabular data

Kafka Web UI

大数据生态圈学习

基于hadoop+hbase+springboot实现分布式网盘系统

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

A tool and library for easily deploying applications on Apache YARN

Web tool for Kafka Connect |

Tidy up Spark and Hadoop tutorials.

Core utility library & data connectors designed for simpler usage in Scala

Flink: Stateful Computations over Data Streams

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Liquibase extension to add Impala Database support

基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步

Learning Flink : Flink CEP,Flink Core,Flink SQL

Moonbox is a DVtaaS (Data Virtualization as a Service) Platform

Gathers scalable tensorflow and infrastructure deployment

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

Avro Schema Evolution made easy

Hadoop utility to compact small files

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Generic Data Ingestion & Dispersal Library for Hadoop

Fast desktop client for Hadoop Distributed File System

Documentation placeholder and utilities for all the other containers.

Collection of Kubernetes Operators built with KUDO.

Repair hbase metadata table from hdfs.

Hadoop splittable InputFormat for ROS. Process rosbag with Hadoop Spark and other HDFS compatible systems.