318 Open source projects that are alternatives of or similar to Hudi

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

A curated list of awesome big data frameworks, ressources and other awesomeness.

Python clone of Spark, a MapReduce alike framework in Python

A curated list of awesome big data frameworks, ressources and other awesomeness.

汇总Apache Hudi相关资料

Some class materials for a data processing course using PySpark

汇总Apache Hudi中的一些Demo，便于快速上手Apache Hudi(Apache Hudi Demos to help beginners know about Hudi)

Apache Spark Course Material

Lightweight real-time big data streaming engine over Akka

Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction

A Cloud Native Batch System (Project under CNCF)

Source code for James Lee's Aparch Spark with Java course

Golang Kafka consumer and producer example

A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)

GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.

a curated list of awesome streaming frameworks, applications, etc

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Neo4j Kafka Integrations, Docs =>

大数据入门指南 ⭐

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Kafka Tutorials microsite

Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.

A Python stream processing engine modeled after Yahoo! Pipes

Apache Mnemonic - A non-volatile hybrid memory storage oriented library

All code samples, scripts and more in-depth examples for the book high performance in-memory computing with Apache Ignite. Please use the repository "the-apache-ignite-book" for Ignite version 2.6 or above.

Distributed Big Data Orchestration Service

The Programming Language Designed For Big Data and AI

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

Grid Solutions Framework

Sort files and pack them into partitions

flink学习笔记

Cross-platform, customizable ML solutions for live and streaming media.

The LeoFS Storage System

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Wayeb is a Complex Event Processing and Forecasting (CEP/F) engine written in Scala.

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Elastic data processing with Apache Pulsar and Apache Flink

A project to help people stand in line at the market as little as possible

Apache Avro is a data serialization system.

biglasso: Extending Lasso Model Fitting to Big Data in R

liteflow是一个基于任务版本来实现的分布式任务流调度系统

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

Presto-like CLI tool for AWS Athena

🐳 big data study

A high performance/ real-time C++ Kafka streams framework (C++17)

Monitor twitter stream

技术书籍等

ROOT I/O in pure Python and NumPy.

Machine is a workflow/pipeline library for processing data

Distributed Stream Processing

Kafka client for functional streams for scala (fs2)

type-class based data cleansing library for Apache Spark SQL

Samsara is a real-time analytics platform

基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法

Educational notes,Hands on problems w/ solutions for hadoop ecosystem