318 Open source projects that are alternatives of or similar to Hudi

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

A Server Side Event stream to deliver Reddit comments and submissions in near real-time to a client.

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Window-Based Hybrid CPU/GPU Stream Processing Engine

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.

Grid Solutions Framework

AWS Auto Terminate Idle AWS EMR Clusters Framework is an AWS based solution using AWS CloudWatch and AWS Lambda using a Python script that is using Boto3 to terminate AWS EMR clusters that have been idle for a specified period of time.

Sort files and pack them into partitions

Plot live-stats as graph from ApacheSpark application using Lightning-viz

flink学习笔记

This toolkit supports common internet protocols, such as HTTP and WebSockets

Cross-platform, customizable ML solutions for live and streaming media.

🐟 A streaming ETL for fish

The LeoFS Storage System

Distributed Stream and Batch Processing

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

C# and F# language binding and extensions to Apache Spark

10-weeks of technology exploration

Wayeb is a Complex Event Processing and Forecasting (CEP/F) engine written in Scala.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

Elastic data processing with Apache Pulsar and Apache Flink

Efficient, easy-to-use, and fast PHP JSON stream parser

A project to help people stand in line at the market as little as possible

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualize and explore big tabular data at a billion rows per second 🚀

Apache Avro is a data serialization system.

Framework for building Event-Driven Microservices

biglasso: Extending Lasso Model Fitting to Big Data in R

A stream processing API for Go (alpha)

liteflow是一个基于任务版本来实现的分布式任务流调度系统

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Streaming System 相关的论文读物

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

A serverless cluster computing system for the Go programming language

Presto-like CLI tool for AWS Athena

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Jigsaw七巧板 provides a set of web components based on Angular5/8/9+. The main purpose of Jigsaw is to help the application developers to construct complex & intensive interacting & user friendly web pages. Jigsaw is supporting the development of all applications of Big Data Product of ZTE.

大数据博客、笔试题、教程、项目、面经的整理

A high performance/ real-time C++ Kafka streams framework (C++17)

The database purpose-built for stream processing applications.

🐳 big data study

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

Machine is a workflow/pipeline library for processing data

A list about Apache Kafka

Distributed Stream Processing

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

type-class based data cleansing library for Apache Spark SQL

High Performance HTTP Sidecar Load Balancer

Samsara is a real-time analytics platform

DataWave is an ingest/query framework that leverages Apache Accumulo to provide fast, secure data access.

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Big Data for Data Engineers Coursera Specialization from Yandex

Countly Product Analytics SDK for Cordova, Icenium and Phonegap

Stream Processing and Complex Event Processing Engine