201 Open source projects that are alternatives of or similar to seatunnel-example

Production Ready Data Integration Product, documentation：

StreamLine - Streaming Analytics

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

An umbrella project for multiple implementations of model serving

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

Real-Time Event Streaming & Change Data Capture

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

www.vixtract.ru

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

Streaming System 相关的论文读物

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Stream computing platform for bigdata

This repository contains the code base for the Open Stream Processing Benchmark.

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Schema Registry

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

🐧基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Updated repository

Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/

Experiments with Apache Flink.

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Kinesis Connector for Structured Streaming

大数据学习笔记，学习路线，技术案例整理。

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

A tool that help automate deployment to an Apache Flink cluster

Simple yet powerful live data computation framework

基于Apache-bahir-kudu-connector的flink-connector-kudu，支持Flink1.11.x DynamicTableSource/Sink，支持Range分区等

Java library for managing Apache Flink via the Monitoring REST API

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Real Time Twitter Sentiment Analysis Product

Apache Spark and Apache Kafka integration example

从本地IDEA提交Flink/Spark任务到Yarn/k8s集群

Code examples on Apache Spark using python

Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake.

TiDB connectors for Flink/Hive/Presto

大型分布式系统实时监控平台

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Custom state store providers for Apache Spark

scala、spark使用过程中，各种测试用例以及相关资料整理

零基础学习spark，大数据学习

Blog post on ETL pipelines with Airflow

Repository for all parts of the Fortis architecture

Plot live-stats as graph from ApacheSpark application using Lightning-viz

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

A general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notifications, actions, live configuration update, missing metrics, ...

Wormhole is a SPaaS (Stream Processing as a Service) Platform

C# and F# language binding and extensions to Apache Spark

bigdatatutorial

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.

基于spark-ml,spark-mllib,spark-streaming的推荐算法实现

A Flexible and Powerful Parameter Server for large-scale machine learning

Real Time Analytics and Data Pipelines based on Spark Streaming

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

An open source framework for building data analytic applications.

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.