693 Open source projects that are alternatives of or similar to Cloudflow

ACID Data Source for Apache Spark based on Hive ACID

本项目收藏这些年来看过或者听过的一些不错的书籍，在整理文件时看见这些，发现删掉有点可惜，放着又太浪费空间，本着分享的原则，就把它们共享出来，一方面给需要的读者提供这些书籍，另一方面也是一种像知识库的积累吧

Visualize column-level data lineage in Spark SQL

blog entries

spark on kubernetes

Distributed scikit-learn meta-estimators in PySpark

Real-time ETL developed by Flink, data from MySQL to Greenplum. Use canal to parse the MySQL binlog, put it into kafka, use Flink to consume kafka and assemble the data into Greenplum, and more data sources and target sources will be added in the future.

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

A minimal seed template for an Akka with Scala build

♦️ nvim host plugin provider and API client library in Scala

flink详细学习实践

A library that provides useful extensions to Apache Spark and PySpark.

Code Library for My Blog

给flink开发的web系统。支持页面上定义udf，进行sql和jar任务的提交；支持source、sink、job的管理；可以管理openshift上的flink集群

low-level helpers for Apache Spark libraries and tests

A complete (distributed) BigData stack, running in containers

Some class materials for a data processing course using PySpark

Flink Tutorial Project

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

Framework for building distributed microserviceies in scala with akka-streams and kafka

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Enabling queries on compressed data.

Open-source distribute workflow schedule tools, also support streaming task.

HL7 Apache Spark Datasource

Resources for Spark AR

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Example of bootstrapping Akka Cluster with Consul

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

Spark functions to run popular phonetic and string matching algorithms

ETL Library for Machine Learning - data pipelines, data munging and wrangling

The Hunting ELK

Reactive: Examples of the most famous reactive libraries that you can find in the market.

Kylo integration with PDND (previously DAF).

Collection of different demo applications using Apache Spark

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

Akka Chinese Book / What should be included in it?

LarkMidTable 是一站式开源的数据中台，实现中台的 基础建设，数据治理，数据开发，监控告警，数据服务，数据的可视化，实现高效赋能数据前台并提供数据服务的产品。

Atomic event store for Scala/Akka

dllib is a distributed deep learning library running on Apache Spark

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Icicle Streaming Query Language

PowerAPI is a middleware toolkit for building software-defined power meters

Demos of how to do custom stream processing using the Akka Streams GraphStages API

Telegram bot to generate self-authorizations for moving around during covid-19 pandemic in France

Flink Forward China 2018 第一届记录，视频记录 | 文档记录 | 不仅仅是流计算 | More than streaming

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

UC Berkeley team's submission for RecSys Challenge 2018

Simple demonstration of how to build a complex real time machine learning visualization tool.

DataFibers Data Service

Massively real-time city transit streaming application

Sample Applications for Pravega.

FBLYZE is a Facebook scraping system and analysis system.

NestJS File Streaming With MongoDB

尚硅谷大数据Spark-2019版最新 Spark 学习

TPC-H queries in Apache Spark SQL using native DataFrames API

FlinkTutorial 专注大数据Flink流试处理技术。从基础入门、概念、原理、实战、性能调优、源码解析等内容，使用Java开发，同时含有Scala部分核心代码。欢迎关注我的博客及github。

A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Akka plugin to collect various data about actors