693 Open source projects that are alternatives of or similar to Cloudflow

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

SANSA Query Layer

A library that provides useful extensions to Apache Spark and PySpark.

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

Pusher meets Akka

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Code Library for My Blog

Boiler plate framework to use Spark and ZIO together.

Microservice for safe sharing and easy access to medical images

Apache Spark and Apache Kafka integration example

给flink开发的web系统。支持页面上定义udf，进行sql和jar任务的提交；支持source、sink、job的管理；可以管理openshift上的flink集群

Kinesis Connector for Structured Streaming

Template for Akka Streams & Kafka. Default impl: mirror a topic onto another one

📊 Cube — Open-Source Analytics API for Building Data Apps

low-level helpers for Apache Spark libraries and tests

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

A really small library (just a few classes) which lets you trace your actors messages transparently propagating a common context together with your messages and adding the specified values to the MDC of the underlying logging framework.

extremely distributed machine learning

A complete (distributed) BigData stack, running in containers

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Proto Actor - Ultra fast distributed actors

Some class materials for a data processing course using PySpark

Simple and Distributed Machine Learning

Base types for OnlineStats.

Apache Spark (PySpark) Practice on Real Data

🐤 Another Twitter stream PHP library to retrieve filtered tweets on hot.

Spark SQL index for Parquet tables

Flink Tutorial Project

🐍 Quick reference guide to common patterns & functions in PySpark.

Stream Processing Made Easy

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

A Linux based software package to control led's on Logitech G910, G810, G610 and G410.

Lichess' websocket server

Source code for James Lee's Aparch Spark with Java course

Framework for building distributed microserviceies in scala with akka-streams and kafka

Spark Terasort

Sample project for Apache Flink with Streaming Engine and JDBC Sink

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

A Scala kernel for Jupyter

This repository contains the code base for the Open Stream Processing Benchmark.

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Enabling queries on compressed data.

Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake.

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

A compiler for Pig Latin to Spark and Flink.

A scalable nearest neighbor search library in Apache Spark

spark summit 2017 SanFrancisco

Open-source distribute workflow schedule tools, also support streaming task.

Spark on Kubernetes infrastructure Helm charts repo

基于Apache-bahir-kudu-connector的flink-connector-kudu，支持Flink1.11.x DynamicTableSource/Sink，支持Range分区等

Run spark calculations from Ammonite

HL7 Apache Spark Datasource

Realtime calculation distributed system. AKA distributed lodash

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

🎼 Docker compose files for various kafka stacks

A quotation-based Scala DSL for scalable data analysis.

A better compressed bitset in Java