573 Open source projects that are alternatives of or similar to Sparkflow

C# and F# language binding and extensions to Apache Spark

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Easy pipelines for pandas DataFrames.

Fundamentals of Spark with Python (using PySpark), code examples

Extensible streaming ingestion pipeline on top of Apache Spark

Simple demonstration of how to build a complex real time machine learning visualization tool.

A simplified pipeline for ctDNA sequencing data analysis

基于Pipeline实现的JT1078Gateway支持TCP/UDP,目前只支持http-flv、ws-flv、hls三种拉流方式

Este repositório está destinado ao processo de aprendizagem da biblioteca Pandas.

Realtime data processing and plotting pipelines in Python

Cloud Pipelines Editor is a web app that allows the users to build and run Machine Learning pipelines without having to set up development environment.

An example project that predicts risk of credit card default using a Logistic Regression classifier and a 30,000 sample dataset.

GitLab Merger Bot

Godot Engine Automation Pipeline Android – iOS – Linux – MacOS – Windows – HTML5 – Itch.io.

Pipeline for initial analysis of droplet-based single-cell RNA-seq data

A Python framework for creating reproducible, maintainable and modular data science code.

A library to build and execute typed scientific workflows

Fastest library to load data from DB to DataFrames in Rust and Python

An image build orchestrator for the modern web

A Rust DataFrame implementation, built on Apache Arrow

Prometheus spot instance exporter to monitor AWS instance termination with Hollowtrees

Pipeline as Code with Jenkins

Apache Spark in your IDE with gradle

metaGraf is a opinionated specification for describing a software component and what its requirements are from the runtime environment. The mg command, turns metaGraf specifications into Kubernetes resources, supporting CI, CD and GitOps software delivery.

Use this Property Manager CLI to automate Akamai property changes and deployments across many environments.

Recognize one of six human activities such as standing, sitting, and walking using a Softmax Classifier trained on mobile phone sensor data.

Pipelines as Code

Asynchronous actions for PySpark

Pipeline for training LSA models using Scikit-Learn.

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

Automatically scrape data and statistics on Coronavirus to make them easily accessible in CSV format

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Makes Interactive Chart Widget, Cleans raw data, Runs baseline models, Interactive hyperparameter tuning & tracking

ETL Library for Machine Learning - data pipelines, data munging and wrangling

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Structural Bioinformatics Training Workshop & Hackathon 2018

Example of how to use ElasticSearch ingest-attachment plugin using JavaScript

Spark structured streaming examples with using of version 3.0.0

A BioWDL variantcalling pipeline for germline DNA data. Starting with FASTQ files to produce VCF files. Category:Multi-Sample

Re-mote operations using SSH and Re-gent

SciKIt-learn Pipeline in PAndas

🏐 Apache Parquet for modern .NET

M-Lab ingestion pipeline

Sets up a mithril.js project with webpack

A python framework to process FITS images. Built for Astronomy.

PySide based TACTIC client for maya, nuke, 3dsmax, houdini, etc

A stream processing framework for high-throughput applications.

DNAscan is a fast and efficient bioinformatics pipeline that allows for the analysis of DNA Next Generation sequencing data, requiring very little computational effort and memory usage.

Map Reduce Implementation of Connected Component on Apache Spark

DataFrame API written in Nim, enabling fast out-of-core data processing

Python DataFrame with fast insert and appends

Sample Maven project with a Jenkinsfile doing git-flow based release management

Riscv32 CPU Project

This repository has been archived, currently maintained version is at https://github.com/iii-companion/companion

Safe, Reliable, and Fast Production Deployments for Kubernetes

RNASeq pipeline

A build system for modular development in Salesforce, delivered as a sfdx plugin that can be implemented in any CI/CD system of choice

A non-intrusive Python pipeline.

Concoures CI Kube Deploment