230 Open source projects that are alternatives of or similar to prefect-saturn

The easiest way to automate your data

funsies is a lightweight workflow engine 🔧

Reusable workflow library for Django

Notebooks that support blog posts and tech talks on Dask / Coiled.

Temporal service

a workflow engine

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

数据可视化, 数据挖掘, 数据处理 ETL

A collection of online resources to help you on your Tech journey.

Workflow engine for exploration of simulation models using high throughput computing

⚡️ An efficient cache for the execution of dask graphs.

nFlow is a battle-proven solution for orchestrating business processes. It can be used as microservices orchestrator (Saga-pattern), as business process engine or as persistent finite-state machine.

Simple and reliable workflow engine, written in Ruby

Less-Resilient MapReduce framework for Go

KubeGene - A turn-key Genome Sequencing workflow management framework

Easy way to define, execute and store quality rules for your data.

[Deprecated, use flor_core instead] A Rails engine which providing essential infrastructure of workflow. It's based on Workflow Nets.

CSVs sliced, diced & analyzed.

Reusable workflow library for Django

Reproducibility for Humans: A lightweight tool to perform reproducible machine learning experiment.

Lightweight workflow engine

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

A lightweight parallel task engine

Distributed Xarray with Apache Beam

Kogito examples - Kogito is a cloud-native business automation technology for building cloud-ready business applications.

The official repository for the AiiDA code

Run Cloud Native workflows on any environment using Dapr

The open source technology for business process management

Workflow engine in C# .NET Core

Listen to your to PostgreSQL database in realtime via websockets. Built with Elixir.

Dummy variable generation with fit/transform capabilities

Kogito Runtimes - Kogito is a cloud-native business automation technology for building cloud-ready business applications.

🪴 Nebari - your open source data science platform

Cuneiform distributed programming language

Postier is a Laravel API automation platform to transfer data and to sync apps. You can build workflows with data and actions of multiple apps and apply logics to the data!

Function Composition for OpenFaaS

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

Distributed SQL Engine in Python using Dask

Cylc: a workflow engine for cycling systems. Repository master branch: core meta-scheduler component of cylc-8 (in development); Repository 7.8.x branch: full cylc-7 system.

A client for connecting and running DDLs on hive metastore.

Distributed Workflow Engine for Microservices Orchestration

DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.

Software Delivery Workflow For Kubernetes

Blog post on ETL pipelines with Airflow

A simple finite state machine (FSM) with workflow character where you define your workflows in code.

DEPRECATED: Stream data processing micro-framework

FlowCore is a Rails engine to help you build your automation or business process application.

A curated list of awesome dbt resources

🚥 Petrinet framework for PHP

Integration between Micronaut and Camunda (Workflow Engine). We configure Camunda with sensible defaults, so that you can get started with minimum configuration: simply add a dependency in your Micronaut project to embed the workflow engine!

A DSL for data-driven computational pipelines

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

The Prefect API and backend

A curated list of big data engineering tools, resources and communities.

Java framework for Cadence Workflow Service

Effortless Microservice Design and Integration. This repository includes the code-base for the Warewolf Studio and Server.

Useful SQL queries for Blockchain ETL datasets in BigQuery.

Radio Astronomy Algorithms Library

A simple guide to understand Prefect and make it work with your own docker-compose configuration.