929 Open source projects that are alternatives of or similar to Airflow

Export Airflow metrics (from mysql) in prometheus format

Docker Apache Airflow

Bitnami Docker Image for Apache Airflow Scheduler

Apache Airflow - OpenApi Client for Python

Enterprise job scheduling middleware with distributed computing ability.

Bitnami Docker Image for Apache Airflow

A distributed workflow runner focusing on performance and simplicity.

The official repository for the AiiDA code

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

A complete development environment setup for working with Airflow

A series of DAGs/Workflows to help maintain the operation of Airflow

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

An easy and fast way to build automation and workflows on Windows, Linux, macOS, and the cloud.

Apache Airflow Website

Turn complex requirements to workflows without leaving the comfort of your technology stack.

Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Workflow engine for Kubernetes

Astronomer Core Docker Images

Curated list of resources about Apache Airflow

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

A way for home buyers to know about factors affecting a state

Schedulis is a high performance workflow task scheduling system that supports high availability and multi-tenant financial level features, Linkis computing middleware, and has been integrated into data application development portal DataSphere Studio

Identifies and collects data on cc-licensed content across web crawl data and public apis.

A plugin for Apache Airflow that allows you to edit DAGs in browser

Functional Airflow DAG definitions.

A plugin for Apache Airflow that allows you to manage the users that can login

An orchestration platform for the development, production, and observation of data assets.

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Venture allows you to create and manage complex, async workflows in your Laravel apps.

GitHub Action to setup `ssh-agent` with a private key

Pipeline is a package to build multi-staged concurrent workflows with a centralized logging output.

Create jobs on a time-based schedule on Docker Swarm

Corgi is a command-line workflow manager that helps with your repetitive command usages by organizing them into reusable snippet

Persistent cluster-friendly scheduler for Java

Cross-platform, fiber-based, multi-threaded task scheduler designed for video games.

Turbine: the bare metals that gets you Airflow

Build workflows, activities, BPMN like processes, or state machines with PVM.

Enable Self-Service Operations: Give specific users access to your existing tools, services, and scripts

The simple, stupid workflow engine for Java

A workflow for Alfred that implements translation from any language to any other language that is supported by google

A react Timeline component with virtual rendering

Modern concurrency for C++. Tasks, executors, timers and C++20 coroutines to rule them all

A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

Qubole Sparklens tool for performance tuning Apache Spark

Ansible Role - Apache 2.x.

The open and extensible integrated development environment (IDE) for computer vision with built-in modules for model building, automated labeling, data processing, model training, hyperparameter tuning and workflow orchestration.

Collective Knowledge framework (CK) helps to organize black-box research software as a database of reusable components and micro-services with common APIs, automation actions and extensible meta descriptions. See real-world use cases from Arm, General Motors, ACM, Raspberry Pi foundation and others:

A meeting coordination app for your team

Easy to use, professional error pages to replace the plaintext error pages that come with any server software like Nginx or Apache

Single header C++ Libraries for Thread Scheduling, Rendering, and so on...

Parallel programming with Python

Open source remote collaboration platform used for configuring and deploying enterprise Workflow solutions.

The bash shell script stack for installation of Nginx OpenResty Tengine lua_nginx_module nginx_concat_module nginx_upload_module ngx_substitutions_filter_module　Apache-2.2 Apache-2.4　MySQL-5.1 MySQL-5.5 MySQL-5.6 MySQL-5.7 PHP-5.2 PHP-5.3 PHP-5.4 PHP-5.5 PHP-5.6 ZendOptimizer ZendGuardLoader Xcache Eaccelerator Imagemagick IonCube Memcache Memcached Redis Mongo Xdebug Mssql Memcached PureFtpd PhpMyAdmin Redis Mongodb PhpRedisAdmin MemAdmin RockMongo Jdk7 Jdk8 Tomcat7 Tomcat8

Apache Block Bad Bots, (Referer) Spam Referrer Blocker, Vulnerability Scanners, Malware, Adware, Ransomware, Malicious Sites, Wordpress Theme Detectors and Fail2Ban Jail for Repeat Offenders

A blazing fast js bundler/loader with a comprehensive API 🔥

A rewrite of the Ember.js run loop as a generic microlibrary

Search StackOverflow.com from Alfred

定时任务管理系统