All Projects → Barski-lab → Cwl Airflow

Barski-lab / Cwl Airflow

Licence: apache-2.0
Python package to extend Airflow functionality with CWL1.1 support

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Cwl Airflow

Cyclone
Powerful workflow engine and end-to-end pipeline solutions implemented with native Kubernetes resources. https://cyclone.dev
Stars: ✭ 978 (+652.31%)
Mutual labels:  dag, workflow
Airflow Maintenance Dags
A series of DAGs/Workflows to help maintain the operation of Airflow
Stars: ✭ 914 (+603.08%)
Mutual labels:  dag, workflow
Cromwell
Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
Stars: ✭ 655 (+403.85%)
Mutual labels:  workflow, containers
Sarek
Detect germline or somatic variants from normal or tumour/normal whole-genome or targeted sequencing
Stars: ✭ 124 (-4.62%)
Mutual labels:  workflow, containers
Common Workflow Language
Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊
Stars: ✭ 1,222 (+840%)
Mutual labels:  workflow, containers
Argo Workflows
Workflow engine for Kubernetes
Stars: ✭ 10,024 (+7610.77%)
Mutual labels:  dag, workflow
Ngx Graph
Graph visualization library for angular
Stars: ✭ 704 (+441.54%)
Mutual labels:  dag, workflow
Xene
A distributed workflow runner focusing on performance and simplicity.
Stars: ✭ 56 (-56.92%)
Mutual labels:  dag, workflow
Bitnami Docker Airflow
Bitnami Docker Image for Apache Airflow
Stars: ✭ 89 (-31.54%)
Mutual labels:  workflow, containers
Liteflow
liteflow是一个基于任务版本来实现的分布式任务流调度系统
Stars: ✭ 112 (-13.85%)
Mutual labels:  dag, workflow
Microwf
A simple finite state machine (FSM) with workflow character where you define your workflows in code.
Stars: ✭ 122 (-6.15%)
Mutual labels:  workflow
Dffml
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
Stars: ✭ 123 (-5.38%)
Mutual labels:  dag
P2plab
performance benchmark infrastructure for IPLD DAGs
Stars: ✭ 126 (-3.08%)
Mutual labels:  containers
Ckube
A cli to simplify working with kubectl for some common workflows
Stars: ✭ 127 (-2.31%)
Mutual labels:  containers
Go2seccomp
Generate seccomp profiles from go binaries
Stars: ✭ 122 (-6.15%)
Mutual labels:  containers
Grunt Drupal Tasks
Grunt-based build and testing tasks for Drupal
Stars: ✭ 125 (-3.85%)
Mutual labels:  workflow
Openflow
Scalable, secure workflow solution
Stars: ✭ 122 (-6.15%)
Mutual labels:  workflow
Dksnap
Docker Snapshots for Development and Test Data
Stars: ✭ 122 (-6.15%)
Mutual labels:  containers
Pipedream
Connect APIs, remarkably fast. Free for developers.
Stars: ✭ 2,068 (+1490.77%)
Mutual labels:  workflow
Ops
Tools&scripts for daily devops.
Stars: ✭ 128 (-1.54%)
Mutual labels:  containers

DOI Python 3.7 Apache 2.0 Build Status Coverage Status Downloads

CWL-Airflow

Python package to extend Apache-Airflow 2.0.1 functionality with CWL v1.1 support

Cite as

Michael Kotliar, Andrey V Kartashov, Artem Barski, CWL-Airflow: a lightweight pipeline manager supporting Common Workflow Language, GigaScience, Volume 8, Issue 7, July 2019, giz084, https://doi.org/10.1093/gigascience/giz084

Get the latest version

pip install cwl-airflow

Latest version documentation

Get published version

pip install cwl-airflow==1.0.18

Published version documentation

Notes

When running on MacOS, you might need to set up the following env variable before starting airflow scheduler/webserver

export OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].