DataBiosphere / Toil
Licence: apache-2.0
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
Stars: ✭ 733
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Toil
Nextflow
A DSL for data-driven computational pipelines
Stars: ✭ 1,337 (+82.4%)
Mutual labels: aws, pipeline
bistro
A library to build and execute typed scientific workflows
Stars: ✭ 43 (-94.13%)
Mutual labels: workflow, pipeline
Aws Serverless Cicd Workshop
Learn how to build a CI/CD pipeline for SAM-based applications
Stars: ✭ 158 (-78.44%)
Mutual labels: aws, pipeline
Terraform Aws Ecs Codepipeline
Terraform Module for CI/CD with AWS Code Pipeline and Code Build for ECS https://cloudposse.com/
Stars: ✭ 85 (-88.4%)
Mutual labels: aws, pipeline
Targets
Function-oriented Make-like declarative workflows for R
Stars: ✭ 293 (-60.03%)
Mutual labels: pipeline, workflow
Stepfunctions2processing
Configuration with AWS step functions and lambdas which initiates processing from activity state
Stars: ✭ 90 (-87.72%)
Mutual labels: aws, workflow
Drone Cache
A Drone plugin for caching current workspace files between builds to reduce your build times
Stars: ✭ 194 (-73.53%)
Mutual labels: aws, pipeline
Batchflow
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
Stars: ✭ 156 (-78.72%)
Mutual labels: pipeline, workflow
Arvados
An open source platform for managing and analyzing biomedical big data
Stars: ✭ 274 (-62.62%)
Mutual labels: aws, workflow
cli-property-manager
Use this Property Manager CLI to automate Akamai property changes and deployments across many environments.
Stars: ✭ 22 (-97%)
Mutual labels: workflow, pipeline
Luigi Warehouse
A luigi powered analytics / warehouse stack
Stars: ✭ 72 (-90.18%)
Mutual labels: aws, workflow
Pipeline
Pipeline is a package to build multi-staged concurrent workflows with a centralized logging output.
Stars: ✭ 433 (-40.93%)
Mutual labels: pipeline, workflow
Scrapy S3pipeline
Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.
Stars: ✭ 57 (-92.22%)
Mutual labels: aws, pipeline
Aws Workflows On Github
Workflows for automation of AWS services setup from Github CI/CD
Stars: ✭ 95 (-87.04%)
Mutual labels: aws, workflow
Rnaseq Workflow
A repository for setting up a RNAseq workflow
Stars: ✭ 170 (-76.81%)
Mutual labels: pipeline, workflow
Diagram Maker
A library to display an interactive editor for any graph-like data.
Stars: ✭ 2,086 (+184.58%)
Mutual labels: aws, workflow
Ugene
UGENE is free open-source cross-platform bioinformatics software
Stars: ✭ 112 (-84.72%)
Mutual labels: pipeline, workflow
Sarek
Detect germline or somatic variants from normal or tumour/normal whole-genome or targeted sequencing
Stars: ✭ 124 (-83.08%)
Mutual labels: pipeline, workflow
DNAscan
DNAscan is a fast and efficient bioinformatics pipeline that allows for the analysis of DNA Next Generation sequencing data, requiring very little computational effort and memory usage.
Stars: ✭ 36 (-95.09%)
Mutual labels: workflow, pipeline
Rnaseq
RNA sequencing analysis pipeline using STAR, RSEM, HISAT2 or Salmon with gene/isoform counts and extensive quality control.
Stars: ✭ 305 (-58.39%)
Mutual labels: pipeline, workflow
.. image:: https://badges.gitter.im/bd2k-genomics-toil/Lobby.svg :alt: Join the chat at https://gitter.im/bd2k-genomics-toil/Lobby :target: https://gitter.im/bd2k-genomics-toil/Lobby?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge
Toil is a scalable, efficient, cross-platform (Linux & macOS) pipeline management system, written entirely in Python, and designed around the principles of functional programming.
- Check the
website_ for a description of Toil and its features. - Full documentation for the latest stable release can be found at
Read the Docs_. - Please subscribe to low-volume
announce_ mailing list so we keep you informed - Google Groups discussion
forum_ - See our occasional
blog_ for tutorials. - Use
biostars_ channel for discussion.
.. _website: http://toil.ucsc-cgl.org/ .. _Read the Docs: https://toil.readthedocs.io/en/latest .. _announce: https://groups.google.com/forum/#!forum/toil-announce .. _forum: https://groups.google.com/forum/#!forum/toil-community .. _blog: https://toilpipelines.wordpress.com/ .. _biostars: https://www.biostars.org/t/toil/
Notes:
- Toil moved from https://github.com/BD2KGenomics/toil to https://github.com/DataBiosphere/toil on July 5th, 2018.
- Toil dropped python 2.7 support on February 13, 2020 (last working py2.7 version is 3.24.0).
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].