All Projects → pveber → bistro

pveber / bistro

Licence: other
A library to build and execute typed scientific workflows

Programming Languages

ocaml
1615 projects

Projects that are alternatives of or similar to bistro

Rnaseq Workflow
A repository for setting up a RNAseq workflow
Stars: ✭ 170 (+295.35%)
Mutual labels:  workflow, bioinformatics, pipeline
Ugene
UGENE is free open-source cross-platform bioinformatics software
Stars: ✭ 112 (+160.47%)
Mutual labels:  workflow, bioinformatics, pipeline
Scipipe
Robust, flexible and resource-efficient pipelines using Go and the commandline
Stars: ✭ 826 (+1820.93%)
Mutual labels:  workflow, bioinformatics, pipeline
Flowr
Robust and efficient workflows using a simple language agnostic approach
Stars: ✭ 73 (+69.77%)
Mutual labels:  workflow, bioinformatics, pipeline
Galaxy
Data intensive science for everyone.
Stars: ✭ 812 (+1788.37%)
Mutual labels:  workflow, bioinformatics, pipeline
Cookiecutter
DEPRECIATED! Please use nf-core/tools instead
Stars: ✭ 18 (-58.14%)
Mutual labels:  workflow, bioinformatics, pipeline
Sarek
Detect germline or somatic variants from normal or tumour/normal whole-genome or targeted sequencing
Stars: ✭ 124 (+188.37%)
Mutual labels:  workflow, bioinformatics, pipeline
Atacseq
ATAC-seq peak-calling, QC and differential analysis pipeline
Stars: ✭ 72 (+67.44%)
Mutual labels:  workflow, pipeline
Machine
Machine is a workflow/pipeline library for processing data
Stars: ✭ 78 (+81.4%)
Mutual labels:  workflow, pipeline
Drake
An R-focused pipeline toolkit for reproducibility and high-performance computing
Stars: ✭ 1,301 (+2925.58%)
Mutual labels:  workflow, pipeline
Vistrails
VisTrails is an open-source data analysis and visualization tool. It provides a comprehensive provenance infrastructure that maintains detailed history information about the steps followed and data derived in the course of an exploratory task: VisTrails maintains provenance of data products, of the computational processes that derive these products and their executions.
Stars: ✭ 94 (+118.6%)
Mutual labels:  workflow, pipeline
Genomics
A collection of scripts and notes related to genomics and bioinformatics
Stars: ✭ 101 (+134.88%)
Mutual labels:  workflow, bioinformatics
Pegasus
Pegasus Workflow Management System - Automate, recover, and debug scientific computations.
Stars: ✭ 110 (+155.81%)
Mutual labels:  workflow, bioinformatics
Cwl Svg
A library for generating an interactive SVG visualization of CWL workflows
Stars: ✭ 57 (+32.56%)
Mutual labels:  workflow, bioinformatics
Drake Examples
Example workflows for the drake R package
Stars: ✭ 57 (+32.56%)
Mutual labels:  workflow, pipeline
Jenkins Workflow
contains handy groovy workflow-libs scripts
Stars: ✭ 41 (-4.65%)
Mutual labels:  workflow, pipeline
Nlppln
NLP pipeline software using common workflow language
Stars: ✭ 31 (-27.91%)
Mutual labels:  workflow, pipeline
Batchflow
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
Stars: ✭ 156 (+262.79%)
Mutual labels:  workflow, pipeline
Cuneiform
Cuneiform distributed programming language
Stars: ✭ 175 (+306.98%)
Mutual labels:  workflow, bioinformatics
Brunch
🍴 Web applications made easy. Since 2011.
Stars: ✭ 6,801 (+15716.28%)
Mutual labels:  workflow, pipeline

bistro: build and run distributed workflows

bistro is an OCaml library to build and run computations represented by a collection of interdependent scripts, as is often found in applied research (especially computational biology).

Features:

  • build complex and composable workflows declaratively
  • simple and lightweight wrapping of new components
  • resume-on-failure: if something fails, fix it and the workflow will restart from where it stopped
  • distributed workflow execution
  • development-friendly: when a script is modified, bistro automatically finds out what needs to be recomputed
  • automatic naming of generated files
  • static typing: detect file format errors at compile time!

The library provides a datatype to represent scripts (including metadata and dependencies), an engine to run workflows and a standard library providing components for popular tools (although mostly related to computational biology and unix for now).

Questions, suggestions or contributions are welcome, please file an issue as needed.

Documentation

A manual is available, but feel free to file issues if something is unclear or missing. There is also a generated API documentation.

Installation

Detailed instructions are available in the manual. In a nutshell, bistro can be installed using opam. You need a recent (at least 4.03.0) installation of OCaml. Once this is done, simply type

opam install bistro

to install the library, or:

opam pin add -y bistro --dev-repo

to get the current development version.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].