Top 371 pipeline open source projects

Let's get the ball rolling on some Container-driven CI & CD

Turn Java 8 Streams into Unix like pipelines

A SingleCell RNASeq pre-processing snakemake workflow

Lightweight, Python library for fast and reproducible experimentation 🔬

A Julia package for piping a value through a series of transformation expressions using a more convenient syntax than Julia's native piping functionality.

Modern WebGL state wrapper for PEX: allocate GPU resources (textures, buffers), setup state pipelines and passes, and combine them into commands.

System for containerized apps management. From build to scaling.

Puppet Container Registry

UGENE is free open-source cross-platform bioinformatics software

A file watcher and development tool.

📺 TV dashboard for a global view on Gitlab Pipelines

Mutlitenancy for dotnet applications

SUPRA: Software Defined Ultrasound Processing for Real-Time Applications - An Open Source 2D and 3D Pipeline from Beamforming to B-Mode

GoCD (gocd.org) plugin to push build notifications to Slack

Data transformations for the ML era

A DSL for data-driven computational pipelines

VisTrails is an open-source data analysis and visualization tool. It provides a comprehensive provenance infrastructure that maintains detailed history information about the steps followed and data derived in the course of an exploratory task: VisTrails maintains provenance of data products, of the computational processes that derive these products and their executions.

Forte is a flexible and powerful NLP builder FOR TExt. This is part of the CASL project: http://casl-project.ai/

An R-focused pipeline toolkit for reproducibility and high-performance computing

Sample application and CD Pipeline for DevOps Dojo

Jenkins pipeline steps for integration with JIRA.

DSP pipeline

Get protein embeddings from protein sequences

A pipelining tool to automate and standardise bioinformatics analyses on cluster environments.

Terraform Module for CI/CD with AWS Code Pipeline and Code Build for ECS https://cloudposse.com/

A cross-platform tool for data pipelines.

Dockerised Next Generation Sequencing Pipeline (QC, Align, Calling, Annotation)

A simple Spark-powered ETL framework that just works 🍺

Machine is a workflow/pipeline library for processing data

Jenkins-Plugin to create a multi-branch-project from gitlab

MLBox is a powerful Automated Machine Learning python library.

Robust and efficient workflows using a simple language agnostic approach

ATAC-seq peak-calling, QC and differential analysis pipeline

The Darkest Pipeline - Multithreaded pipelines for modern C++

integrated RNA-seq Analysis Pipeline

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

Example workflows for the drake R package

Making whole bacterial genome sequencing data analysis easy

streaming pipeline with a mutable configuration

🌅 Dawn is a lightweight task management and build tool for front-end and nodejs.

SalmonTE is an ultra-Fast and Scalable Quantification Pipeline of Transpose Element (TE) Abundances

Analysis pipelines for sequencing data

For extensive instructor led learning

EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource

Groovy pipeline jobs that build and test Container Linux with Jenkins

contains handy groovy workflow-libs scripts

Data Stream Processing API for GO

stream splicer with labels

A simple longslit spectroscopy pipeline in Python

A Julia machine learning framework

Displays CI statuses on a dashboard and triggers fun modules representing the status!

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

Shared Library for Jenkine Pipeline

NLP pipeline software using common workflow language

Codefresh runtime-environment agent

Connect processes into powerful data pipelines with a simple git-like filesystem interface

A full-stack DevOps on AWS framework

PyTorch extensions for fast R&D prototyping and Kaggle farming

Simple Automated CI/CD Pipeline for GitHub and GitLab Projects