Top 365 pipeline open source projects

Al usdmaya
This repo is no longer updated. Please see
Morphl Community Edition
MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization
Mipt Mips
Cycle-accurate pre-silicon simulator of RISC-V and MIPS CPUs
Docker Android Build Box
An optimized docker image includes Android, Kotlin, Flutter sdk.
A CLI for interacting with Tekton!
A package that makes it trivial to create and evaluate machine learning pipeline architectures.
🔬 BEDOPS: high-performance genomic feature operations
High-throughput Redis client for Go with implicit pipelining
🐟 High Performance Computing over Kubernetes - Core Repo 🎣
Bulk Writer
Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.
FlowCraft: a component-based pipeline composer for omics analysis using Nextflow. 🐳📦
An end-to-end machine learning and data mining framework on Hadoop
Jenkins实践文档 最新站点地址:
Hands On Devops
A hands-on DevOps course covering the culture, methods and repeated practices of modern software development involving Packer, Vagrant, VirtualBox, Ansible, Kubernetes, K3s, MetalLB, Traefik, Docker-Compose, Docker, Taiga, GitLab, Drone CI, SonarQube, Selenium, InSpec, Alpine 3.10, Ubuntu-bionic, CentOS 7...
Drone Cache
A Drone plugin for caching current workspace files between builds to reduce your build times
☔️ => ⛅️ => ☀️
Ssh Steps Plugin
Jenkins pipeline steps which provides SSH facilities such as command execution or file transfer for continuous delivery.
zUMIs: A fast and flexible pipeline to process RNA sequencing data with UMIs
Proposal Smart Pipelines
Old archived draft proposal for smart pipelines. Go to the new Hack-pipes proposal at js-choi/proposal-hack-pipes.
pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
Rnaseq Workflow
A repository for setting up a RNAseq workflow
VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.
Open Source Pipeline for Maya, Houdini, 3ds Max and Nuke .
Unity resources
A list of resources and tutorials for those doing programming in Unity.
A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.
Cloud Dev
云研发,是一种生于云上的闭环 + 代码化的软件开发方式。它可以让业务人员、开发人员、运营人员等在同一个云端共同协作、透明化地完成整个软件的生命周期(需求、设计、编码、构建、部署、运营),而非相互隔离,又或者是借助于多个软件才能完成工作。
The safe post-production pipeline -
Kubernetes operator to manage installation, updation and uninstallation of tektoncd projects (pipeline, …)
Aws Serverless Cicd Workshop
Learn how to build a CI/CD pipeline for SAM-based applications
Spacy Wordnet
spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
Elastic Crontab System 简单易用的分布式定时任务管理系统
Fluid dynamics component of Chemical Engineering Design Library (ChEDL)
Dashboard for your Deployment pipeline
Cloud ready pure-python streaming data pipeline library
Python library for creating data pipelines with chain functional programming
c++ LINQ -like library of higher-order functions for data manipulation
🔊 Play sounds while and after shell jobs complete
Bodywork Core
Deploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps 🚀
Demo Jenkins Config As Code
Demo of Jenkins Configuration-As-Code with Docker and Groovy Hook Scripts
Go spider
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
Jenkins Pipeline Library Jenkins Pipeline Library for CI/CD
Gitlab Ci Local
Tired of pushing to test your .gitlab-ci.yml?
Distributed malware processing framework based on Python, Redis and MinIO.
Mara Pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
A complete pipeline for metagenomic analysis
✭ 128
PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more
A simpler way of reading and augmenting image segmentation data into TensorFlow
Detect germline or somatic variants from normal or tumour/normal whole-genome or targeted sequencing
1-60 of 365 pipeline projects