Top 371 pipeline open source projects

This repo is no longer updated. Please see https://github.com/Autodesk/maya-usd

MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization

Cycle-accurate pre-silicon simulator of RISC-V and MIPS CPUs

An optimized docker image includes Android, Kotlin, Flutter sdk.

A CLI for interacting with Tekton!

A package that makes it trivial to create and evaluate machine learning pipeline architectures.

🔬 BEDOPS: high-performance genomic feature operations

High-throughput Redis client for Go with implicit pipelining

🐟 High Performance Computing over Kubernetes - Core Repo 🎣

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

FlowCraft: a component-based pipeline composer for omics analysis using Nextflow. 🐳📦

An end-to-end machine learning and data mining framework on Hadoop

Identify hardcoded secrets and dangerous behaviours

LAMA - automatic model creation framework

Jenkins实践文档 最新站点地址: http://www.idevops.site

A hands-on DevOps course covering the culture, methods and repeated practices of modern software development involving Packer, Vagrant, VirtualBox, Ansible, Kubernetes, K3s, MetalLB, Traefik, Docker-Compose, Docker, Taiga, GitLab, Drone CI, SonarQube, Selenium, InSpec, Alpine 3.10, Ubuntu-bionic, CentOS 7...

A Drone plugin for caching current workspace files between builds to reduce your build times

☔️ => ⛅️ => ☀️

Jenkins pipeline steps which provides SSH facilities such as command execution or file transfer for continuous delivery.

zUMIs: A fast and flexible pipeline to process RNA sequencing data with UMIs

Old archived draft proposal for smart pipelines. Go to the new Hack-pipes proposal at js-choi/proposal-hack-pipes.

pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.

Function Composition for OpenFaaS

A repository for setting up a RNAseq workflow

VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.

Open Source Pipeline for Maya, Houdini, 3ds Max and Nuke .

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

A list of resources and tutorials for those doing programming in Unity.

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

云研发，是一种生于云上的闭环 + 代码化的软件开发方式。它可以让业务人员、开发人员、运营人员等在同一个云端共同协作、透明化地完成整个软件的生命周期（需求、设计、编码、构建、部署、运营），而非相互隔离，又或者是借助于多个软件才能完成工作。

The safe post-production pipeline - https://getavalon.github.io/2.0

Kubernetes operator to manage installation, updation and uninstallation of tektoncd projects (pipeline, …)

Learn how to build a CI/CD pipeline for SAM-based applications

spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

Elastic Crontab System 简单易用的分布式定时任务管理系统

Fluid dynamics component of Chemical Engineering Design Library (ChEDL)

Open solution to the Toxic Comment Classification Challenge

Pipeline Extension for Live Trading

mito ETL tool

Dashboard for your Deployment pipeline https://dashboardhub.io/

Cloud ready pure-python streaming data pipeline library

Python library for creating data pipelines with chain functional programming

c++ LINQ -like library of higher-order functions for data manipulation

Machine learning platform for Web developers

🔊 Play sounds while and after shell jobs complete

Deploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps 🚀

Demo of Jenkins Configuration-As-Code with Docker and Groovy Hook Scripts

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

wcm.io Jenkins Pipeline Library for CI/CD

Tired of pushing to test your .gitlab-ci.yml?

Distributed malware processing framework based on Python, Redis and MinIO.

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

all kinds of scrapy demo

A complete pipeline for metagenomic analysis

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

A simpler way of reading and augmenting image segmentation data into TensorFlow

Detect germline or somatic variants from normal or tumour/normal whole-genome or targeted sequencing

Open solution to the TGS Salt Identification Challenge