465 Open source projects that are alternatives of or similar to datajob

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

Machine learning platform for Web developers

FlowCraft: a component-based pipeline composer for omics analysis using Nextflow. 🐳📦

Deploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps 🚀

UNDER DEVELOPMENT--- Analysis of long non-coding RNAs from RNA-seq datasets

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

Identify hardcoded secrets and dangerous behaviours

Tired of pushing to test your .gitlab-ci.yml?

A Clojure machine learning library

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Jenkins实践文档 最新站点地址: http://www.idevops.site

all kinds of scrapy demo

Maya > Arnold > Nuke pipeline

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

A Drone plugin for caching current workspace files between builds to reduce your build times

Detect germline or somatic variants from normal or tumour/normal whole-genome or targeted sequencing

🤖🎩assume-role-arn allows you to easily assume an AWS IAM role in your CI/CD pipelines, without worrying about external dependencies.

Let's get the ball rolling on some Container-driven CI & CD

Jenkins pipeline steps which provides SSH facilities such as command execution or file transfer for continuous delivery.

A SingleCell RNASeq pre-processing snakemake workflow

Managed Machine Learning Systems and Internet of Things Live Lesson

A Julia package for piping a value through a series of transformation expressions using a more convenient syntax than Julia's native piping functionality.

Old archived draft proposal for smart pipelines. Go to the new Hack-pipes proposal at js-choi/proposal-hack-pipes.

System for containerized apps management. From build to scaling.

The magic message bus

UGENE is free open-source cross-platform bioinformatics software

Function Composition for OpenFaaS

📺 TV dashboard for a global view on Gitlab Pipelines

Generalised and highly customisable, hybrid-parallelism, database based, deep learning framework.

SUPRA: Software Defined Ultrasound Processing for Real-Time Applications - An Open Source 2D and 3D Pipeline from Beamforming to B-Mode

VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.

Data transformations for the ML era

This repo is no longer updated. Please see https://github.com/Autodesk/maya-usd

VisTrails is an open-source data analysis and visualization tool. It provides a comprehensive provenance infrastructure that maintains detailed history information about the steps followed and data derived in the course of an exploratory task: VisTrails maintains provenance of data products, of the computational processes that derive these products and their executions.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

An R-focused pipeline toolkit for reproducibility and high-performance computing

A comprehensive tool for processing, analyzing and visulizing single cell chromatin accessibility sequencing data

Jenkins pipeline steps for integration with JIRA.

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

Get protein embeddings from protein sequences

Cycle-accurate pre-silicon simulator of RISC-V and MIPS CPUs

Terraform Module for CI/CD with AWS Code Pipeline and Code Build for ECS https://cloudposse.com/

The safe post-production pipeline - https://getavalon.github.io/2.0

Dockerised Next Generation Sequencing Pipeline (QC, Align, Calling, Annotation)

Blog post on ETL pipelines with Airflow

Machine is a workflow/pipeline library for processing data

Learn how to build a CI/CD pipeline for SAM-based applications

MLBox is a powerful Automated Machine Learning python library.

A CLI for interacting with Tekton!

ATAC-seq peak-calling, QC and differential analysis pipeline

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

integrated RNA-seq Analysis Pipeline

🏭 PDF text extraction pipeline: self-hosted, local-first, Docker-based

🔬 BEDOPS: high-performance genomic feature operations

Open solution to the Toxic Comment Classification Challenge

Pipeline Extension for Live Trading

Fluid dynamics component of Chemical Engineering Design Library (ChEDL)

Projects developed by Domino's R&D team

Build HTTP API Based Services using Amazon API Gateway, AWS PrivateLink, AWS Fargate and AWS CDK

A modular framework built to simplify Computer Vision inference workloads.