571 Open source projects that are alternatives of or similar to Metl

Get protein embeddings from protein sequences

Turn Java 8 Streams into Unix like pipelines

ATAC-seq peak-calling, QC and differential analysis pipeline

A cross-platform tool for data pipelines.

Deploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps 🚀

Knowledge Graph Toolkit

Lightweight, Python library for fast and reproducible experimentation 🔬

all kinds of scrapy demo

The MarkLogic Data Hub: documentation ==>

A Singer.io Target for Postgres

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

Machine is a workflow/pipeline library for processing data

A Julia package for piping a value through a series of transformation expressions using a more convenient syntax than Julia's native piping functionality.

c++ LINQ -like library of higher-order functions for data manipulation

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

System for containerized apps management. From build to scaling.

locopy: Loading/Unloading to Redshift and Snowflake using Python.

Mass processing data with a complete ETL for .net developers

Sync data between persistence engines, like ETL only not stodgy

Puppet Container Registry

Global Biotic Interactions provides access to existing species interaction datasets

Demo of Jenkins Configuration-As-Code with Docker and Groovy Hook Scripts

Actively curated list of awesome BI tools. PRs welcome!

UGENE is free open-source cross-platform bioinformatics software

ETL with Python - Taught at DWH course 2017 (TAU)

The Darkest Pipeline - Multithreaded pipelines for modern C++

A complete pipeline for metagenomic analysis

A file watcher and development tool.

integrated RNA-seq Analysis Pipeline

Production Ready Data Integration Product, documentation：

ETLy is an add-on dashboard service on top of Apache Airflow.

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

Cloud ready pure-python streaming data pipeline library

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

Big Data Toolkit for the JVM

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

Example workflows for the drake R package

Making whole bacterial genome sequencing data analysis easy

📺 TV dashboard for a global view on Gitlab Pipelines

streaming pipeline with a mutable configuration

🌅 Dawn is a lightweight task management and build tool for front-end and nodejs.

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

SalmonTE is an ultra-Fast and Scalable Quantification Pipeline of Transpose Element (TE) Abundances

Kiba enhancement for Ruby ETL.

The CSV to database command line loader

PHP ETL (Extract / Transform / Load) library with SOLID principles + almost no dependency.

Analysis pipelines for sequencing data

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

A simpler way of reading and augmenting image segmentation data into TensorFlow

Mutlitenancy for dotnet applications

For extensive instructor led learning

EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource

Česká otevřená data

Groovy pipeline jobs that build and test Container Linux with Jenkins

contains handy groovy workflow-libs scripts

SUPRA: Software Defined Ultrasound Processing for Real-Time Applications - An Open Source 2D and 3D Pipeline from Beamforming to B-Mode

A python library to push ethereum blockchain data into an sql database.

A realtime ETL engine

GoCD (gocd.org) plugin to push build notifications to Slack