571 Open source projects that are alternatives of or similar to Metl

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Python toolkit for building restartable pipelines

A full-stack DevOps on AWS framework

A BioWDL variantcalling pipeline for germline DNA data. Starting with FASTQ files to produce VCF files. Category:Multi-Sample

a web system to allow users to automatically record history and manage complicated scientific workflows in web browsers involving the online spatial data facilities, high-performance computation platforms, and open-source libraries.

数据质量控制系统

Production Ready Data Integration Product, documentation：

ETL for the NASDAQ symbol file

An experimental programming language for data flow

Skin export / import tools for Autodesk Maya

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

Handwritten digit recognizer using a feed-forward neural network and the MNIST dataset of 70,000 human-labeled handwritten digits.

基于web版kettle开发的一套分布式综合调度,管理,ETL开发的用户专业版B/S架构工具

GAMECHANGER aspires to be the Department’s trusted solution for evidence-based, data-driven decision-making across the universe of DoD requirements

Cloud ready pure-python streaming data pipeline library

RNA sequencing analysis pipeline using STAR, RSEM, HISAT2 or Salmon with gene/isoform counts and extensive quality control.

Open solution to the TGS Salt Identification Challenge

Udacity Data Engineering Nano Degree (DEND)

PyTorch extensions for fast R&D prototyping and Kaggle farming

An image build orchestrator for the modern web

No description or website provided.

Making whole bacterial genome sequencing data analysis easy

This repo holds configuration for infrastructure used across the tektoncd org 🏗️

Function-oriented Make-like declarative workflows for R

Open source VFX pipeline tool

📺 TV dashboard for a global view on Gitlab Pipelines

A single-cell RNAseq pipeline for 10X genomics data

A guideline for building practical production-level deep learning systems to be deployed in real world applications.

HUAWEI AV Pipeline Kit sample code project, which contains the Java sample code to implement functions like video playback, video super-resolution and media asset management. C++ sample code is contained for calling MediaFilter to use the sound event detection plugin.

🌅 Dawn is a lightweight task management and build tool for front-end and nodejs.

create tool-agnostic, templated pipelines to be shared by multiple teams

An orchestration platform for the development, production, and observation of data assets.

CVparser is software for parsing or extracting data out of CV/resumes.

An Elasticsearch client tailored to data science workflows.

Easy to use library to bring Tensorflow on Apache Spark

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

Kiba enhancement for Ruby ETL.

Redundans is a pipeline that assists an assembly of heterozygous/polymorphic genomes.

A tiny debugging library for Ruby

The CSV to database command line loader

RNA mapping pipeline

Shell supporting pipelines to and from multiple processes

Extensible stream pipelines with object algebras.

Analysis pipelines for sequencing data

Jenkins plugin for using DAGsHub as a source for multibranch projects

Realtime data processing and plotting pipelines in Python

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

SciKIt-learn Pipeline in PAndas

modular pluggable media sorter

EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource

Simple Automated CI/CD Pipeline for GitHub and GitLab Projects

An example project that predicts risk of credit card default using a Logistic Regression classifier and a 30,000 sample dataset.

OpenRefine is a free, open source power tool for working with messy data and improving it. This repository contains Dockerbuild files for automated builds.

LinkedPipes ETL is an RDF based, lightweight ETL tool

Extract your data from the Yunmai weighing scales cloud API so you can use it elsewhere

Python3 lib and cli for operating a Cardano Passive Node and using the API's. (PRE-ALPHA)

Automatic Packaging and Distribution of Bioinformatics Pipelines

Multi-core processing of 'Gameday' data from Major League Baseball Advanced Media. Additional tools to parallelize large data sets and write them to a database.

Prometheus spot instance exporter to monitor AWS instance termination with Hollowtrees