Top 94 reproducibility open source projects

declarative and reproducible Jupyter environments - powered by Nix

Create highly reproducible python environments

ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.

Accelerated deep learning R&D

Container-native task automation engine.

PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.

Tool for encapsulating, running, and reproducing data science projects

Generic template to bootstrap your PyTorch project with PyTorch Lightning, Hydra, W&B, and DVC.

The Renku Project provides a platform and tools for reproducible and collaborative data analysis.

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

This Snakemake pipeline implements the GATK best-practices workflow

Tools for computation on batch systems

An R package to enable reproducible data processing, packaging and sharing.

Deep Reinforcement Learning (DRL) agents applied to medical images

Automation and Make

Lightweight, Python library for fast and reproducible experimentation 🔬

project page for creating a guide to reproducible research

R Package 📦 for initializing projects for various R activities 🔩

A curated list of reproducible research case studies, projects, tutorials, and media

A comparison between some VPS providers. It uses Ansible to perform a series of automated benchmark tests over the VPS servers that you specify. It allows the reproducibility of those tests by anyone that wanted to compare these results to their own. All the tests results are available in order to provide independence and transparency.

This is our implementation of ENMF: Efficient Neural Matrix Factorization (TOIS. 38, 2020). This also provides a fair evaluation of existing state-of-the-art recommendation models.

A Reproducible Data Analysis Workflow with R Markdown, Git, Make, and Docker

VisTrails is an open-source data analysis and visualization tool. It provides a comprehensive provenance infrastructure that maintains detailed history information about the steps followed and data derived in the course of an exploratory task: VisTrails maintains provenance of data products, of the computational processes that derive these products and their executions.

An R-focused pipeline toolkit for reproducibility and high-performance computing

Implementation of SCP-010.

Reproduce research from paper "Predicting the direction of stock market prices using random forest"

A toolkit for reproducible reinforcement learning research.

Example workflows for the drake R package

☁️ 🚀 📊 📈 Evaluating state of the art in AI

TensorHub is a library built on top of TensorFlow 2.0 to provide simple, modular and repeatable abstractions to accelerate deep learning research.

🦉Data Version Control | Git for Data & Models | ML Experiments Management

Open solution to the Santander Value Prediction Challenge 🐠

Say the magic word 😸

Curated set of transformers that make your work with steppy faster and more effective 🔭

Catalyst.Segmentation

This is the development home of the workflow management system Snakemake. For general information, see

This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.

Render bits of R code for sharing, e.g., on GitHub or StackOverflow.

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

rrtools: Tools for Writing Reproducible Research in R

[CVPR 2020 Workshop] A PyTorch GAN library that reproduces research results for popular GANs.

Presentation-Ready Data Summary and Analytic Result Tables

Workflow Description Language - Specification and Implementations

Open solution to the Home Credit Default Risk challenge 🏡

Collective Knowledge framework (CK) helps to organize black-box research software as a database of reusable components and micro-services with common APIs, automation actions and extensible meta descriptions. See real-world use cases from Arm, General Motors, ACM, Raspberry Pi foundation and others:

Open source production model management tool for data scientists

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

Function-oriented Make-like declarative workflows for R

ML project template facilitating both research and production phases.

Software Papers as Software Modules: Towards a Culture of Reusable Results

an initiative to provide infrastructure for reproducible workflows around open data

Execute and document benchmarks reproducibly.

Examples and demos for ReproZip

Reproducible Data Science in Python (SciPy 2019 Tutorial)

A set of tools for R that enhance reproducibility beyond package management

🐶 🕵️ Great Dane turned Python environment detective

Unofficial Implementation of ECANets (CVPR 2020) for the Reproducibility Challenge 2020.

Synchronize your working directory efficiently to a remote place without committing the changes.

The Organization lesson for the Reproducible Science Curriculum

Ten Years Reproducibility Challenge