lazycluster🎛 Distributed machine learning made simple.
Stars: ✭ 43 (+72%)
ReprozipReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.
Stars: ✭ 231 (+824%)
DaskParallel computing with task scheduling
Stars: ✭ 9,309 (+37136%)
dvc dask use caseA use case of a reproducible machine learning pipeline using Dask, DVC, and MLflow.
Stars: ✭ 22 (-12%)
MarsMars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
Stars: ✭ 2,308 (+9132%)
prefect-saturnPython client for using Prefect Cloud with Saturn Cloud
Stars: ✭ 15 (-40%)
hydra-zenPythonic functions for creating and enhancing Hydra applications
Stars: ✭ 165 (+560%)
Anaconda ProjectTool for encapsulating, running, and reproducing data science projects
Stars: ✭ 153 (+512%)
framequerySQL on dataframes - pandas and dask
Stars: ✭ 63 (+152%)
arboretoA scalable python-based framework for gene regulatory network inference using tree-based ensemble regressors.
Stars: ✭ 33 (+32%)
graphchain⚡️ An efficient cache for the execution of dask graphs.
Stars: ✭ 63 (+152%)
mloperatorMachine Learning Operator & Controller for Kubernetes
Stars: ✭ 85 (+240%)
bumblebee🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)
Stars: ✭ 120 (+380%)
StumpySTUMPY is a powerful and scalable Python library for modern time series analysis
Stars: ✭ 2,019 (+7976%)
Jupyterwithdeclarative and reproducible Jupyter environments - powered by Nix
Stars: ✭ 235 (+840%)
xarray-beamDistributed Xarray with Apache Beam
Stars: ✭ 83 (+232%)
PopperContainer-native task automation engine.
Stars: ✭ 216 (+764%)
knitDeprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
Stars: ✭ 53 (+112%)
RenkuThe Renku Project provides a platform and tools for reproducible and collaborative data analysis.
Stars: ✭ 141 (+464%)
coiled-resourcesNotebooks that support blog posts and tech talks on Dask / Coiled.
Stars: ✭ 33 (+32%)
DatapackagerAn R package to enable reproducible data processing, packaging and sharing.
Stars: ✭ 125 (+400%)
dask-rasterioRead and write rasters in parallel using Rasterio and Dask
Stars: ✭ 82 (+228%)
madpy-daskMadPy Dask talk materials
Stars: ✭ 33 (+32%)
SteppyLightweight, Python library for fast and reproducible experimentation 🔬
Stars: ✭ 119 (+376%)
datatileA library for managing, validating, summarizing, and visualizing data.
Stars: ✭ 419 (+1576%)
qhub🪴 Nebari - your open source data science platform
Stars: ✭ 175 (+600%)
esmlabEarth System Model Lab (esmlab). ⚠️⚠️ ESMLab functionality has been moved into <https://github.com/NCAR/geocat-comp>. ⚠️⚠️
Stars: ✭ 23 (-8%)
fertilecreating optimal conditions for reproducibility
Stars: ✭ 52 (+108%)
dask-awkwardNative Dask collection for awkward arrays, and the library to use it.
Stars: ✭ 25 (+0%)
EasyGitianBuilder🔨 Gitian Building made simpler on any Windows Debian/Ubuntu MacOS with Vagrant, lxc, and virtualbox
Stars: ✭ 18 (-28%)
dask-pytorch-ddpdask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.
Stars: ✭ 50 (+100%)
XarrayN-D labeled arrays and datasets in Python
Stars: ✭ 2,353 (+9312%)
mlforecastScalable machine 🤖 learning for time series forecasting.
Stars: ✭ 96 (+284%)
benchmark VAEUnifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)
Stars: ✭ 1,211 (+4744%)
SwifterA package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
Stars: ✭ 1,844 (+7276%)
Mach NixCreate highly reproducible python environments
Stars: ✭ 231 (+824%)
dask-sqlDistributed SQL Engine in Python using Dask
Stars: ✭ 271 (+984%)
CatalystAccelerated deep learning R&D
Stars: ✭ 2,804 (+11116%)
dask-ec2Start a cluster in EC2 for dask.distributed
Stars: ✭ 103 (+312%)
PlynxPLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.
Stars: ✭ 192 (+668%)
Nn TemplateGeneric template to bootstrap your PyTorch project with PyTorch Lightning, Hydra, W&B, and DVC.
Stars: ✭ 145 (+480%)
HyperGBMA full pipeline AutoML tool for tabular data
Stars: ✭ 172 (+588%)
AcceleratorThe Accelerator is a tool for fast and reproducible processing of large amounts of data.
Stars: ✭ 137 (+448%)
binderhub-deployDeploy a BinderHub from scratch on Microsoft Azure
Stars: ✭ 27 (+8%)
BatchtoolsTools for computation on batch systems
Stars: ✭ 127 (+408%)
floxFast & furious GroupBy operations for dask.array
Stars: ✭ 42 (+68%)
Rl MedicalDeep Reinforcement Learning (DRL) agents applied to medical images
Stars: ✭ 123 (+392%)
narpsCode related to Neuroimaging Analysis Replication and Prediction Study
Stars: ✭ 31 (+24%)
gaiaGaia is a geospatial analysis library jointly developed by Kitware and Epidemico.
Stars: ✭ 29 (+16%)
analysis-flowData Analysis Workflows & Reproducibility Learning Resources
Stars: ✭ 108 (+332%)
rna-seq-kallisto-sleuthA Snakemake workflow for differential expression analysis of RNA-seq data with Kallisto and Sleuth.
Stars: ✭ 56 (+124%)
software-devCoding Standards for the USC Biostats group
Stars: ✭ 33 (+32%)
optimus🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Stars: ✭ 1,351 (+5304%)