optimus🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Stars: ✭ 1,351 (+3993.94%)
graphchain⚡️ An efficient cache for the execution of dask graphs.
Stars: ✭ 63 (+90.91%)
MarsMars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
Stars: ✭ 2,308 (+6893.94%)
XarrayN-D labeled arrays and datasets in Python
Stars: ✭ 2,353 (+7030.3%)
StumpySTUMPY is a powerful and scalable Python library for modern time series analysis
Stars: ✭ 2,019 (+6018.18%)
SwifterA package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
Stars: ✭ 1,844 (+5487.88%)
DaskParallel computing with task scheduling
Stars: ✭ 9,309 (+28109.09%)
dask-ec2Start a cluster in EC2 for dask.distributed
Stars: ✭ 103 (+212.12%)
knitDeprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
Stars: ✭ 53 (+60.61%)
HyperGBMA full pipeline AutoML tool for tabular data
Stars: ✭ 172 (+421.21%)
framequerySQL on dataframes - pandas and dask
Stars: ✭ 63 (+90.91%)
floxFast & furious GroupBy operations for dask.array
Stars: ✭ 42 (+27.27%)
dask-rasterioRead and write rasters in parallel using Rasterio and Dask
Stars: ✭ 82 (+148.48%)
gaiaGaia is a geospatial analysis library jointly developed by Kitware and Epidemico.
Stars: ✭ 29 (-12.12%)
madpy-daskMadPy Dask talk materials
Stars: ✭ 33 (+0%)
arboretoA scalable python-based framework for gene regulatory network inference using tree-based ensemble regressors.
Stars: ✭ 33 (+0%)
datatileA library for managing, validating, summarizing, and visualizing data.
Stars: ✭ 419 (+1169.7%)
dvc dask use caseA use case of a reproducible machine learning pipeline using Dask, DVC, and MLflow.
Stars: ✭ 22 (-33.33%)
esmlabEarth System Model Lab (esmlab). ⚠️⚠️ ESMLab functionality has been moved into <https://github.com/NCAR/geocat-comp>. ⚠️⚠️
Stars: ✭ 23 (-30.3%)
mloperatorMachine Learning Operator & Controller for Kubernetes
Stars: ✭ 85 (+157.58%)
dask-awkwardNative Dask collection for awkward arrays, and the library to use it.
Stars: ✭ 25 (-24.24%)
lazycluster🎛 Distributed machine learning made simple.
Stars: ✭ 43 (+30.3%)
dask-pytorch-ddpdask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.
Stars: ✭ 50 (+51.52%)
bumblebee🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)
Stars: ✭ 120 (+263.64%)
mlforecastScalable machine 🤖 learning for time series forecasting.
Stars: ✭ 96 (+190.91%)
prefect-saturnPython client for using Prefect Cloud with Saturn Cloud
Stars: ✭ 15 (-54.55%)
daskperimentReproducibility for Humans: A lightweight tool to perform reproducible machine learning experiment.
Stars: ✭ 25 (-24.24%)
dask-sqlDistributed SQL Engine in Python using Dask
Stars: ✭ 271 (+721.21%)
xarray-beamDistributed Xarray with Apache Beam
Stars: ✭ 83 (+151.52%)
qhub🪴 Nebari - your open source data science platform
Stars: ✭ 175 (+430.3%)