XarrayN-D labeled arrays and datasets in Python
Stars: ✭ 2,353 (+10130.43%)
xarray-beamDistributed Xarray with Apache Beam
Stars: ✭ 83 (+260.87%)
floxFast & furious GroupBy operations for dask.array
Stars: ✭ 42 (+82.61%)
dask-sqlDistributed SQL Engine in Python using Dask
Stars: ✭ 271 (+1078.26%)
HerbiePython for downloading model data (HRRR, RAP, GFS, NBM, etc.) from NOMADS, NOAA's Big Data Program partners (Amazon, Google, Microsoft), ECMWF open data, and the University of Utah Pando Archive System.
Stars: ✭ 92 (+300%)
hypothesis-gufuncExtension to hypothesis for testing numpy general universal functions
Stars: ✭ 32 (+39.13%)
climate systemNotes and practicals for my "Physics of the Climate System" lecture
Stars: ✭ 13 (-43.48%)
bumblebee🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)
Stars: ✭ 120 (+421.74%)
PyEarthScienceThe PyEarthScience repository created by DKRZ (German Climate Computing Center) provides Python scripts and Jupyter notebooks in particular for scientific data processing and visualization used in climate science. It contains scripts for visualization, I/O, and analysis using PyNGL, PyNIO, xarray, cfgrib, xesmf, cartopy, and others.
Stars: ✭ 56 (+143.48%)
MarsMars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
Stars: ✭ 2,308 (+9934.78%)
XArrayAndRasterioExperimental code for loading/saving XArray DataArrays to Geographic Rasters using rasterio
Stars: ✭ 21 (-8.7%)
wxeeA Python interface between Earth Engine and xarray for processing time series data
Stars: ✭ 113 (+391.3%)
Geoweavera web system to allow users to automatically record history and manage complicated scientific workflows in web browsers involving the online spatial data facilities, high-performance computation platforms, and open-source libraries.
Stars: ✭ 32 (+39.13%)
resteePython package to call processed EE objects via the REST API to local data
Stars: ✭ 26 (+13.04%)
xarrayutilsxarrayutils.readthedocs.io/
Stars: ✭ 50 (+117.39%)
clisopsClimate Simulation Operations
Stars: ✭ 17 (-26.09%)
wax-mlA Python library for machine-learning and feedback loops on streaming data
Stars: ✭ 36 (+56.52%)
xbatcherBatch generation from xarray datasets
Stars: ✭ 93 (+304.35%)
SwifterA package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
Stars: ✭ 1,844 (+7917.39%)
dask-ec2Start a cluster in EC2 for dask.distributed
Stars: ✭ 103 (+347.83%)
HyperGBMA full pipeline AutoML tool for tabular data
Stars: ✭ 172 (+647.83%)
goes2goDownload and process GOES-16 and GOES-17 data from NOAA's archive on AWS using Python.
Stars: ✭ 77 (+234.78%)
xwrfA lightweight interface for working with the Weather Research and Forecasting (WRF) model output in Xarray.
Stars: ✭ 45 (+95.65%)
dask-rasterioRead and write rasters in parallel using Rasterio and Dask
Stars: ✭ 82 (+256.52%)
prefect-saturnPython client for using Prefect Cloud with Saturn Cloud
Stars: ✭ 15 (-34.78%)
xbpchxarray interface for bpch files
Stars: ✭ 17 (-26.09%)
lazycluster🎛 Distributed machine learning made simple.
Stars: ✭ 43 (+86.96%)
daskperimentReproducibility for Humans: A lightweight tool to perform reproducible machine learning experiment.
Stars: ✭ 25 (+8.7%)
xmcaMaximum Covariance Analysis in Python
Stars: ✭ 41 (+78.26%)
arboretoA scalable python-based framework for gene regulatory network inference using tree-based ensemble regressors.
Stars: ✭ 33 (+43.48%)
mloperatorMachine Learning Operator & Controller for Kubernetes
Stars: ✭ 85 (+269.57%)
gcpyPython toolkit for GEOS-Chem.
Stars: ✭ 34 (+47.83%)
spyndexAwesome Spectral Indices in Python.
Stars: ✭ 56 (+143.48%)
dask-pytorch-ddpdask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.
Stars: ✭ 50 (+117.39%)
xpublishPublish Xarray Datasets via a REST API.
Stars: ✭ 86 (+273.91%)
qhub🪴 Nebari - your open source data science platform
Stars: ✭ 175 (+660.87%)
aospyPython package for automated analysis and management of gridded climate data
Stars: ✭ 80 (+247.83%)
cmip6 preprocessingAnalysis ready CMIP6 data in python the easy way with pangeo tools.
Stars: ✭ 126 (+447.83%)
StumpySTUMPY is a powerful and scalable Python library for modern time series analysis
Stars: ✭ 2,019 (+8678.26%)
deafrica-sandbox-notebooksRepository for Digital Earth Africa Sandbox, including: Jupyter notebooks, scripts, tools and workflows for geospatial analysis with Open Data Cube and xarray
Stars: ✭ 108 (+369.57%)
DaskParallel computing with task scheduling
Stars: ✭ 9,309 (+40373.91%)
mlforecastScalable machine 🤖 learning for time series forecasting.
Stars: ✭ 96 (+317.39%)
knitDeprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
Stars: ✭ 53 (+130.43%)
coiled-resourcesNotebooks that support blog posts and tech talks on Dask / Coiled.
Stars: ✭ 33 (+43.48%)
framequerySQL on dataframes - pandas and dask
Stars: ✭ 63 (+173.91%)
xcastA High-Performance Data Science Toolkit for the Earth Sciences
Stars: ✭ 28 (+21.74%)
gaiaGaia is a geospatial analysis library jointly developed by Kitware and Epidemico.
Stars: ✭ 29 (+26.09%)
optimus🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Stars: ✭ 1,351 (+5773.91%)
madpy-daskMadPy Dask talk materials
Stars: ✭ 33 (+43.48%)
datatileA library for managing, validating, summarizing, and visualizing data.
Stars: ✭ 419 (+1721.74%)
graphchain⚡️ An efficient cache for the execution of dask graphs.
Stars: ✭ 63 (+173.91%)
intake-esmAn intake plugin for parsing an Earth System Model (ESM) catalog and loading assets into xarray datasets.
Stars: ✭ 78 (+239.13%)
dask-awkwardNative Dask collection for awkward arrays, and the library to use it.
Stars: ✭ 25 (+8.7%)
xarray-sentinelXarray backend to Copernicus Sentinel-1 satellite data products
Stars: ✭ 189 (+721.74%)
DtaleVisualizer for pandas data structures
Stars: ✭ 2,864 (+12352.17%)