GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → pangeo-data → xbatcher

pangeo-data / xbatcher

Licence: Apache-2.0 license
Batch generation from xarray datasets

Programming Languages

python
139335 projects - #7 most used programming language

Labels

tensorflowkeraspytorchxarrayxarray-accessor

Projects that are alternatives of or similar to xbatcher

esmlab
Earth System Model Lab (esmlab). ⚠️⚠️ ESMLab functionality has been moved into <https://github.com/NCAR/geocat-comp>. ⚠️⚠️
Stars: ✭ 23 (-75.27%)
Mutual labels:  xarray
hypothesis-gufunc
Extension to hypothesis for testing numpy general universal functions
Stars: ✭ 32 (-65.59%)
Mutual labels:  xarray
XArrayAndRasterio
Experimental code for loading/saving XArray DataArrays to Geographic Rasters using rasterio
Stars: ✭ 21 (-77.42%)
Mutual labels:  xarray
clisops
Climate Simulation Operations
Stars: ✭ 17 (-81.72%)
Mutual labels:  xarray
restee
Python package to call processed EE objects via the REST API to local data
Stars: ✭ 26 (-72.04%)
Mutual labels:  xarray
wxee
A Python interface between Earth Engine and xarray for processing time series data
Stars: ✭ 113 (+21.51%)
Mutual labels:  xarray
wax-ml
A Python library for machine-learning and feedback loops on streaming data
Stars: ✭ 36 (-61.29%)
Mutual labels:  xarray
xmca
Maximum Covariance Analysis in Python
Stars: ✭ 41 (-55.91%)
Mutual labels:  xarray
gcpy
Python toolkit for GEOS-Chem.
Stars: ✭ 34 (-63.44%)
Mutual labels:  xarray
xbpch
xarray interface for bpch files
Stars: ✭ 17 (-81.72%)
Mutual labels:  xarray
xpublish
Publish Xarray Datasets via a REST API.
Stars: ✭ 86 (-7.53%)
Mutual labels:  xarray
spyndex
Awesome Spectral Indices in Python.
Stars: ✭ 56 (-39.78%)
Mutual labels:  xarray
pangeo-forge-recipes
Python library for building Pangeo Forge recipes.
Stars: ✭ 64 (-31.18%)
Mutual labels:  xarray
aospy
Python package for automated analysis and management of gridded climate data
Stars: ✭ 80 (-13.98%)
Mutual labels:  xarray
Xarray
N-D labeled arrays and datasets in Python
Stars: ✭ 2,353 (+2430.11%)
Mutual labels:  xarray
GEOSChem-python-tutorial
Python/xarray tutorial for GEOS-Chem users
Stars: ✭ 64 (-31.18%)
Mutual labels:  xarray
flox
Fast & furious GroupBy operations for dask.array
Stars: ✭ 42 (-54.84%)
Mutual labels:  xarray
xwrf
A lightweight interface for working with the Weather Research and Forecasting (WRF) model output in Xarray.
Stars: ✭ 45 (-51.61%)
Mutual labels:  xarray
Dtale
Visualizer for pandas data structures
Stars: ✭ 2,864 (+2979.57%)
Mutual labels:  xarray
Herbie
Python for downloading model data (HRRR, RAP, GFS, NBM, etc.) from NOMADS, NOAA's Big Data Program partners (Amazon, Google, Microsoft), ECMWF open data, and the University of Utah Pando Archive System.
Stars: ✭ 92 (-1.08%)
Mutual labels:  xarray
View All Similar Projects ➔

xbatcher: Batch Generation from Xarray Datasets

github actions build status code coverage docs pypi conda-forge license

Xbatcher is a small library for iterating Xarray DataArrays and Datasets in batches. The goal is to make it easy to feed Xarray objects to machine learning libraries such as PyTorch or TensorFlow. View the docs for more info.

Installation

Xbatcher can be installed from PyPI as:

python -m pip install xbatcher

Or via Conda as:

conda install -c conda-forge xbatcher

Or from source as:

python -m pip install git+https://github.com/xarray-contrib/xbatcher.git

Note

The required dependencies installed with Xbatcher are Xarray, Dask, and NumPy. You will need to separately install TensorFlow or PyTorch to use those data loaders or Xarray accessors. Review the installation instructions for more details.

Documentation

Documentation is hosted on ReadTheDocs: https://xbatcher.readthedocs.org

License

Apache License 2.0, see LICENSE file.

Acknowledgements

This work was funded in part by:

NASA ACCESS19-0049: Pangeo ML: Open Source Tools and Pipelines for Scalable Machine Learning Using NASA Earth Observation Data

This work was motivated by many conversations in the Pangeo community and Pangeo ML working group

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].