All Projects → jcmgray → Xyzpy

jcmgray / Xyzpy

Licence: mit
Efficiently generate and analyse high dimensional data.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Xyzpy

Deepgraph
Analyze Data with Pandas-based Networks. Documentation:
Stars: ✭ 232 (+415.56%)
Mutual labels:  parallel, pandas
malib
A parallel framework for population-based multi-agent reinforcement learning.
Stars: ✭ 341 (+657.78%)
Mutual labels:  parallel, distributed
Ray
An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
Stars: ✭ 18,547 (+41115.56%)
Mutual labels:  parallel, distributed
pooljs
Browser computing unleashed!
Stars: ✭ 17 (-62.22%)
Mutual labels:  parallel, distributed
distributed
Library to provide Erlang style distributed computations. This library is inspired by Cloud Haskell.
Stars: ✭ 49 (+8.89%)
Mutual labels:  parallel, distributed
Lightgbm
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
Stars: ✭ 13,293 (+29440%)
Mutual labels:  parallel, distributed
Galaxy
Galaxy is an asynchronous parallel visualization ray tracer for performant rendering in distributed computing environments. Galaxy builds upon Intel OSPRay and Intel Embree, including ray queueing and sending logic inspired by TACC GraviT.
Stars: ✭ 18 (-60%)
Mutual labels:  parallel, distributed
Pandarallel
A simple and efficient tool to parallelize Pandas operations on all available CPUs
Stars: ✭ 1,887 (+4093.33%)
Mutual labels:  parallel, pandas
optuna-examples
Examples for https://github.com/optuna/optuna
Stars: ✭ 238 (+428.89%)
Mutual labels:  parallel, distributed
ParallelUtilities.jl
Fast and easy parallel mapreduce on HPC clusters
Stars: ✭ 28 (-37.78%)
Mutual labels:  parallel, distributed
OpenABL
A domain-specific language for parallel and distributed agent-based simulations.
Stars: ✭ 24 (-46.67%)
Mutual labels:  parallel, distributed
Optuna
A hyperparameter optimization framework
Stars: ✭ 5,679 (+12520%)
Mutual labels:  parallel, distributed
Tqdm
A Fast, Extensible Progress Bar for Python and CLI
Stars: ✭ 20,632 (+45748.89%)
Mutual labels:  parallel, pandas
Modin
Modin: Speed up your Pandas workflows by changing a single line of code
Stars: ✭ 6,639 (+14653.33%)
Mutual labels:  pandas, distributed
Crypto Dht
Blockchain over DHT in GO
Stars: ✭ 38 (-15.56%)
Mutual labels:  distributed
Lizard
💐 Full Amazon Automatic Download
Stars: ✭ 41 (-8.89%)
Mutual labels:  distributed
Vc
SIMD Vector Classes for C++
Stars: ✭ 985 (+2088.89%)
Mutual labels:  parallel
Filetrees.jl
Parallel file processing made easy
Stars: ✭ 37 (-17.78%)
Mutual labels:  parallel
Eventd
A simple daemon to track remote or local events and do actions the user wants to
Stars: ✭ 43 (-4.44%)
Mutual labels:  distributed
Sorry Cypress
An open-source, on-premise, self-hosted alternative to Cypress Dashboard
Stars: ✭ 1,005 (+2133.33%)
Mutual labels:  parallel

.. raw:: html

<img src="https://github.com/jcmgray/xyzpy/blob/master/docs/_static/xyzpy-logo-title.png" width="450px">

.. image:: https://dev.azure.com/xyzpy-org/xyzpy/_apis/build/status/jcmgray.xyzpy?branchName=develop :target: https://dev.azure.com/xyzpy-org/xyzpy :alt: Azure CI .. image:: https://codecov.io/gh/jcmgray/xyzpy/branch/master/graph/badge.svg :target: https://codecov.io/gh/jcmgray/xyzpy :alt: Code Coverage .. image:: https://img.shields.io/lgtm/grade/python/g/jcmgray/xyzpy.svg :target: https://lgtm.com/projects/g/jcmgray/xyzpy/ :alt: LGTM Grade .. image:: https://readthedocs.org/projects/xyzpy/badge/?version=latest :target: http://xyzpy.readthedocs.io/en/latest/?badge=latest :alt: Documentation Status


xyzpy <https://github.com/jcmgray/xyzpy>__ is python library for efficiently generating, manipulating and plotting data with a lot of dimensions, of the type that often occurs in numerical simulations. It stands wholly atop the labelled N-dimensional array library xarray <http://xarray.pydata.org/en/stable/>. The project's documentation is hosted on readthedocs <http://xyzpy.readthedocs.io/>.

The aim is to take the pain and errors out of generating and exploring data with a high number of possible parameters. This means:

  • you don't have to write super nested for loops
  • you don't have to remember which arrays/dimensions belong to which variables/parameters
  • you don't have to parallelize over or distribute runs yourself
  • you don't have to worry about loading, saving and merging disjoint data
  • you don't have to guess when a set of runs is going to finish
  • you don't have to write batch submission scripts or leave the notebook to use SGE, PBS or SLURM

As well as the ability to automatically parallelize over runs, xyzpy provides the Crop object that allows runs and results to be written to disk, these can then be run by any process with access to the files - e.g. a batch system such as SGE, PBS or SLURM - or just serve as a convenient persistent progress mechanism.

Once your data has been aggregated into a xarray.Dataset or pandas.DataFrame there exists many powerful visualization tools such as seaborn <https://seaborn.pydata.org/>, altair <https://altair-viz.github.io/>, and holoviews <https://holoviews.org/#>_ / hvplot <https://hvplot.holoviz.org/>_. To these xyzpy adds also a simple 'oneliner' interface for interactively plotting the data using bokeh <https://bokeh.pydata.org/en/latest/>, or for static, publication ready figures using matplotlib <https://matplotlib.org/>, whilst being able to see the dependence on up to 4 dimensions at once.

.. image:: docs/ex_simple.png

Please see the docs <http://xyzpy.readthedocs.io/>__ for more information.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].