All Projects → Alluxio → alluxio-py

Alluxio / alluxio-py

Licence: Apache-2.0 License
Alluxio Python client - Access Any Data Source with Python

Programming Languages

python
139335 projects - #7 most used programming language
shell
77523 projects

Projects that are alternatives of or similar to alluxio-py

Ozone
Scalable, redundant, and distributed object store for Apache Hadoop
Stars: ✭ 330 (+1733.33%)
Mutual labels:  big-data, storage
Cortx
CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.
Stars: ✭ 426 (+2266.67%)
Mutual labels:  big-data, storage
Moosefs
MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
Stars: ✭ 1,025 (+5594.44%)
Mutual labels:  big-data, storage
bftkv
A distributed key-value storage that's tolerant to Byzantine fault.
Stars: ✭ 27 (+50%)
Mutual labels:  big-data
infinitree
Scalable and encrypted embedded database with 3-tier caching
Stars: ✭ 80 (+344.44%)
Mutual labels:  storage
egis
Egis - a handy Ruby interface for AWS Athena
Stars: ✭ 38 (+111.11%)
Mutual labels:  big-data
taucmdr
Performance engineering for the rest of us.
Stars: ✭ 26 (+44.44%)
Mutual labels:  storage
v6.dooring.public
可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.
Stars: ✭ 323 (+1694.44%)
Mutual labels:  big-data
localstorage-ponyfill
Universal LocalStorage for browser and Node.js.
Stars: ✭ 52 (+188.89%)
Mutual labels:  storage
big-sorter
Java library that sorts very large files of records by splitting into smaller sorted files and merging
Stars: ✭ 49 (+172.22%)
Mutual labels:  big-data
web
realness.online
Stars: ✭ 15 (-16.67%)
Mutual labels:  storage
hyper-engine
Python library for Bayesian hyper-parameters optimization
Stars: ✭ 80 (+344.44%)
Mutual labels:  big-data
pypar
Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.
Stars: ✭ 66 (+266.67%)
Mutual labels:  big-data
gasper
Gasper is a CLI for safe, privacy-aware file storage based on Shamir's Secret Sharing
Stars: ✭ 37 (+105.56%)
Mutual labels:  storage
PhantasmaChain
Blockchain with native storage and smart contract integration.
Stars: ✭ 74 (+311.11%)
Mutual labels:  storage
big-data-lite
Samples to the Oracle Big Data Lite VM
Stars: ✭ 41 (+127.78%)
Mutual labels:  big-data
hotmap
WebGL Heatmap Viewer for Big Data and Bioinformatics
Stars: ✭ 13 (-27.78%)
Mutual labels:  big-data
pyspark-cheatsheet
PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
Stars: ✭ 115 (+538.89%)
Mutual labels:  big-data
big data
A collection of tutorials on Hadoop, MapReduce, Spark, Docker
Stars: ✭ 34 (+88.89%)
Mutual labels:  big-data
pytorch kmeans
Implementation of the k-means algorithm in PyTorch that works for large datasets
Stars: ✭ 38 (+111.11%)
Mutual labels:  big-data

Alluxio Python Client

Documentation Status

Install

pip install alluxio

Example

See example.py.

Dependencies

  • Python 2.7 or later
  • requests
  • pytest
pip install -r requirements.txt

Install for Development

pip install -e .

Code Style

Follow pep8 for source code style, except the restriction for line width.

Check code style by pep8 --ignore=E501 alluxio/.

Follow Google style for docstrings.

Generate Documentation

pip install 'sphinx<1.4' # the latest sphinx has some format issue in the generated html files
cd docs
make html
# open docs/_build/html/index.html in your browser

Unit Tests

Unit tests are in alluxio/tests directory, they can be run under the alluxio-py directory by

pytest

See the test coverage report by

pytest --cov .

Integration Tests

Integration tests are under the tests directory, see tests/README.md for more details.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].