All Projects → LLNL → Zfp

LLNL / Zfp

Licence: bsd-3-clause
Compressed numerical arrays that support high-speed random access

Projects that are alternatives of or similar to Zfp

fpzip
Lossless compressor of multidimensional floating-point arrays
Stars: ✭ 58 (-84.9%)
Mutual labels:  compression, data-viz
Kanzi Go
Lossless data compression in Go
Stars: ✭ 361 (-5.99%)
Mutual labels:  compression
Simdcompressionandintersection
A C++ library to compress and intersect sorted lists of integers using SIMD instructions
Stars: ✭ 289 (-24.74%)
Mutual labels:  compression
Compress Images
Minify size your images. Image compression with extension: jpg/jpeg, svg, png, gif. NodeJs
Stars: ✭ 331 (-13.8%)
Mutual labels:  compression
Boxing
Android multi-media selector based on MVP mode.
Stars: ✭ 3,216 (+737.5%)
Mutual labels:  compression
Nyc Buildings
An interactive 3D visualization of the all the buildings in Manhattan.
Stars: ✭ 338 (-11.98%)
Mutual labels:  data-viz
Crunch
Crunch is a tool for lossy PNG image file optimization. It combines selective bit depth, color type, and color palette reduction with zopfli DEFLATE compression algorithm encoding using the pngquant and zopflipng PNG optimization tools. This approach leads to a significant file size gain relative to lossless approaches at the expense of a relatively modest decrease in image quality (see example images below).
Stars: ✭ 3,074 (+700.52%)
Mutual labels:  compression
Ewahboolarray
A compressed bitmap class in C++.
Stars: ✭ 381 (-0.78%)
Mutual labels:  compression
Mango
mango fun framework
Stars: ✭ 343 (-10.68%)
Mutual labels:  compression
Simdcomp
A simple C library for compressing lists of integers using binary packing
Stars: ✭ 331 (-13.8%)
Mutual labels:  compression
Xz
Pure golang package for reading and writing xz-compressed files
Stars: ✭ 330 (-14.06%)
Mutual labels:  compression
Compress
Collection of compression related Go packages.
Stars: ✭ 319 (-16.93%)
Mutual labels:  compression
Caffe
Caffe for Sparse and Low-rank Deep Neural Networks
Stars: ✭ 339 (-11.72%)
Mutual labels:  compression
Tinify Nodejs
Node.js client for the Tinify API.
Stars: ✭ 299 (-22.14%)
Mutual labels:  compression
Zipfly
Writing large ZIP archives without memory inflation
Stars: ✭ 363 (-5.47%)
Mutual labels:  compression
Javascript For Everyone
A step by step guide to learn JavaScript and programming
Stars: ✭ 285 (-25.78%)
Mutual labels:  arrays
Massiv
Efficient Haskell Arrays featuring Parallel computation
Stars: ✭ 328 (-14.58%)
Mutual labels:  arrays
Ojalgo
oj! Algorithms
Stars: ✭ 336 (-12.5%)
Mutual labels:  arrays
Zson
ZSON is a PostgreSQL extension for transparent JSONB compression
Stars: ✭ 385 (+0.26%)
Mutual labels:  compression
Libzip
A C library for reading, creating, and modifying zip archives.
Stars: ✭ 379 (-1.3%)
Mutual labels:  compression

ZFP

Travis CI Build Status Appveyor Build Status Documentation Status Code Coverage

zfp is a compressed format for representing multidimensional floating-point and integer arrays. zfp provides compressed-array classes that support high throughput read and write random access to individual array elements. zfp also supports serial and parallel (OpenMP and CUDA) compression of whole arrays, e.g., for applications that read and write large data sets to and from disk.

zfp uses lossy but optionally error-bounded compression to achieve high compression ratios. Bit-for-bit lossless compression is also possible through one of zfp's compression modes. zfp works best for 2D, 3D, and 4D arrays that exhibit spatial correlation, such as continuous fields from physics simulations, natural images, regularly sampled terrain surfaces, etc. zfp compression of 1D arrays is possible but generally discouraged.

zfp is freely available as open source and is distributed under a BSD license. zfp is primarily written in C and C++ but also includes Python and Fortran bindings. zfp conforms to various language standards, including C89, C99, C11, C++98, C++11, and C++14, and is supported on Linux, macOS, and Windows.

Quick Start

To download zfp, type:

git clone https://github.com/LLNL/zfp.git

zfp may be built using either CMake or GNU make. To use CMake, type:

cd zfp
mkdir build
cd build
cmake ..
cmake --build . --config Release
ctest

This builds the zfp library in the build/lib directory and the zfp command-line executable in the build/bin directory. It then runs the regression tests.

zfp may also be built using GNU make:

cd zfp
make
make test

Note: GNU builds are less flexible and do not support all available features, e.g., CUDA support.

For further configuration and build instructions, please consult the documentation.

Documentation

Full HTML documentation is available online. A PDF version is also available.

Contributing

The zfp project uses the Gitflow development model. Contributions should be made as pull requests on the develop branch. Although this branch is under continuous development, it should be robust enough to pass all regression tests. The master branch is updated with each release and reflects the most recent official release of zfp. See the Releases Page for a history of releases.

Authors

zfp was originally developed by Peter Lindstrom at Lawrence Livermore National Laboratory. Please see the Contributors Page for a full list of contributors.

Citing zfp

If you use zfp for scholarly research, please cite this paper:

Additional Resources

For more information on zfp, please see the zfp website. For bug reports and feature requests, please consult the GitHub issue tracker. For questions and comments not answered here or in the documentation, please send e-mail to [email protected].

License

zfp is distributed under the terms of the BSD 3-Clause license. See the files LICENSE and NOTICE for details.

SPDX-License-Identifier: BSD-3-Clause

LLNL-CODE-663824

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].