11 open source projects by hpc

Lightweight user-defined software stacks for high-performance computing.

dcp is a distributed file copy program that automatically distributes and dynamically balances work equally across nodes in a large distributed system without centralized state.

IOR and mdtest

File utilities designed for scalability and performance.

An API to provide an efficient distributed queue on a cluster. Libcircle is currently used in production to quickly traverse and perform operations on a file tree which contains several hundred-million file nodes.

Scalable dynamic library and python loading in HPC environments

MPI Memory Consumption Utilities

Some example MPI programs

libhio is a library intended for writing data to hierarchical data store systems.

A distributed and decentralized filesystem treewalk function, similiar to the interface of linux's ftw(3). libdftw automatically and dynamically balances the treewalk workload across many nodes in a large distributed system.

Generate an optimal rootfs hybridize list of files that should be symlinked to NFS mount and not required before NFS mount happens