openucx / Ucx
Licence: other
Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)
Stars: ✭ 471
Programming Languages
c
50402 projects - #5 most used programming language
Projects that are alternatives of or similar to Ucx
Ompi
Open MPI main development repository
Stars: ✭ 1,221 (+159.24%)
Mutual labels: hacktoberfest, hpc, mpi
wxparaver
wxParaver is a trace-based visualization and analysis tool designed to study quantitative detailed metrics and obtain qualitative knowledge of the performance of applications, libraries, processors and whole architectures.
Stars: ✭ 23 (-95.12%)
Mutual labels: hpc, mpi
PartitionedArrays.jl
Vectors and sparse matrices partitioned into pieces for parallel distributed-memory computations.
Stars: ✭ 45 (-90.45%)
Mutual labels: hpc, mpi
pystella
A code generator for grid-based PDE solving on CPUs and GPUs
Stars: ✭ 18 (-96.18%)
Mutual labels: hpc, mpi
yask
YASK--Yet Another Stencil Kit: a domain-specific language and framework to create high-performance stencil code for implementing finite-difference methods and similar applications.
Stars: ✭ 81 (-82.8%)
Mutual labels: hpc, mpi
Easybuild
EasyBuild - building software with ease
Stars: ✭ 321 (-31.85%)
Mutual labels: hacktoberfest, hpc
Devops Guide
DevOps Guide - Development to Production all configurations with basic notes to debug efficiently.
Stars: ✭ 4,119 (+774.52%)
Mutual labels: hacktoberfest, networking
Netjsonconfig
Network configuration management library based on NetJSON DeviceConfiguration
Stars: ✭ 372 (-21.02%)
Mutual labels: hacktoberfest, networking
libquo
Dynamic execution environments for coupled, thread-heterogeneous MPI+X applications
Stars: ✭ 21 (-95.54%)
Mutual labels: hpc, mpi
ACCL
Accelerated Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
Stars: ✭ 28 (-94.06%)
Mutual labels: hpc, mpi
dbcsr
DBCSR: Distributed Block Compressed Sparse Row matrix library
Stars: ✭ 65 (-86.2%)
Mutual labels: hpc, mpi
gpubootcamp
This repository consists for gpu bootcamp material for HPC and AI
Stars: ✭ 227 (-51.8%)
Mutual labels: hpc, mpi
Openwisp Config
OpenWRT configuration agent for OpenWISP Controller
Stars: ✭ 375 (-20.38%)
Mutual labels: hacktoberfest, networking
hpc
Learning and practice of high performance computing (CUDA, Vulkan, OpenCL, OpenMP, TBB, SSE/AVX, NEON, MPI, coroutines, etc. )
Stars: ✭ 39 (-91.72%)
Mutual labels: hpc, mpi
Socks5
A full-fledged high-performance socks5 proxy server written in C#. Plugin support included.
Stars: ✭ 286 (-39.28%)
Mutual labels: hacktoberfest, networking
Unified Communication X
Unified Communication X (UCX) provides an optimized communication layer for Message Passing (MPI), PGAS/OpenSHMEM libraries and RPC/data-centric applications.
UCX utilizes high-speed networks for inter-node communication, and shared memory mechanisms for efficient intra-node communication.
Using UCX
Known critical issues
- UCX version 1.8.0 has a bug that may cause data corruption when TCP transport is used in conjunction with shared memory transport. It is advised to upgrade to UCX version 1.9.0 and above. UCX versions released before 1.8.0 don't have this bug.
Release Builds
Building UCX is typically a combination of running "configure" and "make". Execute the following commands to install the UCX system from within the directory at the top of the tree:
$ ./autogen.sh
$ ./contrib/configure-release --prefix=/where/to/install
$ make -j8
$ make install
NOTE: Compiling support for various networks or other specific hardware may require additional command line flags when running configure.
Developer Builds
$ ./autogen.sh
$ ./contrib/configure-devel --prefix=$PWD/install-debug
*** NOTE: Developer builds of UCX typically include a large performance penalty at run-time because of extra debugging code.
Running internal unit tests
$ make -C test/gtest test
Build RPM package
$ contrib/buildrpm.sh -s -b
Build DEB package
$ dpkg-buildpackage -us -uc
Build Doxygen documentation
$ make docs
OpenMPI and OpenSHMEM installation with UCX
MPICH installation with UCX
UCX Performance Test
Start server:
$ ./src/tools/perf/ucx_perftest -c 0
Connect client:
$ ./src/tools/perf/ucx_perftest <server-hostname> -t tag_lat -c 1
Note: the -c flag sets CPU affinity. If running both commands on same host, make sure you set the affinity to different CPU cores.
Our Community
Licenses
UCX is licensed as:
Contributor Agreement and Guidelines
In order to contribute to UCX, please sign up with an appropriate Contributor Agreement.
Follow these instructions when submitting contributions and changes.
UCX Publications
To reference UCX in a publication, please use the following entry:
@inproceedings{shamis2015ucx,
title={UCX: an open source framework for HPC network APIs and beyond},
author={Shamis, Pavel and Venkata, Manjunath Gorentla and Lopez, M Graham and Baker, Matthew B and Hernandez, Oscar and Itigin, Yossi and Dubman, Mike and Shainer, Gilad and Graham, Richard L and Liss, Liran and others},
booktitle={2015 IEEE 23rd Annual Symposium on High-Performance Interconnects},
pages={40--43},
year={2015},
organization={IEEE}
}
To reference the UCX website:
@misc{openucx-website,
title = {{The Unified Communication X Library}},
key = {{{The Unified Communication X Library}},
howpublished = {{\url{http://www.openucx.org}}}
}
UCX Architecture
| Component | Role | Description |
|---|---|---|
| UCP | Protocol | Implements high-level abstractions such as tag-matching, streams, connection negotiation and establishment, multi-rail, and handling different memory types |
| UCT | Transport | Implements low-level communication primitives such as active messages, remote memory access, and atomic operations |
| UCS | Services | A collection of data structures, algorithms, and system utilities for common use |
| UCM | Memory | Intercepts memory allocation and release events, used by the memory registration cache |
Supported Transports
- Infiniband
- Omni-Path
- RoCE
- Cray Gemini and Aries
- CUDA
- ROCm
- Shared Memory
- TCP/IP
Supported CPU Architectures
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].