GitPlanet
Projects
Users
Categories
Languages
About
All Categories
→
No Category
→ model-parallelism
Top 2 model-parallelism open source projects
Deepspeed
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
✭ 6,024
python
Cuda
C++
shell
deep-learning
machine-learning
pytorch
gpu
data-parallelism
model-parallelism
billion-parameters
libai
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
✭ 284
python
C++
nlp
deep-learning
transformer
large-scale
data-parallelism
model-parallelism
distributed-training
self-supervised-learning
oneflow
pipeline-parallelism
vision-transformer
1-2
of
2
model-parallelism projects
