Top 2 pipeline-parallelism open source projects
pytorch-gpt-x
Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.
libai
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
1-2 of 2 pipeline-parallelism projects