All Categories → No Category → model-parallel

Top 3 model-parallel open source projects

A memory balanced and communication efficient FullyConnected layer with CrossEntropyLoss model parallel implementation in PyTorch

✭ 74

python pytorch half-precision re-id distributed-training model-parallel

torchshard

TorchShard: Slicing a PyTorch Tensor Into Parallel Shards.

✭ 267

python shell pytorch model-parallel shard-training

PLSC

Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, DeiT, FaceViT.

✭ 113

python shell face-recognition resnet vit data-parallel large-scale paddle paddlepaddle low-memory distributed-training arcface cosface model-parallel deit hight-speed partial-fc facevit

1-3 of 3 model-parallel projects