All Categories → No Category → pretraining

Top 5 pretraining open source projects

Official codes: Self-Supervised Learning by Estimating Twin Class Distribution

✭ 72

python computer-vision deep-learning twist self-supervised-learning pretraining

EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper

✭ 565

python shell mixer multi-label-classification downstream pretraining vision-transformer imagenet21k semantic-softmax single-label

Revisiting-Contrastive-SSL

Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]

✭ 81

python shell clustering transfer-learning representation-learning unsupervised-learning moco self-supervised-learning neurips pretraining contrastive-learning neurips2021

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

✭ 109

python shell Cuda C++cython lua natural-language-processing deep-learning transformers representation-learning language-model natural-language-understanding pretraining pretrained-language-model contrastive-learning

1-5 of 5 pretraining projects