Top 5 pre-trained-model open source projects

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

PyTorch implementation of Lambda Network and pretrained Lambda-ResNet

An Open-Source Framework for Prompt-Learning.