Top 124 transformers open source projects

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

🧑‍🏫 50! Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Transformers for Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

State of the Art Natural Language Processing

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Super easy library for BERT based NLP models

🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.

Reformer, the efficient Transformer, in Pytorch

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Text-to-Image generation. The repo for NeurIPS 2021 paper "CogView: Mastering Text-to-Image Generation via Transformers".

Zero-Shot Text-to-Image Generation VQGAN+CLIP Dockerized

Hashformers is a framework for hashtag segmentation with transformers.

Yuno is context based search engine for anime.

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

Transformer based Bangla Speech Recognition

HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision

Emotion recognition in conversation

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

Bangla-Bert is a pretrained bert model for Bengali language

Simple transformer implementations that I can understand

A library for finding knowledge neurons in pretrained transformer models.

🌏 A zero-dependency networking solution for building modern and secure iOS, watchOS, macOS and tvOS applications.

[ICCV 2021] Official implementation of "Scalable Vision Transformers with Hierarchical Pooling"

An Open-Source Package for Chinese Open-domain Conversational Chatbot (中文闲聊对话系统，一键部署微信闲聊机器人)

classy is a simple-to-use library for building high-performance Machine Learning models in NLP.

General Multi-label Image Classification with Transformers

Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch

Text2Text: Cross-lingual natural language processing and generation toolkit

Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.

Deploy transformers serverless on AWS Lambda

Multi-class text categorization using state-of-the-art pre-trained contextualized language models, e.g. BERT

Text Classification in Turkish Texts with Bert

Utility for analyzing Transformer based representations of language.

A PyTorch-based toolkit for natural language processing

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

Transformers Pipeline with KoELECTRA

Multi-Class Text Classification for products based on their description with Machine Learning algorithms and Neural Networks (MLP, CNN, Distilbert).

A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+

Contextualised Embeddings and Language Modelling using BERT and Friends using R

Trained T5 and T5-large model for creating keywords from text

Active Learning for Text Classification in Python

EVE bot, a customer service chatbot to enhance virtual engagement for Twitter Apple Support

Persian Bert For Long-Range Sequences

Contains code for the paper "Vision Transformers are Robust Learners" (AAAI 2022).

Pytorch Implementation of GoEmotions 😍😢😱

Using pre-trained BERT models for Chinese and English NER with 🤗Transformers

Multimodal Image Synthesis and Editing: A Survey

Implementation of the Remixer Block from the Remixer paper, in Pytorch

🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools

Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering | Python3 | PyTorch | CNNs | Causality | Reasoning | LSTMs | Transformers | Multi-Head Self Attention | Published in IEEE Winter Conference on Applications of Computer Vision (WACV) 2021

Chef Transformer 🍲 .

Pytorch-NLU，一个中文文本分类、序列标注工具包，支持中文长文本、短文本的多类、多标签分类任务，支持中文命名实体识别、词性标注、分词等序列标注任务。 Ptorch NLU, a Chinese text classification and sequence annotation toolkit, supports multi class and multi label classification tasks of Chinese long text and short text, and supports sequence annotation tasks such as Chinese named entity recognition, part of speech ta…

This is the official implementation of TransCenter. The code and pretrained models are now available here: https://gitlab.inria.fr/yixu/TransCenter_official.