Top 362 transformer open source projects

Implementation of Uformer, Attention-based Unet, in Pytorch

Unofficial implementation of "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" (https://arxiv.org/abs/2103.14030)

SwinIR: Image Restoration Using Swin Transformer (official repository)

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

One Person, One Model, One World: Learning Continual User Representation without Forgetting

A PyTorch-based model pruning toolkit for pre-trained language models

End-to-end pipeline with TFX to train and deploy a BERT model for sentiment analysis.

Implementation of the GBST block from the Charformer paper, in Pytorch

The official PyTorch implementation of recent paper - SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training

text generation based on transformer

Implementation of Linformer for Pytorch

Mutate Laravel attributes

Personalizing Dialogue Agents via Meta-Learning

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

a simple and complete pytorch implementation of neural machine translation system

Implementation, trained models and result data for the paper "Pairwise Multi-Class Document Classification for Semantic Relations between Wikipedia Articles"

Laravel5 JSONAPI and Dingo together to build APIs fast

Code for the paper "Are Sixteen Heads Really Better than One?"

Summary of Transformer applications for computer vision tasks.

Korean speech recognition based on transformer (트랜스포머 기반 한국어 음성 인식)

"SOLQ: Segmenting Objects by Learning Queries", SOLQ is an end-to-end instance segmentation framework with Transformer.

Zero administration inference with AWS Lambda for 🤗

A python library that makes AMR parsing, generation and visualization simple.

Code for the AAAI 2022 publication "Well-classified Examples are Underestimated in Classification with Deep Neural Networks"

Unofficial implementation of MaX-DeepLab for Instance Segmentation

Molecular optimization by capturing chemist’s intuition using the Seq2Seq with attention and the Transformer

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

[ICCV2021] Official PyTorch implementation of Segmenter: Transformer for Semantic Segmentation

PyTorch v1.2에서 생긴 Transformer API 를 이용한 간단한 Chitchat 챗봇

Neutron: A pytorch based implementation of Transformer and its variants.

Tutel MoE: An Optimized Mixture-of-Experts Implementation

Using LSTM or Transformer to solve Image Captioning in Pytorch

HAL+JSON & HAL+XML API transformer outputting valid (PSR-7) API Responses.

Code base for M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers

End-to-end Temporal Action Detection with Transformer. [Under review for a journal publication]

Transfromer tensorflow2.0版本实现

Embedding模型代码和学习笔记总结

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

This library provides a set of basic functions for different type of deep learning (and other) algorithms in C.This deep learning library will be constantly updated

From Random Walks to Transformer for Learning Node Embeddings (ECML-PKDD 2020) (In Pytorch and Tensorflow)

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

Contextualised Embeddings and Language Modelling using BERT and Friends using R

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Codes for TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization.

RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words (CVPR 2021)

Trained T5 and T5-large model for creating keywords from text

[ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering

Streaming, transforming, SPARQL-based CSV to RDF converter. Apache license.

Deep Learning Transformer models in MATLAB

Text style transfer benchmark

MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems

This is an official implementation of our NeurIPS 2021 paper "HRFormer: High-Resolution Transformer for Dense Prediction".

"A survey of Transformer" paper study 👩🏻‍💻🧑🏻‍💻 KoreaUniv. DSBA Lab

pix2tex: Using a ViT to convert images of equations into LaTeX code.

Vision-Language Transformer and Query Generation for Referring Segmentation (ICCV 2021)

Sign Language Translation with Transformers (COLING'2020, ECCV'20 SLRTP Workshop)

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

a collection of visualization function