371 Open source projects that are alternatives of or similar to attention-is-all-you-need-paper

Data Augmentation by Backtranslation (DAB) ヽ( •_-)ᕗ

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

list of efficient attention modules

Witwicky: An implementation of Transformer in PyTorch.

Neural Machine Translation with Keras

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

Transformers without Tears: Improving the Normalization of Self-Attention

Transformer implementation speciaized in speech recognition tasks using Pytorch.

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Neutron: A pytorch based implementation of Transformer and its variants.

pytorch implementation of Attention is all you need

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

A simple TensorFlow implementation of the Transformer

A PyTorch Implementation of "Attention Is All You Need"

Trained T5 and T5-large model for creating keywords from text

[ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering

Streaming, transforming, SPARQL-based CSV to RDF converter. Apache license.

Text style transfer benchmark

Zero administration inference with AWS Lambda for 🤗

Using LSTM or Transformer to solve Image Captioning in Pytorch

This is an official implementation of our NeurIPS 2021 paper "HRFormer: High-Resolution Transformer for Dense Prediction".

pix2tex: Using a ViT to convert images of equations into LaTeX code.

Code base for M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers

Sign Language Translation with Transformers (COLING'2020, ECCV'20 SLRTP Workshop)

RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words (CVPR 2021)

PyTorch v1.2에서 생긴 Transformer API 를 이용한 간단한 Chitchat 챗봇

"SOLQ: Segmenting Objects by Learning Queries", SOLQ is an end-to-end instance segmentation framework with Transformer.

Deep Learning Transformer models in MATLAB

Tutel MoE: An Optimized Mixture-of-Experts Implementation

MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems

Laravel5 JSONAPI and Dingo together to build APIs fast

"A survey of Transformer" paper study 👩🏻‍💻🧑🏻‍💻 KoreaUniv. DSBA Lab

HAL+JSON & HAL+XML API transformer outputting valid (PSR-7) API Responses.

Vision-Language Transformer and Query Generation for Referring Segmentation (ICCV 2021)

A python library that makes AMR parsing, generation and visualization simple.

End-to-end Temporal Action Detection with Transformer. [Under review for a journal publication]

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

a collection of visualization function

Laravel 5 HAL+JSON API Transformer Package

a simple and complete pytorch implementation of neural machine translation system

Code for the paper "Are Sixteen Heads Really Better than One?"

Code for the AAAI 2022 publication "Well-classified Examples are Underestimated in Classification with Deep Neural Networks"

Transfromer tensorflow2.0版本实现

NLP: Relation extraction with position-aware self-attention transformer

Grapheme to phoneme conversion with deep learning.

Embedding模型代码和学习笔记总结

Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

Unofficial implementation of MaX-DeepLab for Instance Segmentation

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

Representing Long-Range Context for Graph Neural Networks with Global Attention

XPersona: Evaluating Multilingual Personalized Chatbot

This library provides a set of basic functions for different type of deep learning (and other) algorithms in C.This deep learning library will be constantly updated

Laravel Transformer

The official PyTorch implementation of "Pathfinder Discovery Networks for Neural Message Passing" (WebConf '21)

Summary of Transformer applications for computer vision tasks.

Molecular optimization by capturing chemist’s intuition using the Seq2Seq with attention and the Transformer

From Random Walks to Transformer for Learning Node Embeddings (ECML-PKDD 2020) (In Pytorch and Tensorflow)