517 Open source projects that are alternatives of or similar to Awesome Fast Attention

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

A PyTorch Implementation of "Attention Is All You Need"

Summary of Transformer applications for computer vision tasks.

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

Official and maintained implementation of the paper Attention-Based Transformers for Instance Segmentation of Cells in Microstructures [BIBM 2020].

pytorch implementation of Attention is all you need

An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.

BertQA - Attention on Steroids

Sequence to Sequence Models in PyTorch

[ICCV 2021] TRAR: Routing the Attention Spans in Transformers for Visual Question Answering -- Official Implementation

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

End-to-end ASR/LM implementation with PyTorch

Predict materials properties using only the composition information!

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Transformers without Tears: Improving the Normalization of Self-Attention

Implementation of State-of-the-art Text Classification Models in Pytorch

Multi-turn dialogue baselines written in PyTorch

A TensorFlow Implementation of the Transformer: Attention Is All You Need

2018-JDDC大赛第4名的解决方案

A simple TensorFlow implementation of the Transformer

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

nlp lecture-notes and source code

A PyTorch implementation of the Transformer model in "Attention is All You Need".

a collection of visualization function

Julia Implementation of Transformer models

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Neutron: A pytorch based implementation of Transformer and its variants.

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

Neural Machine Translation with Keras

Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"

NLP: Relation extraction with position-aware self-attention transformer

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

Witwicky: An implementation of Transformer in PyTorch.

Natural Language Processing Tutorial for Deep Learning Researchers

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

Transformer implementation speciaized in speech recognition tasks using Pytorch.

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

Transformer implemented in Keras

Fine-grained Sentiment Analysis of User Reviews --- AI CHALLENGER 2018

Data Augmentation by Backtranslation (DAB) ヽ( •_-)ᕗ

Minimalist NMT for educational purposes

Simple transformer implementation from scratch in pytorch.

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

LightSeq: A High Performance Inference Library for Sequence Processing and Generation

A PyTorch Implementation of "Recurrent Models of Visual Attention"

Time series Timeseries Deep Learning Pytorch fastai - State-of-the-art Deep Learning with Time Series and Sequences in Pytorch / fastai

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!

Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)

[NeurIPS 2020] Official code for the paper "DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation". Includes a PyTorch library for deep learning with SVG data.

NLP Paper

Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL

An implementation of Performer, a linear attention-based transformer, in Pytorch