1000 Open source projects that are alternatives of or similar to Transformer

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Neural Machine Translation with Keras

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

a simple and complete pytorch implementation of neural machine translation system

pytorch implementation of Attention is all you need

Witwicky: An implementation of Transformer in PyTorch.

End-to-end ASR/LM implementation with PyTorch

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

Fully featured implementation of Routing Transformer

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

Visualizing RNNs using the attention mechanism

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

Data Augmentation by Backtranslation (DAB) ヽ( •_-)ᕗ

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

TianChi AIEarth Contest Solution

A simple TensorFlow implementation of the Transformer

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

🎨 🎨NLP 自然语言处理教程 🎨🎨 https://dataxujing.github.io/NLP-paper/

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Exploring attention weights in transformer-based models with linguistic knowledge.

Transformer implementation speciaized in speech recognition tasks using Pytorch.

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

list of efficient attention modules

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

Transformers without Tears: Improving the Normalization of Self-Attention

Using LSTM or Transformer to solve Image Captioning in Pytorch

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

An Implementation of 'Attention is all you need' with Chinese Corpus

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Transformer based on a variant of attention that is linear complexity in respect to sequence length

Neutron: A pytorch based implementation of Transformer and its variants.

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

Implementation of E(n)-Transformer, which extends the ideas of Welling's E(n)-Equivariant Graph Neural Network to attention

Implementation of Linformer for Pytorch

Transformer implemented in Keras

Predict materials properties using only the composition information!

A PyTorch Implementation of "Attention Is All You Need"

An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.

a collection of visualization function

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Microsoft Text-to-Speech API sample code in several languages, part of Cognitive Services.

A scene text recognition toolbox based on PyTorch

A browser and wallet for LBRY, the decentralized, user-controlled content marketplace.

A python package to run contextualized topic modeling. CTMs combine BERT with topic models to get coherent topics. Also supports multilingual tasks. Cross-lingual Zero-shot model published at EACL 2021.

🏁 Automatically clean your Localizable.strings files

Go (Golang) GNU gettext utilities package

🌍📖 A readable, automated, and optimized (5 kb) internationalization for JavaScript