659 Open source projects that are alternatives of or similar to transformer

End-to-end ASR/LM implementation with PyTorch

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

list of efficient attention modules

Neutron: A pytorch based implementation of Transformer and its variants.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Implementation of State-of-the-art Text Classification Models in Pytorch

Multi-turn dialogue baselines written in PyTorch

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

Summary of Transformer applications for computer vision tasks.

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

Fine-grained Sentiment Analysis of User Reviews --- AI CHALLENGER 2018

Transformer implemented in Keras

Data Augmentation by Backtranslation (DAB) ヽ( •_-)ᕗ

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Neural Machine Translation with Keras

Official and maintained implementation of the paper Attention-Based Transformers for Instance Segmentation of Cells in Microstructures [BIBM 2020].

一个基于深度学习的中文聊天机器人，这里有详细的教程与代码，每份代码都有详细的注释，作为学习是美好的选择。A Chinese chatbot based on deep learning.

🎨 🎨NLP 自然语言处理教程 🎨🎨 https://dataxujing.github.io/NLP-paper/

Predict materials properties using only the composition information!

Witwicky: An implementation of Transformer in PyTorch.

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

Molecular optimization by capturing chemist’s intuition using the Seq2Seq with attention and the Transformer

PyTorch v1.2에서 생긴 Transformer API 를 이용한 간단한 Chitchat 챗봇

multi-label，classifier，text classification，多标签文本分类，文本分类，BERT，ALBERT，multi-label-classification，seq2seq，attention，beam search

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

Embedding模型代码和学习笔记总结

BertQA - Attention on Steroids

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

Julia Implementation of Transformer models

A wrapper around tensor2tensor to flexibly train, interact, and generate data for neural chatbots.

Minimalist NMT for educational purposes

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

텐서플로우와 머신러닝으로 시작하는 자연어처리(로지스틱회귀부터 트랜스포머 챗봇까지)

pytorch implementation of Attention is all you need

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

a collection of visualization function

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

텐서플로2와 머신러닝으로 시작하는 자연어처리 (로지스틱회귀부터 BERT와 GPT3까지) 실습자료

Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"

An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.

nlp lecture-notes and source code

seq2seq attention tensorflow textrank context

Code and data form the paper BERT Got a Date: Introducing Transformers to Temporal Tagging

NLP Core Library and Model Zoo based on PaddlePaddle 2.0

Transformers without Tears: Improving the Normalization of Self-Attention

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Sequence to Sequence Models in PyTorch

網頁聊天機器人 | tensorflow implementation of seq2seq model with bahdanau attention and Word2Vec pretrained embedding

Transformer implementation speciaized in speech recognition tasks using Pytorch.

NLP: Relation extraction with position-aware self-attention transformer

Natural Language Processing Tutorial for Deep Learning Researchers

2018-JDDC大赛第4名的解决方案

A simple TensorFlow implementation of the Transformer

[ICCV 2021] TRAR: Routing the Attention Spans in Transformers for Visual Question Answering -- Official Implementation