336 Open source projects that are alternatives of or similar to Transformer

Visualization for simple attention and Google's multi-head attention.

PyTorch implementation of AAAI 2021 paper: A Hybrid Attention Mechanism for Weakly-Supervised Temporal Action Localization

🎬 Video Captioning: ICCV '15 paper implementation

Deep-learning model presented in "DataStories at SemEval-2017 Task 6: Siamese LSTM with Attention for Humorous Text Comparison".

Implementation of Linformer for Pytorch

A Fast Neural Machine Translation System. It is developed in C++ and resorts to NiuTensor for fast tensor APIs.

Sentiment Analysis: Deep Bi-LSTM+attention model

英中机器文本翻译

A PyTorch implementation of Transformer in "Attention is All You Need"

A prototype version of our submitted paper: Conversion Prediction Using Multi-task Conditional Attention Networks to Support the Creation of Effective Ad Creatives.

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch

Code for Paper Abstract Writing through Editing Mechanism

A list of data mining and machine learning papers that I implemented in 2019.

💻Speech and Natural Language Processing (SLP & NLP) Lab Assignments for ECE NTUA

Attention mechanism

Pytorch implementation of "Dynamic Coattention Networks For Question Answering"

Word Sense Disambiguation using Word Specific models, All word models and Hierarchical models in Tensorflow

Various implementations and projects on CNN, RNN, LSTM, GAN, etc

Predict materials properties using only the composition information!

Transformer based Bangla Speech Recognition

Pytorch implementation of "Compact Global Descriptor for Neural Networks" (CGD).

Deep-learning models of NTUA-SLP team submitted in SemEval 2018 tasks 1, 2 and 3.

Attention-Guided Version of 2D UNet for Automatic Brain Tumor Segmentation

Contains various architectures and novel paper implementations for Natural Language Processing tasks like Sequence Modelling and Neural Machine Translation.

Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound

Implementation of E(n)-Transformer, which extends the ideas of Welling's E(n)-Equivariant Graph Neural Network to attention

The Business Scene Dialogue corpus

Official repository for "Learning Enriched Features for Real Image Restoration and Enhancement" (ECCV 2020). SOTA results for image denoising, super-resolution, and image enhancement.

A tool for translating text from source grammar to target grammar (context-free) with corresponding dictionary.

Library of state-of-the-art models (PyTorch) for NLP tasks

Interactive Neural Machine Translation tool

Compare six baseline deep learning models on TrecQA

An original implementation of "3HAN: A Deep Neural Network for Fake News Detection" (ICONIP 2017)

Clean & Documented TF2 implementation of "An end-to-end deep learning architecture for graph classification" (M. Zhang et al., 2018).

No description or website provided.

source code for signed graph attention networks (ICANN2019) & SDGNN (AAAI2021)

Code for the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis", AAAI'19

The official code repository for MetricMT - a reward optimization method for NMT with learned metrics

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

Sanskrit compound segmentation using seq2seq model

Web application providing a fully localised interface for text/website/document translation, analysis and generation powered by Apertium.

Its a social networking chat-bot trained on Reddit dataset . It supports open bounded queries developed on the concept of Neural Machine Translation. Beware of its being sarcastic just like its creator 😝 BDW it uses Pytorch framework and Python3.

Tooling to play around with multilingual machine translation for Indian Languages.

臺灣言語工具

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Pytorch implementation of a basic language model using Attention in LSTM network

Starter code for the VMT task and challenge

Implementation of the Character-level Intra Attention Network (CIAN) for Natural Language Inference (NLI) upon SNLI and MultiNLI corpus

Implementation of A Structured Self-attentive Sentence Embedding

Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".

Transformer implementation speciaized in speech recognition tasks using Pytorch.

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022

Code for the paper "Extreme Adaptation for Personalized Neural Machine Translation"

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

Neutron: A pytorch based implementation of Transformer and its variants.

codes for paper "Domain Attention Model for Multi-Domain Sentiment Classification"

A simple TensorFlow implementation of the Transformer

Multi heads attention for image classification

Using LSTM or Transformer to solve Image Captioning in Pytorch