336 Open source projects that are alternatives of or similar to Transformer

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Neural Machine Translation with Keras

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

A seq2seq with attention dialogue/MT model implemented by TensorFlow.

A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Transformers without Tears: Improving the Normalization of Self-Attention

Witwicky: An implementation of Transformer in PyTorch.

Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.

Machine translation is the task of converting one language to other. Unlike the traditional phrase-based translation system which consists of many small sub-components that are tuned separately, neural machine translation attempts to build and train a single, large neural network that reads a sentence and outputs a correct translation.

a simple and complete pytorch implementation of neural machine translation system

[TPAMI 2020] Parallax Attention for Unsupervised Stereo Correspondence Learning

attention mechanism in keras, like Dense and RNN...

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

一些不同的Attention机制代码

Implementation of Nyström Self-attention, from the paper Nyströmformer

Patient2Vec: A Personalized Interpretable Deep Representation of the Longitudinal Electronic Health Record

🔖 An Attention Layer in Keras

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

[AAAI 2020] Modeling Personality with Attentive Networks and Contextual Embeddings

This repository contains the code and data of the paper titled "Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translation" published in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), November 16 - November 20, 2020.

Applied Deep Learning (2019 Spring) @ NTU

PyTorch Implementation of "Monotonic Chunkwise Attention" (ICLR 2018)

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Fast Differentiable Forest lib with the advantages of both decision trees and neural networks

Visualization for simple attention and Google's multi-head attention.

🎬 Video Captioning: ICCV '15 paper implementation

Implementation of Linformer for Pytorch

Sentiment Analysis: Deep Bi-LSTM+attention model

A PyTorch implementation of Transformer in "Attention is All You Need"

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Code for Paper Abstract Writing through Editing Mechanism

💻Speech and Natural Language Processing (SLP & NLP) Lab Assignments for ECE NTUA

Pytorch implementation of "Dynamic Coattention Networks For Question Answering"

Various implementations and projects on CNN, RNN, LSTM, GAN, etc

Transformer based Bangla Speech Recognition

Deep-learning models of NTUA-SLP team submitted in SemEval 2018 tasks 1, 2 and 3.

Contains various architectures and novel paper implementations for Natural Language Processing tasks like Sequence Modelling and Neural Machine Translation.

Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound

Official repository for "Learning Enriched Features for Real Image Restoration and Enhancement" (ECCV 2020). SOTA results for image denoising, super-resolution, and image enhancement.

Compare six baseline deep learning models on TrecQA

Library of state-of-the-art models (PyTorch) for NLP tasks

a collection of visualization function

No description or website provided.

Code for the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis", AAAI'19

ttslearn: Library for Pythonで学ぶ音声合成 (Text-to-speech with Python)

Arbitrary Style Transfer with Style-Attentional Networks

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

Web application providing a fully localised interface for text/website/document translation, analysis and generation powered by Apertium.

Drug effect prediction using neural network

Tooling to play around with multilingual machine translation for Indian Languages.

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Using Residual Attention Networks to diagnose retinal diseases in medical images

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

Multigrid Neural Architecture

Starter code for the VMT task and challenge

Implementation of A Structured Self-attentive Sentence Embedding

An original implementation of "3HAN: A Deep Neural Network for Fake News Detection" (ICONIP 2017)