A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)

✭ 119

jupyter-notebook pytorch lstm rnn recurrent-neural-networks attention-mechanism attention-model attention-is-all-you-need

Transformer image caption

Image Captioning based on Bottom-Up and Top-Down Attention model

✭ 94

jupyter-notebook deep-learning pytorch image-captioning attention-model

Attention Gated Networks

Use of Attention Gates in a Convolutional Neural Network / Medical Image Classification and Segmentation

✭ 1,237

python convolutional-neural-networks image-classification image-segmentation attention-model

Code

ECG Classification

✭ 78

python deep-learning machine-learning pytorch rnn attention-model

Pytorch Attention Guided Cyclegan

Pytorch implementation of Unsupervised Attention-guided Image-to-Image Translation.

✭ 67

python deep-learning machine-learning pytorch deep-neural-networks attention-mechanism attention-model

Deepattention

Deep Visual Attention Prediction (TIP18)

✭ 65

matlab attention-mechanism attention-model

Awesome Attention Mechanism In Cv

计算机视觉中用到的注意力模块和其他即插即用模块PyTorch Implementation Collection of Attention Module and Plug&Play Module

✭ 54

python attention-model implementation

Sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

✭ 990

python deep-learning machine-learning deep-neural-networks translation transformer attention-mechanism mxnet seq2seq machine-translation neural-machine-translation encoder-decoder sequence-to-sequence attention-model gluon attention-is-all-you-need

Reading comprehension tf

Machine Reading Comprehension in Tensorflow

✭ 37

python deep-learning machine-learning natural-language-processing artificial-intelligence convolutional-neural-networks recurrent-neural-networks natural-language-understanding attention-model squad

Text Classification Pytorch

Text classification using deep learning models in Pytorch

✭ 683

python pytorch text-classification attention-model glove sentiment-classification

Nmt Keras

Neural Machine Translation with Keras

✭ 501

python deep-learning machine-learning tensorflow keras transformer attention-mechanism theano machine-translation neural-machine-translation sequence-to-sequence attention-model gru nmt attention-is-all-you-need

Structured Self Attention

A Structured Self-attentive Sentence Embedding

✭ 459

python python3 deep-learning pytorch visualization classification attention-mechanism attention attention-model

Attention Ocr Chinese Version

Attention OCR Based On Tensorflow

✭ 421

python tensorflow text-recognition attention-model crnn

Mtan

The implementation of "End-to-End Multi-Task Learning with Attention" [CVPR 2019].

✭ 364

python pytorch attention-model

Attentiongan

AttentionGAN for Unpaired Image-to-Image Translation & Multi-Domain Image-to-Image Translation

✭ 341

python deep-learning pytorch computer-vision geometry gans image-generation cyclegan attention-model image-translation adversarial-networks

Attention ocr.pytorch

This repository implements the the encoder and decoder model with attention model for OCR

✭ 278

python pytorch ocr attention-model

SAE-NAD

The implementation of "Point-of-Interest Recommendation: Exploiting Self-Attentive Autoencoders with Neighbor-Aware Influence"

✭ 48

python autoencoder recommender-system point-of-interest attention-model attentive-autoencoders

Caver

Caver: a toolkit for multilabel text classification.

✭ 38

python nlp deep-learning text-classification cnn pytorch multi-label-classification attention-model

attention-mechanism-keras

attention mechanism in keras, like Dense and RNN...

✭ 19

python attention-mechanism attention-model attention-lstm attention-visualization

PBAN-PyTorch

A Position-aware Bidirectional Attention Network for Aspect-level Sentiment Analysis, PyTorch implementation.

✭ 33

python nlp natural-language-processing deep-learning sentiment-analysis pytorch attention-model aspect-based-sentiment-analysis

Attention

Repository for Attention Algorithm

✭ 39

Jupyter Notebook lstm soft-attention attention-model hard-attention

Recognizing-Textual-Entailment

A pyTorch implementation of models used for Recognizing Textual Entailment using the SNLI corpus

✭ 31

python deep-learning pytorch attention-model entailment

HHH-An-Online-Question-Answering-System-for-Medical-Questions

HBAM: Hierarchical Bi-directional Word Attention Model

✭ 44

python Jupyter Notebook HTML deep-learning question-answering attention-model medical-chatbot

Compact-Global-Descriptor

Pytorch implementation of "Compact Global Descriptor for Neural Networks" (CGD).

✭ 22

python shell efficient pytorch convolutional-neural-networks attention-mechanism attention-model efficient-attention

learningspoons

nlp lecture-notes and source code

✭ 29

Jupyter Notebook python nlp tensorflow word2vec cnn transformer lstm ipynb attention cbow lecture-notes seq2seq-model attention-model colab-notebook

GATE

The implementation of "Gated Attentive-Autoencoder for Content-Aware Recommendation"

✭ 65

python Jupyter Notebook autoencoder content-aware recommender-systems attention-model

SANET

"Arbitrary Style Transfer with Style-Attentional Networks" (CVPR 2019)

✭ 21

HTML deep-learning-algorithms styletransfer attention-model

reasoning attention

Unofficial implementation algorithms of attention models on SNLI dataset

✭ 34

python Jupyter Notebook shell lasagne attention snli attention-model

G2P

Grapheme To Phoneme

✭ 59

python pytorch g2p attention-model

swin-transformer-pytorch

Implementation of the Swin Transformer in PyTorch.

✭ 610

python machine-learning deep-learning pytorch artificial-intelligence attention-model transformer-architecture transformer-pytorch

1-42 of 42 attention-model projects