280 Open source projects that are alternatives of or similar to Keras Attention Mechanism

Pytorch implementation of "Compact Global Descriptor for Neural Networks" (CGD).

A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)

Deep Visual Attention Prediction (TIP18)

Neural Machine Translation with Keras

Code/Model release for NIPS 2017 paper "Attentional Pooling for Action Recognition"

A neural network to generate captions for an image using CNN and RNN with BEAM Search.

A Structured Self-attentive Sentence Embedding

attention mechanism in keras, like Dense and RNN...

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Pytorch implementation of Unsupervised Attention-guided Image-to-Image Translation.

Deep-Learning based CTR models implemented by PyTorch

Code & data accompanying the NAACL 2019 paper "Bidirectional Attentive Memory Networks for Question Answering over Knowledge Bases"

code of Relation Classification via Multi-Level Attention CNNs

Train and visualize Hierarchical Attention Networks

Attention-guided CNN for image denoising(Neural Networks,2020)

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

Implementation of abstractive summarization using LSTM in the encoder-decoder architecture with local attention.

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

An Implementation of 'Attention is all you need' with Chinese Corpus

从零开始学习YOLOv3教程解读代码+注意力模块(SE,SPP,RFB etc)

Implementation of the Point Transformer layer, in Pytorch

Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)

Pytorch Implementation of PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

[ACM MM 2018] Attribute-Aware Attention Model for Fine-grained Representation Learning

Attention-based multimodal fusion for sentiment analysis

A bidirectional LSTM with attention for multiclass/multilabel text classification.

Sparse and structured neural attention mechanisms

Deep neural network to extract intelligent information from invoice documents.

attention-based LSTM/Dense implemented by Keras

The code of CIKM'19 paper《Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach》

Bidirectional LSTM network for speech emotion recognition.

Implementation of Slot Attention from GoogleAI

Soft attention mechanism for video caption generation

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Keras Implementation of Aspect based Sentiment Analysis

Unofficial tensorflow implemention of "Attentive Generative Adversarial Network for Raindrop Removal from A Single Image (CVPR 2018) " model https://maybeshewill-cv.github.io/attentive-gan-derainnet/

Densely Residual Laplacian Super-resolution, IEEE Pattern Analysis and Machine Intelligence (TPAMI), 2020

Chinese Poetry Generation

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

Tensorflow Implement of GeoMAN, IJCAI-18

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

text_recognition_toolbox: The reimplementation of a series of classical scene text recognition papers with Pytorch in a uniform way.

Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".

Important paper implementations for Question Answering using PyTorch

official implementation of the spatial-temporal attention neural network (STANet) for remote sensing image change detection

[CVPR 2020] Official Implementation: "Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models".

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

Coherent Semantic Attention for image inpainting(ICCV 2019)

Hierarchical Attention Networks | a PyTorch Tutorial to Text Classification

[Params: Only 272K!!!] Efficient Image Super-Resolution Using Pixel Attention, in ECCV Workshop, 2020.

Reformer, the efficient Transformer, in Pytorch

Revisiting Video Saliency: A Large-scale Benchmark and a New Model (CVPR18, PAMI19)

Hierarchical Attentive Recurrent Tracking

Implementation of Knowledge Aided Consistency for Weakly Supervised Phrase Grounding in Tensorflow

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

attention model for entailment on SNLI corpus implemented in Tensorflow and Keras

Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)