Top 178 attention open source projects

Sorting numbers with pointer networks

📚 Text classification library with Keras

Implementation of RNN for Time Series prediction from the paper https://arxiv.org/abs/1704.02971

A Keras Implementation of Attention_based Siamese Manhattan LSTM

Re-implementation of Bi-Directional Block Self-Attention for Fast and Memory-Efficient Sequence Modeling (T. Shen et al., ICLR 2018) on Pytorch.

PyTorch implementation of some attentions for Deep Learning Researchers.

TensorFlow Implementation of "Attention Clusters: Purely Attention Based Local Feature Integration for Video Classification"

implementing "recurrent attentive neural processes" to forecast power usage (w. LSTM baseline, MCDropout)

DeFactoNLP: An Automated Fact-checking System that uses Named Entity Recognition, TF-IDF vector comparison and Decomposable Attention models.

Bangla Machine Translator

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

Use tensorflow to achieve some NLP project, eg: classification chatbot ner attention QAetc.

Official and maintained implementation of the paper Attention-Based Transformers for Instance Segmentation of Cells in Microstructures [BIBM 2020].

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

A Tensorflow implementation of Spatial Transformer Networks.

Tensorflow implementation of attention mechanism for text classification tasks.

研读顶会论文，复现论文相关代码

Implementation of papers for text classification task on DBpedia

list of efficient attention modules

Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.

Reproduce simple cv project including attention module, classification, object detection, segmentation, keypoint detection, tracking 😄 etc.

A PyTorch implementation of the Transformer model in "Attention is All You Need".

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

An implementation of Performer, a linear attention-based transformer, in Pytorch

Residual Attention Network for Image Classification

A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text

中文实体关系抽取，pytorch，bilstm+attention

A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling

A Structured Self-attentive Sentence Embedding

Bilinear attention networks for visual question answering

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

Generative Adversarial Transformers

A PyTorch Implementation of "Recurrent Models of Visual Attention"

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

End-to-end ASR/LM implementation with PyTorch

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Implementation of State-of-the-art Text Classification Models in Pytorch

BERT-NER (nert-bert) with google bert https://github.com/google-research.

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

CRNN with attention to do OCR,add Chinese recognition

Deep Xi: A deep learning approach to a priori SNR estimation implemented in TensorFlow 2/Keras. For speech enhancement and robust ASR.

Pointer-generator reinforced seq2seq summarization in PyTorch

Transformer implemented in Keras

Deep Modular Co-Attention Networks for Visual Question Answering

[ICCV 2019] "ABD-Net: Attentive but Diverse Person Re-Identification" https://arxiv.org/abs/1908.01114

Four styles of encoder decoder model by Python, Theano, Keras and Seq2Seq

A PyTorch Implementation of "Watch Your Step: Learning Node Embeddings via Graph Attention" (NeurIPS 2018).

Implementation of ABCNN(Attention-Based Convolutional Neural Network) on Tensorflow

Fine-grained Sentiment Analysis of User Reviews --- AI CHALLENGER 2018

Official code for ResUNetplusplus for medical image segmentation (TensorFlow implementation) (IEEE ISM)

PyTorch implementation of MTAD-GAT (Multivariate Time-Series Anomaly Detection via Graph Attention Networks) by Zhao et. al (2020, https://arxiv.org/abs/2009.02040).

Visualization for simple attention and Google's multi-head attention.

一些不同的Attention机制代码

Summary of Transformer applications for computer vision tasks.

Semantic Aware Attention Based Deep Object Co-segmentation

CVPR 2021: "Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE"

⌛ Introducing Self-Attention to Target Attentive Graph Neural Networks (AISP '22)

Image captioning using attention models

[CVPR2020] "Detecting Attended Visual Targets in Video"