787 Open source projects that are alternatives of or similar to Structured Self Attention

A neural network to generate captions for an image using CNN and RNN with BEAM Search.

Train and visualize Hierarchical Attention Networks

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

Attention mechanism Implementation for Keras.

Deep-learning models of NTUA-SLP team submitted in SemEval 2018 tasks 1, 2 and 3.

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

Keras Implementation of Aspect based Sentiment Analysis

Deep-Learning based CTR models implemented by PyTorch

nlp lecture-notes and source code

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Predict materials properties using only the composition information!

End-to-end ASR/LM implementation with PyTorch

Deep-learning model presented in "DataStories at SemEval-2017 Task 6: Siamese LSTM with Attention for Humorous Text Comparison".

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

Attention mechanism

Implementation of State-of-the-art Text Classification Models in Pytorch

A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)

Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)

Deep Visual Attention Prediction (TIP18)

My Attempt(s) In The World Of ML/DL....

Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem

[AAAI 2020] Modeling Personality with Attentive Networks and Contextual Embeddings

a collection of visualization function

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

Drug effect prediction using neural network

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

BERT-NER (nert-bert) with google bert https://github.com/google-research.

Pytorch implementation of "Compact Global Descriptor for Neural Networks" (CGD).

An implementation of Performer, a linear attention-based transformer, in Pytorch

Neural Machine Translation with Keras

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Unofficial implementation algorithms of attention models on SNLI dataset

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

A Tensorfflow implementation of Attend, Infer, Repeat

Pytorch implementation of Unsupervised Attention-guided Image-to-Image Translation.

attention mechanism in keras, like Dense and RNN...

Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".

Attention-based multimodal fusion for sentiment analysis

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

Pointer-generator reinforced seq2seq summarization in PyTorch

all kinds of text classification models and more with deep learning

Reproduce simple cv project including attention module, classification, object detection, segmentation, keypoint detection, tracking 😄 etc.

Attention-based bidirectional LSTM for Classification Task (ICASSP)

Code/Model release for NIPS 2017 paper "Attentional Pooling for Action Recognition"

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

Word Sense Disambiguation using Word Specific models, All word models and Hierarchical models in Tensorflow

💻Speech and Natural Language Processing (SLP & NLP) Lab Assignments for ECE NTUA

一些不同的Attention机制代码

Semantic3D segmentation with Open3D and PointNet++

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Attention OCR Based On Tensorflow

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

A wizard's guide to Adversarial Autoencoders

CNN-RNN中文文本分类，基于TensorFlow

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Keras implementation of the graph attention networks (GAT) by Veličković et al. (2017; https://arxiv.org/abs/1710.10903)

Curated Tensorflow code resources to help you get started with Deep Learning.

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)