Top 178 attention open source projects

Cgnl Network.pytorch
Compact Generalized Non-local Network (NIPS 2018)
⚠️[Deprecated] no longer maintained, please use the code in
Ai law
all kinds of baseline models for long text classificaiton( text categorization)
Long Range Arena
Long Range Arena for Benchmarking Efficient Transformers
Jddc solution 4th
A PyTorch implementation of "Predict then Propagate: Graph Neural Networks meet Personalized PageRank" (ICLR 2019).
Self Attention Cv
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
A PyTorch implementation of "Graph Classification Using Structural Attention" (KDD 2018).
Neat Vision
Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)
Pen Net For Inpainting
[CVPR'2019]PEN-Net: Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
Doc Han Att
Hierarchical Attention Networks for Chinese Sentiment Classification
Guided Attention Inference Network
Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.
Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.
Train and visualize Hierarchical Attention Networks
Self Attentive Tensorflow
Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"
Graph attention pool
Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)
Datastories Semeval2017 Task4
Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
Deep Time Series Prediction
Seq2Seq, Bert, Transformer, WaveNet for time series prediction.
Pyramid Attention Networks Pytorch
Implementation of Pyramid Attention Networks for Semantic Segmentation.
Rnn For Joint Nlu
Pytorch implementation of "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling" (
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
Medical Transformer
Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"
Multihead Siamese Nets
Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.
Vqa regat
Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"
Chinese Chatbot
Asr syllable
Absa keras
Keras Implementation of Aspect based Sentiment Analysis
Ccnet Pure Pytorch
Criss-Cross Attention for Semantic Segmentation in pure Pytorch with a faster and more precise implementation.
Punctuation restoration and spell correction experiments.
Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection
Lambda Networks
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
Multi-turn dialogue baselines written in PyTorch
End-to-end variable length Captcha recognition using CNN+RNN+Attention/CTC (pytorch implementation). 端到端的不定长验证码识别
Njunmt Tf
An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.
Cnn lstm for text classify
CNN, LSTM, NBOW, fasttext 中文文本分类
Nlp Journey
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation),etc. All codes are implemented intensorflow 2.0.
Eval On Nn Of Rc
Empirical Evaluation on Current Neural Networks on Cloze-style Reading Comprehension
Self Attention Classification
document classification using LSTM + self attention
Attention Transfer
Improving Convolutional Networks via Attention Transfer (ICLR 2017)
Hierarchical Attention Transfer Network for Cross-domain Sentiment Classification (AAAI'18)
Absa Pytorch
Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析,使用PyTorch实现。
Enjoy Hamburger
[ICLR 2021] Is Attention Better Than Matrix Decomposition?
Deeplearning Nlp Models
A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.
Global Self Attention Network
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
Attention Over Attention Tf Qa
论文“Attention-over-Attention Neural Networks for Reading Comprehension”中AoA模型实现
Yolov4 Pytorch
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
A deep learning library based on Pytorch focussed on low resource language research and robustness
1-60 of 178 attention projects