All Categories → No Category → self-attention

Top 23 self-attention open source projects

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

✭ 2,229

python tensorflow neural-networks attention-mechanism graph-attention-networks self-attention

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

✭ 1,853

python pytorch neural-networks attention-mechanism graph-attention-networks self-attention

attention-augmented-conv

Implementation from the paper Attention Augmented Convolutional Networks in Tensorflow (https://arxiv.org/pdf/1904.09925v1.pdf)

✭ 47

python deep-learning tensorflow self-attention

pytorch-psetae

PyTorch implementation of the model presented in "Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention"

✭ 117

python machine-learning computer-vision deep-learning agriculture pytorch remote-sensing cvpr spatio-temporal earth-observation time-series-classification self-attention transformer-architecture satellite-image cvpr2020

Walk-Transformer

From Random Walks to Transformer for Learning Node Embeddings (ECML-PKDD 2020) (In Pytorch and Tensorflow)

✭ 26

python C++Makefile transformer random-walk graph-embeddings node-classification self-attention graph-neural-networks pytorch-implementation unsupervised-node-embedding node-embeddings inductive-node-embeddings

Parallel-Tacotron2

PyTorch Implementation of Google's Parallel Tacotron 2: A Non-Autoregressive Neural TTS Model with Differentiable Duration Modeling

✭ 149

python text-to-speech duration pytorch tts speech-synthesis english vae self-attention neural-tts non-autoregressive fastspeech parallel-tacotron parallel-tacotron2

robustness-vit

Contains code for the paper "Vision Transformers are Robust Learners" (AAAI 2022).

✭ 78

Jupyter Notebook python computer-vision tensorflow transformers pytorch robustness self-attention jax

iPerceive

Object-and-Semantic-Part-Detection-pyTorch

Joint detection of Object and its Semantic parts using Attention-based Feature Fusion on PASCAL Parts 2010 dataset

✭ 18

python Jupyter Notebook computer-vision pytorch faster-rcnn convolutional-neural-networks object-detection self-attention feature-fusion

Awesome-Vision-Transformer-Collection

Variants of Vision Transformer and its downstream tasks

✭ 124

tracking awesome computer-vision deep-learning detection backbone generative-model segmentation pose-estimation lidar-point-cloud explainable-ai self-attention self-supervised-learning

Relational Deep Reinforcement Learning

No description or website provided.

✭ 44

python reinforcement-learning tensorflow relational-networks proximal-policy-optimization ppo explainable-ai self-attention

lightweight-temporal-attention-pytorch

A PyTorch implementation of the Light Temporal Attention Encoder (L-TAE) for satellite image time series. classification

✭ 43

python machine-learning deep-neural-networks deep-learning time-series satellite pytorch remote-sensing classification deeplearning satellite-imagery satellite-data time-series-classification self-attention

CrabNet

Predict materials properties using only the composition information!

✭ 57

python machine-learning scikit-learn pytorch transformer neural-networks attention materials-science materials-informatics attention-mechanism materials-screening self-attention predict-materials-properties

VAENAR-TTS

PyTorch Implementation of VAENAR-TTS: Variational Auto-Encoder based Non-AutoRegressive Text-to-Speech Synthesis.

✭ 66

python text-to-speech duration pytorch tts speech-synthesis vae unsupervised-learning glow self-attention neural-tts non-autoregressive transforer non-ar unsupervised-duration

AttnSleep

[IEEE TNSRE] "An Attention-based Deep Learning Approach for Sleep Stage Classification with Single-Channel EEG"

✭ 76

python shell pytorch eeg attention eeg-classification sleep-staging self-attention sleep-stage-scoring sleep-stage-classification

Multi-Hop-Knowledge-Paths-Human-Needs

Ranking and Selecting Multi-Hop Knowledge Paths to Better Predict Human Needs

✭ 17

python shell naacl machine-learning sentiment-analysis 2019 self-attention human-needs

FUSION

PyTorch code for NeurIPSW 2020 paper (4th Workshop on Meta-Learning) "Few-Shot Unsupervised Continual Learning through Meta-Examples"

✭ 18

python representation-learning unsupervised-learning incremental-learning meta-learning continual-learning self-attention few-shot-learning

Generative MLZSL

[TPAMI Under Submission] Generative Multi-Label Zero-Shot Learning

✭ 37

python shell pytorch generative-adversarial-network multi-label-classification vaegan self-attention pytorch-implementation zero-shot-detection gzsl zsl clswgan zero-shot-classification multi-label-zsl

Transformer-in-PyTorch

Transformer/Transformer-XL/R-Transformer examples and explanations

✭ 21

python transformers self-attention multi-head-self-attention transformer-variants

R-MeN

Transformer-based Memory Networks for Knowledge Graph Embeddings (ACL 2020) (Pytorch and Tensorflow)

✭ 74

python c C++transformer knowledge-graph knowledge-graph-embeddings self-attention triple-classification search-personalization relational-memory knowledge-graph-transformer

MASTER-pytorch

Code for the paper "MASTER: Multi-Aspect Non-local Network for Scene Text Recognition" (Pattern Recognition 2021)

✭ 263

python shell ocr transformer scene-text-recognition self-attention non-local-network

query-selector

LONG-TERM SERIES FORECASTING WITH QUERYSELECTOR – EFFICIENT MODEL OF SPARSEATTENTION

✭ 63

python machine-learning deep-learning time-series pytorch transformer forecasting self-attention

seq2seq-pytorch

Sequence to Sequence Models in PyTorch

✭ 41

python shell pytorch transformer pointer-networks attention sequence-to-sequence rnn-encoder-decoder self-attention

1-23 of 23 self-attention projects