Top 223 attention-mechanism open source projects

Implementation of Knowledge Aided Consistency for Weakly Supervised Phrase Grounding in Tensorflow

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

Source code of paper: (not available now)

Raw implementation of attention gated U-Net by Keras

Implementation of Grounding of Textual Phrases in Images by Reconstruction in Tensorflow

A Tensorfflow implementation of Attend, Infer, Repeat

Source code of AAAI 2020 paper 'Learning to Incorporate Structure Knowledge for Image Inpainting'

SimpleDNN is a machine learning lightweight open-source library written in Kotlin designed to support relevant neural network architectures in natural language processing tasks

Protein-compound affinity prediction through unified RNN-CNN

TensorFlow implementation of the paper "Hierarchical Attention Networks for Document Classification"

Fake News Detection using Deep Learning models in Tensorflow

Detecting Sarcasm on Twitter using both traditonal machine learning and deep learning techniques.

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Model submitted for the ICMI 2018 EmotiW Group-Level Emotion Recognition Challenge

Pytorch implementation of Unsupervised Attention-guided Image-to-Image Translation.

Deep Visual Attention Prediction (TIP18)

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

🔍 Attentional interfaces in TensorFlow.

Code for Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentation.

Code for Describing a Knowledge Base

Attention,Factorization Machine, Deep Learning, Recommender System

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Text classifier for Hierarchical Attention Networks for Document Classification

Attentive Federated Learning for Private NLM

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

TensorFlow Implementation of "Show, Attend and Tell"

all kinds of text classification models and more with deep learning

This is a reimplementation of AG-CNN. ("Thorax Disease Classification with Attention Guided Convolutional Neural Network","Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification")

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等，并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口

Visualizing RNNs using the attention mechanism

pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

An implementation of Performer, a linear attention-based transformer, in Pytorch

MORAN: A Multi-Object Rectified Attention Network for Scene Text Recognition

Neural Machine Translation with Keras

Attention mechanism for processing sequential data that considers the context for each timestamp.

This repository contains my full work and notes on Coursera's NLP Specialization (Natural Language Processing) taught by the instructor Younes Bensouda Mourri and Łukasz Kaiser offered by deeplearning.ai

A Structured Self-attentive Sentence Embedding

A collection of important graph embedding, classification and representation learning papers with implementations.

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Implementation of Bottleneck Transformer in Pytorch

End-to-end ASR/LM implementation with PyTorch

Code for PaperRobot: Incremental Draft Generation of Scientific Ideas

A PyTorch implementation of "SimGNN: A Neural Network Approach to Fast Graph Similarity Computation" (WSDM 2019).

Action recognition using soft attention based deep recurrent neural networks

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Keras implementation of the graph attention networks (GAT) by Veličković et al. (2017; https://arxiv.org/abs/1710.10903)

Model Compression—YOLOv3 with multi lightweight backbones(ShuffleNetV2 HuaWei GhostNet), attention, prune and quantization

基于seq2seq模型的简单对话系统的tf实现，具有embedding、attention、beam_search等功能，数据集是Cornell Movie Dialogs

End-to-End speech recognition implementation base on TensorFlow (CTC, Attention, and MTL training)

Pointer-generator reinforced seq2seq summarization in PyTorch

To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning"

Transformer of "Attention Is All You Need" (Vaswani et al. 2017) by Chainer.

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Code for our paper "Multi-scale Guided Attention for Medical Image Segmentation"

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"