1265 Open source projects that are alternatives of or similar to Global Self Attention Network

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

An implementation of Performer, a linear attention-based transformer, in Pytorch

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Implementation of Bottleneck Transformer in Pytorch

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

CNN image classifier implemented in Keras Notebook 🖼️.

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

MemeGen is a web application where the user gives an image as input and our tool generates a meme at one click for the user.

Attention-based bidirectional LSTM for Classification Task (ICASSP)

An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem

Attention mechanism

An AI based application to identify currency and gives audio feedback.

Reformer, the efficient Transformer, in Pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

Implementation of Slot Attention from GoogleAI

Fully featured implementation of Routing Transformer

A simple but complete full-attention transformer with a set of promising experimental features from various papers

My take on a practical implementation of Linformer for Pytorch.

Word Sense Disambiguation using Word Specific models, All word models and Hierarchical models in Tensorflow

Implementation of the Point Transformer layer, in Pytorch

💻Speech and Natural Language Processing (SLP & NLP) Lab Assignments for ECE NTUA

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

🌓 Bringing pjreddie's DarkNet out of the shadows #yolo

a collection of visualization function

Deep Learning Computer Vision Algorithms for Real-World Use

An easy to use C# deep learning library with CUDA/OpenCL support

Towards Building an Intelligent Anti-Malware System: A Deep Learning Approach using Support Vector Machine for Malware Classification

SimpleDNN is a machine learning lightweight open-source library written in Kotlin designed to support relevant neural network architectures in natural language processing tasks

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Improved Residual Networks (https://arxiv.org/pdf/2004.04989.pdf)

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

Deep learning codes and projects using Python

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Transfer Learning Suite in Keras. Perform transfer learning using any built-in Keras image classification model easily!

Transformer based on a variant of attention that is linear complexity in respect to sequence length

Predict materials properties using only the composition information!

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Deep-learning model presented in "DataStories at SemEval-2017 Task 6: Siamese LSTM with Attention for Humorous Text Comparison".

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

Deep-learning models of NTUA-SLP team submitted in SemEval 2018 tasks 1, 2 and 3.

一些不同的Attention机制代码

[AAAI 2020] Modeling Personality with Attentive Networks and Contextual Embeddings

Pointer-generator reinforced seq2seq summarization in PyTorch

To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

Efficient Learning of Augmentation Policy Schedules

Residual Attention Network for Image Classification

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

A Structured Self-attentive Sentence Embedding

High-performance Vision library in Python. Scale your research, not boilerplate.

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)

Train and visualize Hierarchical Attention Networks

采用深度学习方法进行刀具识别。

End-to-end ASR/LM implementation with PyTorch

A convolutional neural network implementation of a script that detects whether an individual is wearing a hardhat or not.

Best Practices, code samples, and documentation for Computer Vision.