1536 Open source projects that are alternatives of or similar to Self Attention Cv

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

Predict materials properties using only the composition information!

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Fully featured implementation of Routing Transformer

a collection of visualization function

Transformer based on a variant of attention that is linear complexity in respect to sequence length

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

End-to-end ASR/LM implementation with PyTorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

Official and maintained implementation of the paper Attention-Based Transformers for Instance Segmentation of Cells in Microstructures [BIBM 2020].

Lets Learn AI

Succinct Machine Learning algorithm implementations from scratch in Python, solving real-world problems (Notebooks and Book). Examples of Logistic Regression, Linear Regression, Decision Trees, K-means clustering, Sentiment Analysis, Recommender Systems, Neural Networks and Reinforcement Learning.

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

PHP-ML - Machine Learning library for PHP

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

Implementation of the Point Transformer layer, in Pytorch

A Tensorfflow implementation of Attend, Infer, Repeat

Highly cited and useful papers related to machine learning, deep learning, AI, game theory, reinforcement learning

Multi-turn dialogue baselines written in PyTorch

This is the Repository where you can find all the solution of the Problems which you solve on competitive platforms mainly HackerRank and HackerEarth

An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

A simple but complete full-attention transformer with a set of promising experimental features from various papers

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Daily Dose of Neural Network that Everyone Needs

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

Deep-Learning based CTR models implemented by PyTorch

A simple machine learning framework written in Swift 🤖

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

💬 Machine Learning Course with Python:

SimpleDNN is a machine learning lightweight open-source library written in Kotlin designed to support relevant neural network architectures in natural language processing tasks

Natural Language Processing Tutorial for Deep Learning Researchers

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

Reformer, the efficient Transformer, in Pytorch

Implementation of the convolutional module from the Conformer paper, for use in Transformers

Notes, examples, and Python demos for the textbook "Machine Learning Refined" (published by Cambridge University Press).

Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"

A neural network to generate captions for an image using CNN and RNN with BEAM Search.

Keras Implementation of Aspect based Sentiment Analysis

Here you can get all the Quantum Machine learning Basics, Algorithms ,Study Materials ,Projects and the descriptions of the projects around the web

An Implementation of 'Attention is all you need' with Chinese Corpus

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

The Cutest Deep Learning Framework which is also a wonderful Declarative Language

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

Implementation of Slot Attention from GoogleAI

🤖 NanoNeuron is 7 simple JavaScript functions that will give you a feeling of how machines can actually "learn"

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

最全的中文版深度学习资源索引，包括论文，慕课，开源框架，数据集等等

Attention-based multimodal fusion for sentiment analysis

Julia Implementation of Transformer models

Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)

Log Anomaly Detection - Machine learning to detect abnormal events logs

Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".

🚀 FREE AI Resources - 🎓 Courses, 👷 Jobs, 📝 Blogs, 🔬 AI Research, and many more - for everyone!

Train and visualize Hierarchical Attention Networks