1135 Open source projects that are alternatives of or similar to Routing Transformer

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Transformer based on a variant of attention that is linear complexity in respect to sequence length

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

A simple but complete full-attention transformer with a set of promising experimental features from various papers

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

a collection of visualization function

Exploring attention weights in transformer-based models with linguistic knowledge.

Using LSTM or Transformer to solve Image Captioning in Pytorch

a simple and complete pytorch implementation of neural machine translation system

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

Implementation of the convolutional module from the Conformer paper, for use in Transformers

Implementation of the Point Transformer layer, in Pytorch

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Predict materials properties using only the composition information!

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

My take on a practical implementation of Linformer for Pytorch.

A TensorFlow Implementation of the Transformer: Attention Is All You Need

End-to-end ASR/LM implementation with PyTorch

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

An implementation of Performer, a linear attention-based transformer, in Pytorch

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

SimpleDNN is a machine learning lightweight open-source library written in Kotlin designed to support relevant neural network architectures in natural language processing tasks

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

Reformer, the efficient Transformer, in Pytorch

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

Implementation of Slot Attention from GoogleAI

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Implementation of E(n)-Transformer, which extends the ideas of Welling's E(n)-Equivariant Graph Neural Network to attention

TianChi AIEarth Contest Solution

🎨 🎨NLP 自然语言处理教程 🎨🎨 https://dataxujing.github.io/NLP-paper/

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

Neural Machine Translation with Keras

To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Implementation of Bottleneck Transformer in Pytorch

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

Implementation of Linformer for Pytorch

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

An Implementation of 'Attention is all you need' with Chinese Corpus

NLP research：基于tensorflow的nlp深度学习项目，支持文本分类/句子匹配/序列标注/文本生成 四大任务

Board game AI implementations using Monte Carlo Tree Search

Jetbrains IDEs client for TabNine. Compatible with all IntelliJ-based IDEs. https://plugins.jetbrains.com/plugin/12798-tabnine

🔓 🔑 🔐 Origami: Artificial Intelligence as a Service

集成了Tensorflow 2版本的端到端语音识别模型，并且RTF(实时率)在0.1左右/Mandarin State-of-the-art Automatic Speech Recognition in Tensorflow 2

A simple machine learning framework written in Swift 🤖

Data augmentation for NLP

Flappy Bird AI using Evolution Strategies

An independent implementation of DeepMind's AlphaGoZero in Scala, using Deeplearning4J (DL4J)

CNN image classifier implemented in Keras Notebook 🖼️.