1135 Open source projects that are alternatives of or similar to Linear Attention Transformer

Fully featured implementation of Routing Transformer

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Implementation of the Point Transformer layer, in Pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

TianChi AIEarth Contest Solution

Using LSTM or Transformer to solve Image Captioning in Pytorch

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

Reformer, the efficient Transformer, in Pytorch

Implementation of the convolutional module from the Conformer paper, for use in Transformers

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

A simple but complete full-attention transformer with a set of promising experimental features from various papers

a collection of visualization function

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Implementation of Linformer for Pytorch

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

SimpleDNN is a machine learning lightweight open-source library written in Kotlin designed to support relevant neural network architectures in natural language processing tasks

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

A TensorFlow Implementation of the Transformer: Attention Is All You Need

An Implementation of 'Attention is all you need' with Chinese Corpus

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

My take on a practical implementation of Linformer for Pytorch.

Implementation of Slot Attention from GoogleAI

Implementation of E(n)-Transformer, which extends the ideas of Welling's E(n)-Equivariant Graph Neural Network to attention

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

Exploring attention weights in transformer-based models with linguistic knowledge.

🎨 🎨NLP 自然语言处理教程 🎨🎨 https://dataxujing.github.io/NLP-paper/

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Predict materials properties using only the composition information!

a simple and complete pytorch implementation of neural machine translation system

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Implementation of Bottleneck Transformer in Pytorch

Neural Machine Translation with Keras

End-to-end ASR/LM implementation with PyTorch

To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

Lumen 8 基础上扩展出的API 启动项目，精心设计的目录结构，规范统一的响应数据格式，Repository 模式架构的最佳实践。

Transformer for Graph Classification (Pytorch and Tensorflow)

Sentiment analysis neural network trained by fine-tuning BERT, ALBERT, or DistilBERT on the Stanford Sentiment Treebank.

Library for Semi-Automated Data Science

🔮 A refreshing functional take on deep learning, compatible with your favorite libraries

Enhance your WordPress content with Artificial Intelligence and Machine Learning services.

a list of demo websites for automatic music generation research

A multi-object tracking component. Works in the conditions where identification and classical object trackers don't (e.g. shaky/unstable camera footage, occlusions, motion blur, covered faces, etc.). Works on any object despite their nature.

Resources for the study group in IIT Guwahati focused on learning Artificial Intelligence.