553 Open source projects that are alternatives of or similar to linformer

End-to-end ASR/LM implementation with PyTorch

a simple and complete pytorch implementation of neural machine translation system

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

Using LSTM or Transformer to solve Image Captioning in Pytorch

Transformer based on a variant of attention that is linear complexity in respect to sequence length

TianChi AIEarth Contest Solution

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Fully featured implementation of Routing Transformer

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

Neural Machine Translation with Keras

Implementation of E(n)-Transformer, which extends the ideas of Welling's E(n)-Equivariant Graph Neural Network to attention

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

🎨 🎨NLP 自然语言处理教程 🎨🎨 https://dataxujing.github.io/NLP-paper/

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

An Implementation of 'Attention is all you need' with Chinese Corpus

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Predict materials properties using only the composition information!

A TensorFlow Implementation of the Transformer: Attention Is All You Need

a collection of visualization function

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Exploring attention weights in transformer-based models with linguistic knowledge.

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

PyTorch v1.2에서 생긴 Transformer API 를 이용한 간단한 Chitchat 챗봇

Pytorch implementation of "Dynamic Coattention Networks For Question Answering"

Neutron: A pytorch based implementation of Transformer and its variants.

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

Summary of Transformer applications for computer vision tasks.

Tutel MoE: An Optimized Mixture-of-Experts Implementation

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

Korean speech recognition based on transformer (트랜스포머 기반 한국어 음성 인식)

HAL+JSON & HAL+XML API transformer outputting valid (PSR-7) API Responses.

Code base for M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers

Mutate Laravel attributes

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

🔖 An Attention Layer in Keras

Fast Differentiable Forest lib with the advantages of both decision trees and neural networks

End-to-end Temporal Action Detection with Transformer. [Under review for a journal publication]

"SOLQ: Segmenting Objects by Learning Queries", SOLQ is an end-to-end instance segmentation framework with Transformer.

Transfromer tensorflow2.0版本实现

Embedding模型代码和学习笔记总结

Attention-Based Guided Structured Sparsity of Deep Neural Networks

Zero administration inference with AWS Lambda for 🤗

[TPAMI 2020] Parallax Attention for Unsupervised Stereo Correspondence Learning

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

A python library that makes AMR parsing, generation and visualization simple.

This library provides a set of basic functions for different type of deep learning (and other) algorithms in C.This deep learning library will be constantly updated

Applied Deep Learning (2019 Spring) @ NTU

Using Residual Attention Networks to diagnose retinal diseases in medical images

🎬 Video Captioning: ICCV '15 paper implementation

PyTorch Implementation of "Monotonic Chunkwise Attention" (ICLR 2018)

attention mechanism in keras, like Dense and RNN...

From Random Walks to Transformer for Learning Node Embeddings (ECML-PKDD 2020) (In Pytorch and Tensorflow)