893 Open source projects that are alternatives of or similar to Transformer-in-Transformer

A collection of SOTA Image Classification Models in PyTorch

Implementation of Linformer for Pytorch

Fully featured implementation of Routing Transformer

resources for the IBM Airlines Table-Question-Answering Benchmark

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Implementation of Bottleneck Transformer in Pytorch

Transformer based on a variant of attention that is linear complexity in respect to sequence length

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

Code for the AAAI 2022 publication "Well-classified Examples are Underestimated in Classification with Deep Neural Networks"

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Implementation of E(n)-Transformer, which extends the ideas of Welling's E(n)-Equivariant Graph Neural Network to attention

a simple and complete pytorch implementation of neural machine translation system

Predict materials properties using only the composition information!

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Exploring attention weights in transformer-based models with linguistic knowledge.

🎨 🎨NLP 自然语言处理教程 🎨🎨 https://dataxujing.github.io/NLP-paper/

Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

End-to-end ASR/LM implementation with PyTorch

Neural Machine Translation with Keras

An Implementation of 'Attention is all you need' with Chinese Corpus

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

A TensorFlow Implementation of the Transformer: Attention Is All You Need

TianChi AIEarth Contest Solution

a collection of visualization function

Using LSTM or Transformer to solve Image Captioning in Pytorch

Image classification of wildflowers using deep residual learning and convolutional neural nets

Notebooks for Fastai Viusal Guide

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

End-to-end Temporal Action Detection with Transformer. [Under review for a journal publication]

Contextualised Embeddings and Language Modelling using BERT and Friends using R

Implementation of Nyström Self-attention, from the paper Nyströmformer

Transfromer tensorflow2.0版本实现

Codes for TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization.

RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words (CVPR 2021)

Neutron: A pytorch based implementation of Transformer and its variants.

A PyTorch toolkit with 8 popular deep active learning query methods implemented.

Embedding模型代码和学习笔记总结

Trained T5 and T5-large model for creating keywords from text

[ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering

This repo contains projects created using TensorFlow-Lite on Raspberry Pi and Teachable Machine. AI and ML capabilities have been integrated with Robot's software.

Streaming, transforming, SPARQL-based CSV to RDF converter. Apache license.

💻Speech and Natural Language Processing (SLP & NLP) Lab Assignments for ECE NTUA

HAL+JSON & HAL+XML API transformer outputting valid (PSR-7) API Responses.

[TPAMI 2020] Parallax Attention for Unsupervised Stereo Correspondence Learning

Python REST API to detect images with adult content

Deep Learning Transformer models in MATLAB

Food classification using deep learning

Text style transfer benchmark