673 Open source projects that are alternatives of or similar to h-transformer-1d

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

End-to-end ASR/LM implementation with PyTorch

Predict materials properties using only the composition information!

a collection of visualization function

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Summary of Transformer applications for computer vision tasks.

Implementation of Linformer for Pytorch

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

list of efficient attention modules

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Official and maintained implementation of the paper Attention-Based Transformers for Instance Segmentation of Cells in Microstructures [BIBM 2020].

A PyTorch Implementation of "Attention Is All You Need"

NLP: Relation extraction with position-aware self-attention transformer

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Implementation of State-of-the-art Text Classification Models in Pytorch

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.

Multi-turn dialogue baselines written in PyTorch

[ICCV 2021] TRAR: Routing the Attention Spans in Transformers for Visual Question Answering -- Official Implementation

Fully featured implementation of Routing Transformer

BertQA - Attention on Steroids

Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"

Julia Implementation of Transformer models

Exploring attention weights in transformer-based models with linguistic knowledge.

🎨 🎨NLP 自然语言处理教程 🎨🎨 https://dataxujing.github.io/NLP-paper/

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Using LSTM or Transformer to solve Image Captioning in Pytorch

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

a simple and complete pytorch implementation of neural machine translation system

nlp lecture-notes and source code

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

Transformer implemented in Keras

Fine-grained Sentiment Analysis of User Reviews --- AI CHALLENGER 2018

Attention-based bidirectional LSTM for Classification Task (ICASSP)

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

Neural Machine Translation with Keras

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

Natural Language Processing Tutorial for Deep Learning Researchers

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

An Implementation of 'Attention is all you need' with Chinese Corpus

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

2018-JDDC大赛第4名的解决方案

An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem

Sequence to Sequence Models in PyTorch

Transformer based on a variant of attention that is linear complexity in respect to sequence length

Train and visualize Hierarchical Attention Networks

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

TianChi AIEarth Contest Solution

Implementation of E(n)-Transformer, which extends the ideas of Welling's E(n)-Equivariant Graph Neural Network to attention