371 Open source projects that are alternatives of or similar to transformer

Transformer implementation speciaized in speech recognition tasks using Pytorch.

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

Neural Machine Translation with Keras

A PyTorch Implementation of "Attention Is All You Need"

Data Augmentation by Backtranslation (DAB) ヽ( •_-)ᕗ

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

Witwicky: An implementation of Transformer in PyTorch.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

Neutron: A pytorch based implementation of Transformer and its variants.

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

list of efficient attention modules

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Transformers without Tears: Improving the Normalization of Self-Attention

pytorch implementation of Attention is all you need

Java 字节操作的工具库(不是字节码的工具库)

A more handy way to use SPARQL data in your web app

Code for the paper "MASTER: Multi-Aspect Non-local Network for Scene Text Recognition" (Pattern Recognition 2021)

LONG-TERM SERIES FORECASTING WITH QUERYSELECTOR – EFFICIENT MODEL OF SPARSEATTENTION

A middleware to switch fractal serializers in dingo

This repo provides the official code for : 1) TransBTS: Multimodal Brain Tumor Segmentation Using Transformer (https://arxiv.org/abs/2103.04430) , accepted by MICCAI2021. 2) TransBTSV2: Towards Better and More Efficient Volumetric Segmentation of Medical Images(https://arxiv.org/abs/2201.12785).

Dense video captioning in PyTorch

Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

A curated list of resources for Low-level Vision Tasks

Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"

Codes to pre-train Japanese T5 models

Text Simplification Model based on Encoder-Decoder (includes Transformer and Seq2Seq) model.

TianChi AIEarth Contest Solution

SImple SenTence EmbeddeR

A Robustly Optimized BERT Pretraining Approach for Vietnamese

Code & Data for "Tabular Transformers for Modeling Multivariate Time Series" (ICASSP, 2021)

(CVPRW 2022) Learning Co-segmentation by Segment Swapping for Retrieval and Discovery

Code for the CHAMPS Predicting Molecular Properties Kaggle competition

Code for Synchronous Bidirectional Neural Machine Translation (SB-NMT)

Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.

Sequence to Sequence Models in PyTorch

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

A curated list of awesome resources combining Transformers with Neural Architecture Search

Build English-Vietnamese machine translation with ProtonX Transformer. :D

Multi heads attention for image classification

Image Captioning Using Transformer

PyTorch implementation of a collections of scalable Video Transformer Benchmarks.

Zero-Shot Cross-Lingual Abstractive Sentence Summarization through Teaching Generation and Attention

Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf

Codes and Datasets for paper RecSys'20 "SSE-PT: Sequential Recommendation Via Personalized Transformer" and NurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"

Leetcode using AI

[MICCAI2022] This is an official PyTorch implementation for A Robust Volumetric Transformer for Accurate 3D Tumor Segmentation

PyTorch implementation of some learning rate schedulers for deep learning researcher.

Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).

Serialize PHP variables, including objects, in any format. Support to unserialize it too.

PyTorch solution of named entity recognition task Using Google AI's pre-trained BERT model.

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Generate images from texts. In Russian

Repository for Project Insight: NLP as a Service

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

A PyTorch implementation of the Transformer model from "Attention Is All You Need".