384 Open source projects that are alternatives of or similar to Transformer

Molecular optimization by capturing chemist’s intuition using the Seq2Seq with attention and the Transformer

HAL+JSON & HAL+XML API transformer outputting valid (PSR-7) API Responses.

Mutate Laravel attributes

Zero administration inference with AWS Lambda for 🤗

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

Implementation of the GBST block from the Charformer paper, in Pytorch

Neutron: A pytorch based implementation of Transformer and its variants.

npm-svgs2fonts。svg图标转字体图标库（svgs -> svg,ttf,eot,woff,woff2），nodejs。

Embedding模型代码和学习笔记总结

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

Korean speech recognition based on transformer (트랜스포머 기반 한국어 음성 인식)

RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words (CVPR 2021)

A PyTorch-based model pruning toolkit for pre-trained language models

Code for the AAAI 2022 publication "Well-classified Examples are Underestimated in Classification with Deep Neural Networks"

A dockerized flask API, serving ALBERT and BERT predictions using TensorFlow 2.0.

[ICCV2021] Official PyTorch implementation of Segmenter: Transformer for Semantic Segmentation

text generation based on transformer

Using LSTM or Transformer to solve Image Captioning in Pytorch

An easy way to create and layout UI components for iOS (Swift version).

End-to-end Temporal Action Detection with Transformer. [Under review for a journal publication]

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

This library provides a set of basic functions for different type of deep learning (and other) algorithms in C.This deep learning library will be constantly updated

Unofficial implementation of "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" (https://arxiv.org/abs/2103.14030)

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Implementation, trained models and result data for the paper "Pairwise Multi-Class Document Classification for Semantic Relations between Wikipedia Articles"

Summary of Transformer applications for computer vision tasks.

Trained T5 and T5-large model for creating keywords from text

One Person, One Model, One World: Learning Continual User Representation without Forgetting

"SOLQ: Segmenting Objects by Learning Queries", SOLQ is an end-to-end instance segmentation framework with Transformer.

Fine-grained Sentiment Analysis of User Reviews --- AI CHALLENGER 2018

A python library that makes AMR parsing, generation and visualization simple.

End-to-end pipeline with TFX to train and deploy a BERT model for sentiment analysis.

Unofficial implementation of MaX-DeepLab for Instance Segmentation

"Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions", ACM Multimedia 2020

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

The official PyTorch implementation of recent paper - SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training

PyTorch v1.2에서 생긴 Transformer API 를 이용한 간단한 Chitchat 챗봇

resources for the IBM Airlines Table-Question-Answering Benchmark

Tutel MoE: An Optimized Mixture-of-Experts Implementation

Implementation of Linformer for Pytorch

An elegant way to deal with attributed string in swift.

Implementation of Transformer model (originally from Attention is All You Need) applied to Time Series.

Code base for M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers

Personalizing Dialogue Agents via Meta-Learning

Transfromer tensorflow2.0版本实现

Implementation of Uformer, Attention-based Unet, in Pytorch

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

From Random Walks to Transformer for Learning Node Embeddings (ECML-PKDD 2020) (In Pytorch and Tensorflow)

allRank is a framework for training learning-to-rank neural models based on PyTorch.

Contextualised Embeddings and Language Modelling using BERT and Friends using R

a simple and complete pytorch implementation of neural machine translation system

Codes for TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization.

SwinIR: Image Restoration Using Swin Transformer (official repository)

Laravel5 JSONAPI and Dingo together to build APIs fast

Transformer implemented in Keras

本项目是作者们根据个人面试和经验总结出的自然语言处理(NLP)面试准备的学习笔记与资料，该资料目前包含 自然语言处理各领域的 面试题积累。

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Code for the paper "Are Sixteen Heads Really Better than One?"