443 Open source projects that are alternatives of or similar to awesome-transformer-search

(ICCV 2021) BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search

Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"

Running BERT without Padding

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

Julia Implementation of Transformer models

NLP Core Library and Model Zoo based on PaddlePaddle 2.0

Transformers for Longer Sequences

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

A collaborative collection of open-source safe GPT-3 prompts that work well

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

A tool that can transform CommonJS to ESM

Understanding the Difficulty of Training Transformers

transformer, multi-graph transformer, graph, graph classification, sketch recognition, sketch classification, free-hand sketch, official code of the paper "Multi-Graph Transformer for Free-Hand Sketch Recognition"

OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0

Repository for Project Insight: NLP as a Service

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

[ECCV'2020] STTN: Learning Joint Spatial-Temporal Transformations for Video Inpainting

集成了Tensorflow 2版本的端到端语音识别模型，并且RTF(实时率)在0.1左右/Mandarin State-of-the-art Automatic Speech Recognition in Tensorflow 2

PyTorch implementation of some learning rate schedulers for deep learning researcher.

NLP research：基于tensorflow的nlp深度学习项目，支持文本分类/句子匹配/序列标注/文本生成 四大任务

pytorch implementation of Attention is all you need

BertQA - Attention on Steroids

PostHTML is a tool to transform HTML/XML with JS plugins

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

Build and train state-of-the-art natural language processing models using BERT

Multi-turn dialogue baselines written in PyTorch

Transformer-based image captioning extension for pytorch/fairseq

Meshed-Memory Transformer for Image Captioning. CVPR 2020

텐서플로우와 머신러닝으로 시작하는 자연어처리(로지스틱회귀부터 트랜스포머 챗봇까지)

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

End-to-End Automatic Speech Recognition on PyTorch

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

[MICCAI2022] This is an official PyTorch implementation for A Robust Volumetric Transformer for Accurate 3D Tumor Segmentation

Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"

The efficient and elegant JSON:API 1.1 server library for PHP

Fully featured implementation of Routing Transformer

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

Transformer implementation in PyTorch.

[ACL 2020] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the paper "Analyzing Source and Target Contributions to NMT Predictions".

Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

Transformer based on a variant of attention that is linear complexity in respect to sequence length

An Implementation of 'Attention is all you need' with Chinese Corpus

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

JSON API Transformer Bundle for Symfony 2 and Symfony 3

Lumen 8 基础上扩展出的API 启动项目，精心设计的目录结构，规范统一的响应数据格式，Repository 模式架构的最佳实践。

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

[InterSpeech 2020] "AutoSpeech: Neural Architecture Search for Speaker Recognition" by Shaojin Ding*, Tianlong Chen*, Xinyu Gong, Weiwei Zha, Zhangyang Wang

Code for the paper "KISS: Keeping it Simple for Scene Text Recognition"

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Easy to use NLP library built on PyTorch and TorchText

Transformation functions generator for Protocol Buffers.

Transformer for Graph Classification (Pytorch and Tensorflow)

Build English-Vietnamese machine translation with ProtonX Transformer. :D

Codes and Datasets for paper RecSys'20 "SSE-PT: Sequential Recommendation Via Personalized Transformer" and NurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"

PyTorch solution of named entity recognition task Using Google AI's pre-trained BERT model.

2018-JDDC大赛第4名的解决方案