361 Open source projects that are alternatives of or similar to The Story Of Heads

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

(CVPRW 2022) Learning Co-segmentation by Segment Swapping for Retrieval and Discovery

[ACL 19] Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction

Code for Synchronous Bidirectional Neural Machine Translation (SB-NMT)

Implementation, trained models and result data for the paper "Pairwise Multi-Class Document Classification for Semantic Relations between Wikipedia Articles"

Sequence to Sequence Models in PyTorch

list of efficient attention modules

Build English-Vietnamese machine translation with ProtonX Transformer. :D

Code for the paper "Are Sixteen Heads Really Better than One?"

Codes and Datasets for paper RecSys'20 "SSE-PT: Sequential Recommendation Via Personalized Transformer" and NurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"

An Implementation of 'Attention is all you need' with Chinese Corpus

PyTorch implementation of some learning rate schedulers for deep learning researcher.

Korean speech recognition based on transformer (트랜스포머 기반 한국어 음성 인식)

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

Zero administration inference with AWS Lambda for 🤗

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

Large-scale pretraining for dialogue

Easy to use NLP library built on PyTorch and TorchText

Code for the AAAI 2022 publication "Well-classified Examples are Underestimated in Classification with Deep Neural Networks"

Meshed-Memory Transformer for Image Captioning. CVPR 2020

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Molecular optimization by capturing chemist’s intuition using the Seq2Seq with attention and the Transformer

The efficient and elegant JSON:API 1.1 server library for PHP

reference tensorflow code for named entity tagging

[ACL 2020] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

[ICCV2021] Official PyTorch implementation of Segmenter: Transformer for Semantic Segmentation

Transformer based on a variant of attention that is linear complexity in respect to sequence length

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!

Lumen 8 基础上扩展出的API 启动项目，精心设计的目录结构，规范统一的响应数据格式，Repository 模式架构的最佳实践。

Neutron: A pytorch based implementation of Transformer and its variants.

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

Presento - Transformer & Presenter Package for PHP

Transformer for Graph Classification (Pytorch and Tensorflow)

Using LSTM or Transformer to solve Image Captioning in Pytorch

Transformer-based image captioning extension for pytorch/fairseq

an open-source implementation of sequence-to-sequence based speech processing engine

텐서플로우와 머신러닝으로 시작하는 자연어처리(로지스틱회귀부터 트랜스포머 챗봇까지)

Code base for M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers

End-to-End Automatic Speech Recognition on PyTorch

A tool that can transform CommonJS to ESM

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

Transfromer tensorflow2.0版本实现

Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"

Simple transformer implementation from scratch in pytorch.

Fully featured implementation of Routing Transformer

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

Transformer implementation in PyTorch.

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

From Random Walks to Transformer for Learning Node Embeddings (ECML-PKDD 2020) (In Pytorch and Tensorflow)

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

NLP research：基于tensorflow的nlp深度学习项目，支持文本分类/句子匹配/序列标注/文本生成 四大任务

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

CV backbones including GhostNet, TinyNet and TNT, developed by Huawei Noah's Ark Lab.

使用基于Transformer的预训练模型在ACE2005数据集上进行事件抽取任务

中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

viewpager with parallax pages, together with vertical sliding (or click) and activity transition

Русскоязычный чат-бот для Discord на архитектуре Transformer