368 Open source projects that are alternatives of or similar to t5-japanese

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Trained T5 and T5-large model for creating keywords from text

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

PostHTML is a tool to transform HTML/XML with JS plugins

OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0

pytorch implementation of Attention is all you need

Repository for Project Insight: NLP as a Service

Understanding the Difficulty of Training Transformers

A curated list of awesome resources combining Transformers with Neural Architecture Search

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

transformer, multi-graph transformer, graph, graph classification, sketch recognition, sketch classification, free-hand sketch, official code of the paper "Multi-Graph Transformer for Free-Hand Sketch Recognition"

集成了Tensorflow 2版本的端到端语音识别模型，并且RTF(实时率)在0.1左右/Mandarin State-of-the-art Automatic Speech Recognition in Tensorflow 2

Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"

PyTorch solution of named entity recognition task Using Google AI's pre-trained BERT model.

A collaborative collection of open-source safe GPT-3 prompts that work well

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

Sentiment analysis neural network trained by fine-tuning BERT, ALBERT, or DistilBERT on the Stanford Sentiment Treebank.

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

Julia Implementation of Transformer models

Dense video captioning in PyTorch

Running BERT without Padding

2018-JDDC大赛第4名的解决方案

Transformers for Longer Sequences

Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

NLP Core Library and Model Zoo based on PaddlePaddle 2.0

NLP research：基于tensorflow的nlp深度学习项目，支持文本分类/句子匹配/序列标注/文本生成 四大任务

[ACL 2020] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

PyTorch implementation of some learning rate schedulers for deep learning researcher.

Transformer based on a variant of attention that is linear complexity in respect to sequence length

Code for Synchronous Bidirectional Neural Machine Translation (SB-NMT)

Lumen 8 基础上扩展出的API 启动项目，精心设计的目录结构，规范统一的响应数据格式，Repository 模式架构的最佳实践。

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

A Robustly Optimized BERT Pretraining Approach for Vietnamese

Transformer for Graph Classification (Pytorch and Tensorflow)

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

Transformer-based image captioning extension for pytorch/fairseq

Sequence to Sequence Models in PyTorch

텐서플로우와 머신러닝으로 시작하는 자연어처리(로지스틱회귀부터 트랜스포머 챗봇까지)

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

End-to-End Automatic Speech Recognition on PyTorch

TianChi AIEarth Contest Solution

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

Easy to use NLP library built on PyTorch and TorchText

Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"

Build English-Vietnamese machine translation with ProtonX Transformer. :D

Fully featured implementation of Routing Transformer

Meshed-Memory Transformer for Image Captioning. CVPR 2020

Transformer implementation in PyTorch.

(CVPRW 2022) Learning Co-segmentation by Segment Swapping for Retrieval and Discovery

This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the paper "Analyzing Source and Target Contributions to NMT Predictions".

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

Codes and Datasets for paper RecSys'20 "SSE-PT: Sequential Recommendation Via Personalized Transformer" and NurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"

An Implementation of 'Attention is all you need' with Chinese Corpus

The efficient and elegant JSON:API 1.1 server library for PHP

Code for the paper "MASTER: Multi-Aspect Non-local Network for Scene Text Recognition" (Pattern Recognition 2021)

LONG-TERM SERIES FORECASTING WITH QUERYSELECTOR – EFFICIENT MODEL OF SPARSEATTENTION

Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)