500 Open source projects that are alternatives of or similar to Highway-Transformer

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Indonesian Language Models and its Usage

Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

Google AI 2018 BERT pytorch implementation

GPT-2 French demo | Démo française de GPT-2

PyTorch Implementation of OpenAI GPT-2

A collaborative collection of open-source safe GPT-3 prompts that work well

Electra pre-trained model using Vietnamese corpus

MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems

End-to-end ASR/LM implementation with PyTorch

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

NLP Paper

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

Experiments for automated personality detection using Language Models and psycholinguistic features on various famous personality datasets including the Essays dataset (Big-Five)

ALPR model in unconstrained scenarios for Chinese license plates

Character-aware Neural Language Model implemented by PyTorch

Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"

Dasher text entry in HTML, CSS, JavaScript, and SVG

Yet Another ETL in PHP

A more handy way to use SPARQL data in your web app

This repo provides the official code for : 1) TransBTS: Multimodal Brain Tumor Segmentation Using Transformer (https://arxiv.org/abs/2103.04430) , accepted by MICCAI2021. 2) TransBTSV2: Towards Better and More Efficient Volumetric Segmentation of Medical Images(https://arxiv.org/abs/2201.12785).

Code & Data for "Tabular Transformers for Modeling Multivariate Time Series" (ICASSP, 2021)

Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch

Zero-Shot Cross-Lingual Abstractive Sentence Summarization through Teaching Generation and Attention

Code and data form the paper BERT Got a Date: Introducing Transformers to Temporal Tagging

Jest Svelte component transformer

Variational Transformers for Diverse Response Generation

Topic clustering library built on Transformer embeddings and cosine similarity metrics.Compatible with all BERT base transformers from huggingface.

莱斯杯：全国第二届“军事智能机器阅读”挑战赛 - Rank7 解决方案

A simple TensorFlow implementation of the Transformer

Context Aware Language Models

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

SImple SenTence EmbeddeR

A simple Neural Network for sentiment analysis, embedding sentences using a Transformer network.

Code for the CHAMPS Predicting Molecular Properties Kaggle competition

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

Image Captioning Using Transformer

Basis expansion transformers in sklearn style.

Leetcode using AI

Several basic neural machine translation models implemented by PyTorch & TensorFlow

rxjava scheduler transformer tools for android

SWIG Wrapper for the SRILM toolkit

Serialize PHP variables, including objects, in any format. Support to unserialize it too.

Generate images from texts. In Russian

📃Language Model based sentences scoring library

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

[NeurIPS 2021]: Are Transformers More Robust Than CNNs? (Pytorch implementation & checkpoints)

Pytorch implementation of a basic language model using Attention in LSTM network

Implementation of the paper Video Action Transformer Network

Transformer-based Memory Networks for Knowledge Graph Embeddings (ACL 2020) (Pytorch and Tensorflow)

Pytorch implementation of Paper by Google Research - Representation Learning for Information Extraction from Form-like Documents.

GAP-text2SQL: Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training

The Tensorflow, Keras implementation of Swin-Transformer and Swin-UNET

A curated list of resources for Low-level Vision Tasks

A GPT, made only of MLPs, in Jax

Source code for our "TitleStylist" paper at ACL 2020

Text Simplification Model based on Encoder-Decoder (includes Transformer and Seq2Seq) model.