Top 153 language-model open source projects

Electra pre-trained model using Vietnamese corpus

Language model finetuning on NER with an easy interface, and cross-domain evaluation. We released NER models finetuned on various domain via huggingface model hub.

Top-k Approximate String Matching.

A library & tools to evaluate predictive language models.

GPT-2 French demo | Démo française de GPT-2

curated collection of papers for the nlp practitioner 📖👩‍🔬

C++ Implementation of PyTorch Tutorials for Everyone

Boilerplate code for quickly getting set up to run language modeling experiments

Self-contained Machine Learning and Natural Language Processing library in Go

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

Language Model that makes you Laugh .

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

Empower Sequence Labeling with Task-Aware Language Model

A Python wrapper for Kaldi

基于Pytorch和torchtext的自然语言处理深度学习框架。

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

📖 Some language modeling tools for Keras

My Reading Lists of Deep Learning and Natural Language Processing

Korean BERT pre-trained cased (KoBERT)

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger

The implementation of DeBERTa

A Lite Bert For Self-Supervised Learning Language Representations

Connectionist Temporal Classification (CTC) decoding algorithms: best path, prefix search, beam search and token passing. Implemented in Python.

NLP Paper

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Google AI 2018 BERT pytorch implementation

End-to-end ASR/LM implementation with PyTorch

Connectionist Temporal Classification (CTC) decoder with dictionary and language model for TensorFlow.

Open tools and data for cloudless automatic speech recognition

Seq2seq chatbot with attention and anti-language model to suppress generic response, option for further improve by deep reinforcement learning.

Korean GPT-2 pretrained cased (KoGPT2)

End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

An implementation of model parallel GPT-3-like models on GPUs, based on the DeepSpeed library. Designed to be able to train models in the hundreds of billions of parameters or larger.

An implementation of Google Brain's 2019 XLNet in PyTorch

NLP library designed for reproducible experimentation management

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).

Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling

The source code of "Language Models are Few-shot Multilingual Learners" (MRL @ EMNLP 2021)

State of the art Chinese Word Segmentation with Bi-LSTMs

🐍 Python library for n-gram models in ARPA format

Data Augmentation for Neural Machine Translation

Code accompanying EMNLP 2018 paper Language Modeling with Sparse Product of Sememe Experts

Utility for analyzing Transformer based representations of language.

Tensorflow with KenLM integrated for beam search scoring

Streaming based VHDL parser.

MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems

Implementation for "Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling"

Code for CodeT5: a new code-aware pre-trained encoder-decoder model.

A GPT-J API to use with python3 to generate text, blogs, code, and more

Next Word Prediction using n-gram Probabilistic Model with various Smoothing Techniques

Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

Jupyter notebooks for Chainer hands-on

Build a Movie Reviews Sentiment Classifier with Google's BERT Language Model

ICML'2022: Black-Box Tuning for Language-Model-as-a-Service

Curated list of all NLP Resources