152 Open source projects that are alternatives of or similar to Xlnet_zh

XLNet for generating language.

Language Model that makes you Laugh .

A Dutch RoBERTa-based language model

Empower Sequence Labeling with Task-Aware Language Model

结合python一起学习自然语言处理 (nlp): 语言模型、HMM、PCFG、Word2vec、完形填空式阅读理解任务、朴素贝叶斯分类器、TFIDF、PCA、SVD

基于Pytorch和torchtext的自然语言处理深度学习框架。

package lingo provides the data structures and algorithms required for natural language processing

📖 Some language modeling tools for Keras

[EMNLP 2020] Text Classification Using Label Names Only: A Language Model Self-Training Approach

Korean BERT pre-trained cased (KoBERT)

Natural language detection package in pure Go

Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger

Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019

A Lite Bert For Self-Supervised Learning Language Representations

A Dead Simple BERT API for Python and Java (https://github.com/google-research/bert)

NLP Paper

Language Modeling

Google AI 2018 BERT pytorch implementation

PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset

Connectionist Temporal Classification (CTC) decoder with dictionary and language model for TensorFlow.

a sklearn wrapper for Google's BERT model

Seq2seq chatbot with attention and anti-language model to suppress generic response, option for further improve by deep reinforcement learning.

A C++ library providing fast language model queries in compressed space.

End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service

An opensource speech-to-text software written in tensorflow

An implementation of model parallel GPT-3-like models on GPUs, based on the DeepSpeed library. Designed to be able to train models in the hundreds of billions of parameters or larger.

Quantize weights and activations in Recurrent Neural Networks.

NLP library designed for reproducible experimentation management

Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.

BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).

Get protein embeddings from protein sequences

The source code of "Language Models are Few-shot Multilingual Learners" (MRL @ EMNLP 2021)

A curated list of pretrained sentence and word embedding models

🐍 Python library for n-gram models in ARPA format

Pytorch library for end-to-end transformer models training, inference and serving

Code accompanying EMNLP 2018 paper Language Modeling with Sparse Product of Sememe Experts

Optimus: the first large-scale pre-trained VAE language model

Tensorflow with KenLM integrated for beam search scoring

Cross-domain NER using cross-domain language modeling, code for ACL 2019 paper

MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems

Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

Code for CodeT5: a new code-aware pre-trained encoder-decoder model.

PyTorch Implementation of OpenAI GPT-2

Next Word Prediction using n-gram Probabilistic Model with various Smoothing Techniques

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch. Based on code of https://github.com/karpathy/char-rnn. Support Chinese and other things.

Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

PhoNLP: A BERT-based multi-task learning toolkit for part-of-speech tagging, named entity recognition and dependency parsing (NAACL 2021)

Build a Movie Reviews Sentiment Classifier with Google's BERT Language Model

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

Curated list of all NLP Resources

Language model finetuning on NER with an easy interface, and cross-domain evaluation. We released NER models finetuned on various domain via huggingface model hub.

Useful resources for Mongolian NLP

An implementation of model parallel GPT2& GPT3-like models, with the ability to scale up to full GPT3 sizes (and possibly more!), using the mesh-tensorflow library.

A library & tools to evaluate predictive language models.

The Noise Contrastive Estimation for softmax output written in Pytorch

Lingvo

🎧 Automatic Speech Recognition: DeepSpeech & Seq2Seq (TensorFlow)

BERT-based Multilingual Model for Indian Languages

Character-based word embeddings model based on RNN for handling real world texts

C++ Implementation of PyTorch Tutorials for Everyone