152 Open source projects that are alternatives of or similar to Xlnet_zh

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.

language model in Chinese，基于Pytorch官方文档实现

Implementation of XLNet that can load pretrained checkpoints

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

NEZHA: Neural Contextualized Representation for Chinese Language Understanding

Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling

Implementation of Dynamic memory networks plus in Pytorch

Top-k Approximate String Matching.

Library to scrape and clean web pages to create massive datasets.

Load GPT-2 checkpoint and generate texts

bert as language model, fork from https://github.com/google-research/bert

Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP

Transformer language model (GPT-2) with sentencepiece tokenizer

TensorFlow GAN implementation using Gumbel Softmax

A collaborative collection of open-source safe GPT-3 prompts that work well

A Greek edition of BERT pre-trained language model

LSTM and QRNN Language Model Toolkit for PyTorch

Indonesian Language Models and its Usage

Revisiting Pre-trained Models for Chinese Natural Language Processing (Findings of EMNLP)

Electra pre-trained model using Vietnamese corpus

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

🔥 Korean GPT-2, KoGPT2 FineTuning cased. 한국어 가사 데이터 학습 🔥

A library & tools to evaluate predictive language models.

XLNet for generating language.

A Dutch RoBERTa-based language model

结合python一起学习自然语言处理 (nlp): 语言模型、HMM、PCFG、Word2vec、完形填空式阅读理解任务、朴素贝叶斯分类器、TFIDF、PCA、SVD

package lingo provides the data structures and algorithms required for natural language processing

[EMNLP 2020] Text Classification Using Label Names Only: A Language Model Self-Training Approach

Natural language detection package in pure Go

Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019

A Dead Simple BERT API for Python and Java (https://github.com/google-research/bert)

Language Modeling

PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset

a sklearn wrapper for Google's BERT model

A C++ library providing fast language model queries in compressed space.

An opensource speech-to-text software written in tensorflow

Quantize weights and activations in Recurrent Neural Networks.

Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.

Get protein embeddings from protein sequences

A curated list of pretrained sentence and word embedding models

Pytorch library for end-to-end transformer models training, inference and serving

Optimus: the first large-scale pre-trained VAE language model

Cross-domain NER using cross-domain language modeling, code for ACL 2019 paper

Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

PyTorch Implementation of OpenAI GPT-2

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch. Based on code of https://github.com/karpathy/char-rnn. Support Chinese and other things.

PhoNLP: A BERT-based multi-task learning toolkit for part-of-speech tagging, named entity recognition and dependency parsing (NAACL 2021)

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

Language model finetuning on NER with an easy interface, and cross-domain evaluation. We released NER models finetuned on various domain via huggingface model hub.

An implementation of model parallel GPT2& GPT3-like models, with the ability to scale up to full GPT3 sizes (and possibly more!), using the mesh-tensorflow library.

中文 预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model

The Noise Contrastive Estimation for softmax output written in Pytorch

Lingvo

🎧 Automatic Speech Recognition: DeepSpeech & Seq2Seq (TensorFlow)

BERT-based Multilingual Model for Indian Languages

Character-based word embeddings model based on RNN for handling real world texts