Top bert open source projects

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

✭ 2,768

python Jupyter Notebook perl javascript CSS Makefile deep-learning pytorch tensorflow nlp deeplearning nlu quantization transformers bert dynet

Pytorch Sentiment Analysis

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

Bertviz

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

✭ 3,443

python javascript Jupyter Notebook machine-learning pytorch nlp visualization neural-network natural-language-processing transformer bert roberta gpt2

Texar

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

✭ 2,236

python deep-learning machine-learning tensorflow natural-language-processing machine-translation text-generation data-processing bert text-data dialog-systems gpt-2 texar xlnet casl-project

Keras Bert

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

✭ 2,264

python shell keras language-model bert

Kashgari

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

✭ 2,235

python shell machine-learning nlp text-classification named-entity-recognition transfer-learning seq2seq ner sequence-labeling bert nlp-framework bert-model text-labeling gpt-2

Pycorrector

pycorrector is a toolkit for text error correction. 文本纠错，Kenlm，Seq2Seq_Attention，BERT，MacBERT，ELECTRA，ERNIE，Transformer等模型实现，开箱即用。

✭ 2,857

python bert spelling-errors electra error-detection deep-learning-models kenlm error-correction pycorrector seq2seq-attention

Spark Nlp

State of the Art Natural Language Processing

Awesome Sentence Embedding

A curated list of pretrained sentence and word embedding models

✭ 1,973

python awesome awesome-list nlp unsupervised-learning language-model pretrained-models word-embeddings natural-language embedding-models bert cross-lingual wordembedding sentence-embeddings pretrained-embedding sentence-representations contextualized-representation pretrained-language-model subword-models

Clue

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

✭ 2,425

python Jupyter Notebook shell pytorch tensorflow dataset benchmark chinese language-model pretrained-models nlu corpus glue transformers albert bert roberta chineseglue

Mt Dnn

Multi-Task Deep Neural Networks for Natural Language Understanding

✭ 1,871

python shell Jupyter Notebook Dockerfile deep-learning microsoft named-entity-recognition natural-language-understanding ranking bert multi-task-learning

Awesome Bert

bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目

✭ 1,732

nlp bert google-bert xlnet

Roberta zh

RoBERTa中文预训练模型: RoBERTa for Chinese

✭ 1,953

python shell chinese bert pre-trained roberta gpt2 pre-trained-language-models

Fast Bert

Super easy library for BERT based NLP models

✭ 1,678

python Jupyter Notebook shell Dockerfile transformers fastai bert fast-bert

Haystack

🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.

Chineseglue

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

✭ 1,548

python Jupyter Notebook shell nlp datasets glue albert bert chinese-corpus language-understanding pre-trained-model

Bert As Service

Mapping a variable-length sentence to a fixed-length vector using BERT model

✭ 9,779

python HTML javascript deep-learning machine-learning tensorflow nlp natural-language-processing deep-neural-networks ai natural-language-understanding bert word-embedding sentence-encoding

Nlp Tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

✭ 9,895

Jupyter Notebook python pytorch tensorflow nlp tutorial natural-language-processing paper transformer attention bert

Nlp chinese corpus

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

✭ 6,656

nlp dataset chinese text-classification wiki news word2vec question-answering language-model corpus chinese-nlp bert chinese-corpus pretrain chinese-dataset

Chinese Bert Wwm

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

✭ 6,357

python pytorch tensorflow nlp bert rbt roberta chinese-bert bert-wwm bert-wwm-ext roberta-wwm

Tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

✭ 5,077

rust python typescript Jupyter Notebook javascript CSS nlp natural-language-processing language-model natural-language-understanding transformers gpt bert

Bert Pytorch

Google AI 2018 BERT pytorch implementation

✭ 4,642

python Makefile pytorch nlp transformer language-model bert

Ernie

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.

✭ 4,659

python C++nlp natural-language-processing bert language-understanding ernie

Bert Bilstm Crf Ner

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services

✭ 3,838

python perl named-entity-recognition ner crf bert blstm bert-bilstm-crf

Albert zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

✭ 3,500

python shell pytorch tensorflow albert bert pre-trained chinese-corpus roberta pre-trained-model xlnet

bert in a flask

A dockerized flask API, serving ALBERT and BERT predictions using TensorFlow 2.0.

✭ 32

python Makefile Dockerfile docker flask tensorflow keras transformer albert bert

FewCLUE

FewCLUE 小样本学习测评基准，中文版

✭ 251

python Jupyter Notebook shell benchmark pet chinese clue bert few-shot-learning gpt3 fewclue ptuning

T3

[EMNLP 2020] "T3: Tree-Autoencoder Constrained Adversarial Text Generation for Targeted Attack" by Boxin Wang, Hengzhi Pei, Boyuan Pan, Qian Chen, Shuohang Wang, Bo Li

✭ 25

python Jupyter Notebook tree attack autoencoder bert adversarial-attacks

SIGIR2021 Conure

One Person, One Model, One World: Learning Continual User Representation without Forgetting

PIE

Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models for Local Sequence Transduction": www.aclweb.org/anthology/D19-1435.pdf (EMNLP-IJCNLP 2019)

✭ 164

Macaulay2 python shell nlp natural-language-processing bert sequence-labeling grammatical-error-correction sequence-editing sequence-transduction post-editing bert-model bert-embeddings bert-models

CLUE pytorch

CLUE baseline pytorch CLUE的pytorch版本基线

✭ 72

python shell glue pytorch classification chinese clue albert bert roberta ernie xlnet

iamQA

中文wiki百科QA阅读理解问答系统，使用了CCKS2016数据的NER模型和CMRC2018的阅读理解模型，还有W2V词向量搜索,使用torchserve部署

✭ 46

python HTML nlp question-answering bert

TEXTOIR

TEXTOIR is a flexible toolkit for open intent detection and discovery. (ACL 2021)

✭ 31

python c C++shell cython natural-language-processing deep-neural-networks clustering artificial-intelligence bert dialogue-systems intent-discovery intent-recognition open-classification acl2021

bert-as-a-service TFX

End-to-end pipeline with TFX to train and deploy a BERT model for sentiment analysis.

✭ 32

Jupyter Notebook nlp machine-learning deep-learning tensorflow transformer bert tfx mlops bert-as-service

text-generation-transformer

text generation based on transformer

✭ 36

Jupyter Notebook text-generation transformer sequence-to-sequence bert encoder-decoder

keras-bert-ner

Keras solution of Chinese NER task using BiLSTM-CRF/BiGRU-CRF/IDCNN-CRF model with Pretrained Language Model: supporting BERT/RoBERTa/ALBERT

✭ 7

python shell crf keras ner albert bert

kwx

BERT, LDA, and TFIDF based keyword extraction in Python

policy-data-analyzer

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

KoBERT-nsmc

Naver movie review sentiment classification with KoBERT

✭ 57

python movie-reviews bert sentiment-classification kobert nsmc distilkobert

VideoBERT

Using VideoBERT to tackle video prediction

✭ 56

python pytorch bert videobert

knowledge-graph-nlp-in-action

从模型训练到部署，实战知识图谱(Knowledge Graph)&自然语言处理(NLP)。涉及 Tensorflow, Bert+Bi-LSTM+CRF,Neo4j等涵盖 Named Entity Recognition,Text Classify,Information Extraction,Relation Extraction 等任务。

✭ 58

python Jupyter Notebook nlp neo4j tensorflow crf information-extraction knowledge-graph lstm named-entity-recognition bert relation-extraction

ADL2019

Applied Deep Learning (2019 Spring) @ NTU

✭ 20

Jupyter Notebook python reinforcement-learning pytorch generative-adversarial-network gan policy-gradient image-generation ntu attention-mechanism bert adl actor-critic rnn-pytorch elmo deep-q-learning-network contextual-embeddings adl2019spring dialogue-modeling

Filipino-Text-Benchmarks

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

✭ 22

python benchmark deep-learning text-classification corpus transformer transfer-learning tagalog bert filipino electra nli low-resource-languages tagalog-transformers electra-models

HugsVision

HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision

erc

Emotion recognition in conversation

✭ 34

Jupyter Notebook python Makefile nlp deep-learning transformers pytorch bert emotion-recognition roberta huggingface

syntaxdot

Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.

✭ 32

rust python morphology pretrained-models bert dependency-parsing lemmatization biaffine-parser part-of-speech-tagging xlm-roberta sequence-labels

Mengzi

Mengzi Pretrained Models

✭ 238

nlp natural-language-processing deep-learning pytorch bert language-understanding chinese-bert

MobileQA

离线端阅读理解应用 QA for mobile, Android & iPhone

✭ 49

python java android nlp qa tensorflow iphone chinese albert bert machine-reading-comprehension tflite

semantic-document-relations

Implementation, trained models and result data for the paper "Pairwise Multi-Class Document Classification for Semantic Relations between Wikipedia Articles"

✭ 21

python Jupyter Notebook wikipedia pytorch similarity transformer document document-classification bert xlnet

bangla-bert

Bangla-Bert is a pretrained bert model for Bengali language

✭ 41

Jupyter Notebook nlp transformers lm bangla bert bangla-nlp

are-16-heads-really-better-than-1

Code for the paper "Are Sixteen Heads Really Better than One?"

✭ 128

shell nlp machine-learning transformer bert

FinBERT

A Pretrained BERT Model for Financial Communications. https://arxiv.org/abs/2006.08097