All Projects → AidenHuen → BERT-BiLSTM-CRF

AidenHuen / BERT-BiLSTM-CRF

Licence: other
BERT-BiLSTM-CRF的Keras版实现

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to BERT-BiLSTM-CRF

Kashgari
Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.
Stars: ✭ 2,235 (+5487.5%)
Mutual labels:  bert, sequence-labeling
Pytorch-NLU
Pytorch-NLU,一个中文文本分类、序列标注工具包,支持中文长文本、短文本的多类、多标签分类任务,支持中文命名实体识别、词性标注、分词等序列标注任务。 Ptorch NLU, a Chinese text classification and sequence annotation toolkit, supports multi class and multi label classification tasks of Chinese long text and short text, and supports sequence annotation tasks such as Chinese named entity recognition, part of speech ta…
Stars: ✭ 151 (+277.5%)
Mutual labels:  bert, sequence-labeling
deepseg
Chinese word segmentation in tensorflow 2.x
Stars: ✭ 23 (-42.5%)
Mutual labels:  sequence-labeling, bilstm-crf
PIE
Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models for Local Sequence Transduction": www.aclweb.org/anthology/D19-1435.pdf (EMNLP-IJCNLP 2019)
Stars: ✭ 164 (+310%)
Mutual labels:  bert, sequence-labeling
ChineseNER
中文NER的那些事儿
Stars: ✭ 241 (+502.5%)
Mutual labels:  bert, bilstm-crf
sticker2
Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot
Stars: ✭ 14 (-65%)
Mutual labels:  bert
hard-label-attack
Natural Language Attacks in a Hard Label Black Box Setting.
Stars: ✭ 26 (-35%)
Mutual labels:  bert
NER-in-Chinese-Text
NLP Keras BiLSTM+CRF
Stars: ✭ 53 (+32.5%)
Mutual labels:  bilstm-crf
SA-BERT
CIKM 2020: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
Stars: ✭ 71 (+77.5%)
Mutual labels:  bert
consistency
Implementation of models in our EMNLP 2019 paper: A Logic-Driven Framework for Consistency of Neural Models
Stars: ✭ 26 (-35%)
Mutual labels:  bert
NLP-Review-Scorer
Score your NLP paper review
Stars: ✭ 25 (-37.5%)
Mutual labels:  bert
Cross-Lingual-MRC
Cross-Lingual Machine Reading Comprehension (EMNLP 2019)
Stars: ✭ 66 (+65%)
Mutual labels:  bert
gender-unbiased BERT-based pronoun resolution
Source code for the ACL workshop paper and Kaggle competition by Google AI team
Stars: ✭ 42 (+5%)
Mutual labels:  bert
AnnA Anki neuronal Appendix
Using machine learning on your anki collection to enhance the scheduling via semantic clustering and semantic similarity
Stars: ✭ 39 (-2.5%)
Mutual labels:  bert
DE-LIMIT
DeEpLearning models for MultIlingual haTespeech (DELIMIT): Benchmarking multilingual models across 9 languages and 16 datasets.
Stars: ✭ 90 (+125%)
Mutual labels:  bert
Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
Stars: ✭ 2,828 (+6970%)
Mutual labels:  bert
CrossNER
CrossNER: Evaluating Cross-Domain Named Entity Recognition (AAAI-2021)
Stars: ✭ 87 (+117.5%)
Mutual labels:  sequence-labeling
NAG-BERT
[EACL'21] Non-Autoregressive with Pretrained Language Model
Stars: ✭ 47 (+17.5%)
Mutual labels:  bert
roberta-wwm-base-distill
this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large
Stars: ✭ 61 (+52.5%)
Mutual labels:  bert
wechsel
Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
Stars: ✭ 39 (-2.5%)
Mutual labels:  bert

BERT-BiLSTM-CRF

BERT-BiLSTM-CRF的Keras版实现

BERT配置

  1. 首先需要下载Pre-trained的BERT模型,本文用的是Google开源的中文BERT模型:
  1. 安装BERT客户端和服务器 pip install bert-serving-server pip install bert-serving-client,源项目如下:
  1. 打开服务器,在BERT根目录下,打开终端,输入命令:
  • bert-serving-start -pooling_strategy NONE -max_seq_len 144 -mask_cls_sep -model_dir chinese_L-12_H-768_A-12/ -num_worker 1

DEMO数据

  • 2015词性标注数据集

文件描述

  • preprocess.py 数据预处理,产生模型输入的pickle文件
  • train.py 通过训练集,训练模型
  • test.py 计算模型在测试集中的F1值
  • Modellib.py 模型位置
  • config.py 参数配置

模型训练

配置BERT->>执行preprocess.py->>执行train.py

配置

  • python 2.7
  • tensorflow-gpu 1.10.0
  • Keras 2.2.4
  • keras-contrib 2.0.8
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].