yanwii / Chinesener
基于Bi-GRU + CRF 的中文机构名、人名识别, 支持google bert模型
Stars: ✭ 136
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Chinesener
Bi Lstm Crf Ner Tf2.0
Named Entity Recognition (NER) task using Bi-LSTM-CRF model implemented in Tensorflow 2.0(tensorflow2.0 +)
Stars: ✭ 93 (-31.62%)
Mutual labels: named-entity-recognition
Flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Stars: ✭ 11,065 (+8036.03%)
Mutual labels: named-entity-recognition
Dan Jurafsky Chris Manning Nlp
My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.
Stars: ✭ 124 (-8.82%)
Mutual labels: named-entity-recognition
Open Semantic Entity Search Api
Open Source REST API for named entity extraction, named entity linking, named entity disambiguation, recommendation & reconciliation of entities like persons, organizations and places for (semi)automatic semantic tagging & analysis of documents by linked data knowledge graph like SKOS thesaurus, RDF ontology, database(s) or list(s) of names
Stars: ✭ 98 (-27.94%)
Mutual labels: named-entity-recognition
Compromise
modest natural-language processing
Stars: ✭ 10,086 (+7316.18%)
Mutual labels: named-entity-recognition
Ner
命名体识别(NER)综述-论文-模型-代码(BiLSTM-CRF/BERT-CRF)-竞赛资源总结-随时更新
Stars: ✭ 118 (-13.24%)
Mutual labels: named-entity-recognition
End To End Sequence Labeling Via Bi Directional Lstm Cnns Crf Tutorial
Tutorial for End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Stars: ✭ 87 (-36.03%)
Mutual labels: named-entity-recognition
Bnlp
BNLP is a natural language processing toolkit for Bengali Language.
Stars: ✭ 127 (-6.62%)
Mutual labels: named-entity-recognition
Danlp
DaNLP is a repository for Natural Language Processing resources for the Danish Language.
Stars: ✭ 111 (-18.38%)
Mutual labels: named-entity-recognition
Awesome Hungarian Nlp
A curated list of NLP resources for Hungarian
Stars: ✭ 121 (-11.03%)
Mutual labels: named-entity-recognition
Universal Data Tool
Collaborate & label any type of data, images, text, or documents, in an easy web interface or desktop app.
Stars: ✭ 1,356 (+897.06%)
Mutual labels: named-entity-recognition
Anago
Bidirectional LSTM-CRF and ELMo for Named-Entity Recognition, Part-of-Speech Tagging and so on.
Stars: ✭ 1,392 (+923.53%)
Mutual labels: named-entity-recognition
Multilstm
keras attentional bi-LSTM-CRF for Joint NLU (slot-filling and intent detection) with ATIS
Stars: ✭ 122 (-10.29%)
Mutual labels: named-entity-recognition
Bond
BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision
Stars: ✭ 96 (-29.41%)
Mutual labels: named-entity-recognition
Camel tools
A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.
Stars: ✭ 124 (-8.82%)
Mutual labels: named-entity-recognition
Crossweigh
CrossWeigh: Training Named Entity Tagger from Imperfect Annotations
Stars: ✭ 91 (-33.09%)
Mutual labels: named-entity-recognition
Mt Dnn
Multi-Task Deep Neural Networks for Natural Language Understanding
Stars: ✭ 1,871 (+1275.74%)
Mutual labels: named-entity-recognition
Ner Evaluation
An implementation of a full named-entity evaluation metrics based on SemEval'13 Task 9 - not at tag/token level but considering all the tokens that are part of the named-entity
Stars: ✭ 126 (-7.35%)
Mutual labels: named-entity-recognition
Neuroner
Named-entity recognition using neural networks. Easy-to-use and state-of-the-art results.
Stars: ✭ 1,579 (+1061.03%)
Mutual labels: named-entity-recognition
Chinese NER
基于Bi-GRU + CRF 的中文机构名、人名识别 集成GOOGLE BERT模型
下载bert模型
wget -c https://storage.googleapis.com/bert_models/2018_11_03/chinese_L-12_H-768_A-12.zip
放到根目录 bert_model 下
用法
# 训练
# 使用bert模型
python3 model.py -e train -m bert
# 使用一般模型
python3 model.py -e train
# 预测
# 使用bert模型
python3 model.py -e predict -m bert
# 使用一般模型
python3 model.py -e predict
介绍
bert 模型的加载和使用
def bert_layer(self):
# 加载bert配置文件
bert_config = modeling.BertConfig.from_json_file(ARGS.bert_config)
# 创建bert模型
model = modeling.BertModel(
config=bert_config,
is_training=self.is_training,
input_ids=self.input_ids,
input_mask=self.input_mask,
token_type_ids=self.segment_ids,
use_one_hot_embeddings=False
)
# 加载词向量
self.embedded = model.get_sequence_output()
self.model_inputs = tf.nn.dropout(
self.embedded, self.dropout
)
bert 优化器
self.train_op = create_optimizer(
self.loss, self.learning_rate, num_train_steps, num_warmup_steps, False
)
例子
> 金树良先生,董事,硕士。现任北方国际信托股份有限公司总经济师。曾任职于北京大学经济学院国际经济系。1992年7月起历任海南省证券公司副总裁、北京华宇世纪投资有限公司副总裁、昆仑证券有限责任公司总裁、北方国际信托股份有限公司资产管理部总经理及公司总经理助理兼资产管理部总经理、渤海财产保险股份有限公司常务副总经理及总经理、北方国际信托股份有限公司总经理助理。
> [
{
"begin": 14,
"end": 26,
"entity": "北方国际信托股份有限公司",
"type": "ORG"
},
{
"begin": 70,
"end": 82,
"entity": "北京华宇世纪投资有限公司",
"type": "ORG"
},
{
"begin": 99,
"end": 111,
"entity": "北方国际信托股份有限公司",
"type": "ORG"
},
{
"begin": 160,
"end": 172,
"entity": "北方国际信托股份有限公司",
"type": "ORG"
},
{
"begin": 0,
"end": 3,
"entity": "金树良",
"type": "PER"
}
]
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].