106 Open source projects that are alternatives of or similar to Lexicon Thai

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

Build a deep learning model for predicting the named entities from text.

Collections of Chinese NLP corpus

Open Discourse is the first fully comprehensive corpus of the plenary proceedings of the federal German Parliament (Bundestag).

A Public Corpus for Machine Learning

微信公众号语料库

No description or website provided.

An unofficial Python API that allows users to create a corpus of lyrical text from their favorite artists and billboard charts

CLUE Emotion Analysis Dataset 细粒度情感分析数据集

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

extract relationships from standardized terms from corpus of interest with deep learning 🐟

中文文本分类实践，基于搜狗新闻语料库，采用传统机器学习方法以及预训练模型等方法

An R package for the Quantitative Analysis of Textual Data

Repository for the experiments described in the paper named "DeepSentiPers: Novel Deep Learning Models Trained Over Proposed Augmented Persian Sentiment Corpus"

A multilingual dialog corpus

An open-access corpus of conversational bilingual speech in Cantonese and English

Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources

FoLiA: Format for Linguistic Annotation - FoLiA is a rich XML-based annotation format for the representation of language resources (including corpora) with linguistic annotations. A wide variety of linguistic annotations are supported, making FoLiA a useful format for NLP tasks and data interchange. Note that the actual Python library for proces…

Russian mass media stemmed texts corpus / Корпус лемматизированных (морфологически нормализованных) текстов российских СМИ

Kyoto University Web Document Leads Corpus

An Integrated Corpus Tool With Multilingual Support for the Study of Language, Literature, and Translation

Python script to quickly create hand-crafted PDF files

Naive Bayes classifier is classification algorithm. It uses Naive based Bernoulli and Multinomial equation to classify documents(Text) as ham or spam.

No description or website provided.

A dataset of millions of news articles scraped from a curated list of data sources.

Computer-generated poetry

Kanji usage frequency data collected from various sources

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

Fast corpus search engine originally made for the Corpus of Written Tatar language

Pre-trained Wikipedia corpus by MITIE

物种名称语料库。植物名,动物名。

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

collect the open dialog corpus and some useful data processing utils.

Japanese text8 corpus for word embedding.

My fuzzing corpus

Some useful Chinese corpus datasets 中文语料小数据

An Open-Source Package for Chinese Open-domain Conversational Chatbot (中文闲聊对话系统，一键部署微信闲聊机器人)

Typing Assistant provides the ability to autocomplete words and suggests predictions for the next word. This makes typing faster, more intelligent and reduces effort.

PubMed PICO Element Detection Dataset

Crawl BookCorpus

computer tools for thai language

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

A greppable archive of ClojureScript code

A collection of small corpuses of interesting data for the creation of bots and similar stuff.

A multilingual parallel corpus created from translations of the Bible.

公司名语料库。机构名语料库。公司简称,缩写,品牌词,企业名。可用于中文分词、机构名实体识别。

Поэтический корпус русского языка

Fuzzing resources for feeding various fuzzers with input. 🔧

中文医疗信息处理基准CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark

A corpus retrieval engine based on Apache Lucene

Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)

Korean corpus repository

We present a list of languages with their codes, families, regions and etc. We also present a list of multi-lingual corpora (with urls).

🚁 保险行业语料库，聊天机器人

医疗语料库。医疗机构名语料库。药品本位码。

迟先生语料库

lists of text corpus and more (mainly Japanese)

Corpus of Annual Reports in Japan

Chatbot in 200 lines of code using TensorLayer

Curated list of publicly available parallel corpus for Indian Languages