177 Open source projects that are alternatives of or similar to proiel-treebank

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.

Repository for the Georgetown University Multilayer Corpus (GUM)

微信公众号语料库

FoLiA: Format for Linguistic Annotation - FoLiA is a rich XML-based annotation format for the representation of language resources (including corpora) with linguistic annotations. A wide variety of linguistic annotations are supported, making FoLiA a useful format for NLP tasks and data interchange. Note that the actual Python library for proces…

A Curated List of Dataset and Usable Library Resources for NLP in Bahasa Indonesia

Tools for ASR Corpus Generation from Online Video

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

A corpus retrieval engine based on Apache Lucene

This is a repository created for the list of resources for learning and exploring Wonderful Polish language.

Helsinki Prosody Corpus and A System for Predicting Prosodic Prominence from Text

Typing Assistant provides the ability to autocomplete words and suggests predictions for the next word. This makes typing faster, more intelligent and reduces effort.

Poetry-related datasets developed by THUAIPoet (Jiuge) group.

Cornell NLVR and NLVR2 are natural language grounding datasets. Each example shows a visual input and a sentence describing it, and is annotated with the truth-value of the sentence.

คลังศัพท์ภาษาไทย

Poetic processing, for Python.

Japanese text8 corpus for word embedding.

WP2TXT extracts plain text data from Wikipedia dump file (encoded in XML/compressed with Bzip2) stripping all the MediaWiki markups and other metadata.

Pre-trained Wikipedia corpus by MITIE

Language Acquisition Research Tools

Preprocessed Python functions and docstrings for automated code documentation (code2doc) and automated code generation (doc2code) tasks.

公司名语料库。机构名语料库。公司简称,缩写,品牌词,企业名。可用于中文分词、机构名实体识别。

🚁 保险行业语料库，聊天机器人

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

No description or website provided.

KH Coder: for Quantitative Content Analysis or Text Mining

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

Some useful Chinese corpus datasets 中文语料小数据

Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator

UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language

🇺🇦 🇬🇧 🔡 🐘 PHP library for transliteration.

PubMed 200k RCT dataset: a large dataset for sequential sentence classification.

❤️Emotional First Aid Dataset, 心理咨询问答、聊天机器人语料库

迟先生语料库

Probabilistic Dialogue Act Classification for the Switchboard Corpus using an LSTM model

lists of text corpus and more (mainly Japanese)

data resource untuk NLP bahasa indonesia

Russian mass media stemmed texts corpus / Корпус лемматизированных (морфологически нормализованных) текстов российских СМИ

Political Discourse Analysis Using Pre-Trained Word Vectors.

Corpus of Annual Reports in Japan

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

A multilingual dialog corpus

DANeS is an open-source E-newspaper dataset by collaboration between DATASET JSC (dataset.vn) and AIV Group (aivgroup.vn)

An unofficial Python API that allows users to create a corpus of lyrical text from their favorite artists and billboard charts

PTT 八卦版問答中文語料

Naive Bayes classifier is classification algorithm. It uses Naive based Bernoulli and Multinomial equation to classify documents(Text) as ham or spam.

A merged version of multiple open-source German speech datasets.

Chatbot in 200 lines of code using TensorLayer

Awesome Chatbot Projects,Corpus,Papers,Tutorials.Chinese Chatbot =>:

An R package for the Quantitative Analysis of Textual Data

Rich Context leaderboard competition, including the corpus and current SOTA for required tasks.

用于训练中英文对话系统的语料库 Datasets for Training Chatbot System

Crawl BookCorpus

搜索所有中文NLP数据集，附常用英文NLP数据集

Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources

中文人名语料库。人名生成器。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名。可用于中文分词、人名实体识别。

Collections of Chinese NLP corpus

A curated list of NLP resources for Hungarian

Tweets when words are published for the first time in the NYT

Феминизатор слов

A list of ~100,000 German nouns and their grammatical properties compiled from WiktionaryDE as CSV file. Plus a module to look up the data and parse compound words.