108 Open source projects that are alternatives of or similar to LanguageCodes

Awesome Chatbot Projects,Corpus,Papers,Tutorials.Chinese Chatbot =>:

UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language

A list of ~100,000 German nouns and their grammatical properties compiled from WiktionaryDE as CSV file. Plus a module to look up the data and parse compound words.

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Russian mass media stemmed texts corpus / Корпус лемматизированных (морфологически нормализованных) текстов российских СМИ

Official releases of the PROIEL treebank of ancient Indo-European languages

A curated list of NLP resources for Hungarian

New York Times Word Innovation Types dataset

迟先生语料库

中文人名语料库。人名生成器。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名。可用于中文分词、人名实体识别。

data resource untuk NLP bahasa indonesia

A multilingual dialog corpus

TVsub: DCU-Tencent Chinese-English Dialogue Corpus

PTT 八卦版問答中文語料

おーぷん2ちゃんねるをクロールして作成した対話コーパス

搜索所有中文NLP数据集，附常用英文NLP数据集

Probabilistic Dialogue Act Classification for the Switchboard Corpus using an LSTM model

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.

The Business Scene Dialogue corpus

PubMed 200k RCT dataset: a large dataset for sequential sentence classification.

No description or website provided.

lists of text corpus and more (mainly Japanese)

Text conversion tool (from e.g. Word, HTML, txt) to corpus formats TEI or FoLiA)

Corpus of Annual Reports in Japan

Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator

A Curated List of Dataset and Usable Library Resources for NLP in Bahasa Indonesia

Typing Assistant provides the ability to autocomplete words and suggests predictions for the next word. This makes typing faster, more intelligent and reduces effort.

总结了一些可以用作聊天机器人训练实作的文字语聊，包含中英文不同语言

WP2TXT extracts plain text data from Wikipedia dump file (encoded in XML/compressed with Bzip2) stripping all the MediaWiki markups and other metadata.

Text corpus for Bahasa Malaysia, https://malaya.readthedocs.io/en/latest/Dataset.html

Helsinki Prosody Corpus and A System for Predicting Prosodic Prominence from Text

A Collection of Speech Corpus for ASR and TTS

Preprocessed Python functions and docstrings for automated code documentation (code2doc) and automated code generation (doc2code) tasks.

MEV Data Corpus

KH Coder: for Quantitative Content Analysis or Text Mining

DANeS is an open-source E-newspaper dataset by collaboration between DATASET JSC (dataset.vn) and AIV Group (aivgroup.vn)

用于训练中英文对话系统的语料库 Datasets for Training Chatbot System

Repository for the Georgetown University Multilayer Corpus (GUM)

Korean sejong corpus download and simple analysis

Rich Context leaderboard competition, including the corpus and current SOTA for required tasks.

Poetry-related datasets developed by THUAIPoet (Jiuge) group.

Kanji usage frequency data collected from various sources

Tools for ASR Corpus Generation from Online Video

A merged version of multiple open-source German speech datasets.

คลังศัพท์ภาษาไทย

Convert a PDF via OCR to a TXT file in UTF-8 encoding

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

Text2Text: Cross-lingual natural language processing and generation toolkit

Japanese text8 corpus for word embedding.

A meta-corpus of functional harmonic analysis.

A corpus retrieval engine based on Apache Lucene

Deep Learning and deep reinforcement learning research papers and some codes

Pre-trained Wikipedia corpus by MITIE

A repo listing known open source voice tools, ordered by where they sit in the voice stack

Cornell NLVR and NLVR2 are natural language grounding datasets. Each example shows a visual input and a sentence describing it, and is annotated with the truth-value of the sentence.

中文文本分类实践，基于搜狗新闻语料库，采用传统机器学习方法以及预训练模型等方法

โครงการเก็บรวบรวมข่าวสารจากเว็บไซต์รัฐบาลไทย

Text collections made available by the CLiGS group.

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

❤️Emotional First Aid Dataset, 心理咨询问答、聊天机器人语料库