107 Open source projects that are alternatives of or similar to open-discourse

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

A list of ~100,000 German nouns and their grammatical properties compiled from WiktionaryDE as CSV file. Plus a module to look up the data and parse compound words.

We present a list of languages with their codes, families, regions and etc. We also present a list of multi-lingual corpora (with urls).

New York Times Word Innovation Types dataset

A Curated List of Dataset and Usable Library Resources for NLP in Bahasa Indonesia

中文医疗信息处理基准CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark

Official releases of the PROIEL treebank of ancient Indo-European languages

computer tools for thai language

Deep Learning and deep reinforcement learning research papers and some codes

MEV Data Corpus

Repository for the Georgetown University Multilayer Corpus (GUM)

Helsinki Prosody Corpus and A System for Predicting Prosodic Prominence from Text

Поэтический корпус русского языка

Text conversion tool (from e.g. Word, HTML, txt) to corpus formats TEI or FoLiA)

PubMed PICO Element Detection Dataset

TVsub: DCU-Tencent Chinese-English Dialogue Corpus

Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)

Probabilistic Dialogue Act Classification for the Switchboard Corpus using an LSTM model

My fuzzing corpus

No description or website provided.

Kanji usage frequency data collected from various sources

Cornell NLVR and NLVR2 are natural language grounding datasets. Each example shows a visual input and a sentence describing it, and is annotated with the truth-value of the sentence.

A greppable archive of ClojureScript code

WP2TXT extracts plain text data from Wikipedia dump file (encoded in XML/compressed with Bzip2) stripping all the MediaWiki markups and other metadata.

A meta-corpus of functional harmonic analysis.

おーぷん2ちゃんねるをクロールして作成した対話コーパス

PTT 八卦版問答中文語料

CLUE Emotion Analysis Dataset 细粒度情感分析数据集

Scripts to maintain German law git repository

No description or website provided.

Convert a PDF via OCR to a TXT file in UTF-8 encoding

Python script to quickly create hand-crafted PDF files

A repo listing known open source voice tools, ordered by where they sit in the voice stack

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

总结了一些可以用作聊天机器人训练实作的文字语聊，包含中英文不同语言

A Public Corpus for Machine Learning

A Collection of Speech Corpus for ASR and TTS

FoLiA: Format for Linguistic Annotation - FoLiA is a rich XML-based annotation format for the representation of language resources (including corpora) with linguistic annotations. A wide variety of linguistic annotations are supported, making FoLiA a useful format for NLP tasks and data interchange. Note that the actual Python library for proces…

DANeS is an open-source E-newspaper dataset by collaboration between DATASET JSC (dataset.vn) and AIV Group (aivgroup.vn)

No description or website provided.

Rich Context leaderboard competition, including the corpus and current SOTA for required tasks.

Repository for the experiments described in the paper named "DeepSentiPers: Novel Deep Learning Models Trained Over Proposed Augmented Persian Sentiment Corpus"

A merged version of multiple open-source German speech datasets.

中文文本分类实践，基于搜狗新闻语料库，采用传统机器学习方法以及预训练模型等方法

中文人名语料库。人名生成器。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名。可用于中文分词、人名实体识别。

Build a deep learning model for predicting the named entities from text.

Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator

โครงการเก็บรวบรวมข่าวสารจากเว็บไซต์รัฐบาลไทย

❤️Emotional First Aid Dataset, 心理咨询问答、聊天机器人语料库

An open-access corpus of conversational bilingual speech in Cantonese and English

data resource untuk NLP bahasa indonesia

The Business Scene Dialogue corpus

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Kyoto University Web Document Leads Corpus

Text collections made available by the CLiGS group.

物种名称语料库。植物名,动物名。

collect the open dialog corpus and some useful data processing utils.

An Open-Source Package for Chinese Open-domain Conversational Chatbot (中文闲聊对话系统，一键部署微信闲聊机器人)

A multilingual parallel corpus created from translations of the Bible.

Text corpus for Bahasa Malaysia, https://malaya.readthedocs.io/en/latest/Dataset.html