GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → EternalFeather → Chatbot-Training-Corpus

EternalFeather / Chatbot-Training-Corpus

Licence: other
总结了一些可以用作聊天机器人训练实作的文字语聊，包含中英文不同语言

Programming Languages

python
139335 projects - #7 most used programming language

Labels

chatbotdialoguecorpus

Projects that are alternatives of or similar to Chatbot-Training-Corpus

Probabilistic-RNN-DA-Classifier
Probabilistic Dialogue Act Classification for the Switchboard Corpus using an LSTM model
Stars: ✭ 22 (-81.2%)
Mutual labels:  dialogue, corpus
open2ch-dialogue-corpus
おーぷん2ちゃんねるをクロールして作成した対話コーパス
Stars: ✭ 65 (-44.44%)
Mutual labels:  dialogue, corpus
TV4Dialog
No description or website provided.
Stars: ✭ 33 (-71.79%)
Mutual labels:  dialogue, corpus
Dialogue-Corpus
No description or website provided.
Stars: ✭ 27 (-76.92%)
Mutual labels:  dialogue, corpus
dialogue-datasets
collect the open dialog corpus and some useful data processing utils.
Stars: ✭ 24 (-79.49%)
Mutual labels:  dialogue, corpus
Sequicity
Source code for the ACL 2018 paper entitled "Sequicity: Simplifying Task-oriented Dialogue Systems with Single Sequence-to-Sequence Architectures" by Wenqiang Lei et al.
Stars: ✭ 145 (+23.93%)
Mutual labels:  dialogue
Dstc7 End To End Conversation Modeling
Grounded conversational dataset for end-to-end conversational AI (official DSTC7 data)
Stars: ✭ 141 (+20.51%)
Mutual labels:  dialogue
Tod Bert
Pre-Trained Models for ToD-BERT
Stars: ✭ 143 (+22.22%)
Mutual labels:  dialogue
ConDigSum
Code for EMNLP 2021 paper "Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization"
Stars: ✭ 62 (-47.01%)
Mutual labels:  dialogue
Scribble
Efficient multi-effects text renderer for GameMaker Studio 2.3.1
Stars: ✭ 123 (+5.13%)
Mutual labels:  dialogue
Whiskers
A Visual Dialogue Editor made using the Godot Engine
Stars: ✭ 229 (+95.73%)
Mutual labels:  dialogue
Deeputteranceaggregation
Modeling Multi-turn Conversation with Deep Utterance Aggregation (COLING 2018)
Stars: ✭ 171 (+46.15%)
Mutual labels:  dialogue
megs
A merged version of multiple open-source German speech datasets.
Stars: ✭ 21 (-82.05%)
Mutual labels:  corpus
DANeS
DANeS is an open-source E-newspaper dataset by collaboration between DATASET JSC (dataset.vn) and AIV Group (aivgroup.vn)
Stars: ✭ 64 (-45.3%)
Mutual labels:  corpus
Dialogue
Node based dialogue system
Stars: ✭ 207 (+76.92%)
Mutual labels:  dialogue
Dialogue.moe
Stars: ✭ 127 (+8.55%)
Mutual labels:  dialogue
rclc
Rich Context leaderboard competition, including the corpus and current SOTA for required tasks.
Stars: ✭ 20 (-82.91%)
Mutual labels:  corpus
Convlab 2
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Stars: ✭ 196 (+67.52%)
Mutual labels:  dialogue
Anyq
FAQ-based Question Answering System
Stars: ✭ 2,336 (+1896.58%)
Mutual labels:  dialogue
Speech-Corpus-Collection
A Collection of Speech Corpus for ASR and TTS
Stars: ✭ 113 (-3.42%)
Mutual labels:  corpus
View All Similar Projects ➔

Dialog Datasets for Training Chatbot

In the research process of the chatbot, except to having a wonderful model, a large amount of training materials are also needed to strengthen the efficacy of bot. The cleaner our corpus, the smarter chatbot that is able to generate human natural language replies can be. (在进行Chatbot的研究过程中，除了要有一个漂亮的模型之外，还需要有大量可供训练的语料来强化我们的聊天机器人。越干净的语料就能训练出越接近人类自然语言回复的Chatbot。)

  • A summary of the corpora are shown as follows (目前网上公开的语料大多是一些带有噪音的、数量有限的语料。在这里总结了一些可行的语料以及一些利用爬取工具得到的语料，其中包括：)

Basic public corpus (基本公开语料)

  • dgk_shooter_min.conv movie dialogue corpus (中文电影对白语料，噪音大，由于对话未区分说话人，因此对白问答关系难以对应。 )

    • dgk_shooter_min.conv with pre-processing (针对聊天机器人语料的处理)： data_preprocessing

  • ChatBot多语种聊天语料 Multi-language dialogue corpus proposed by ChatterBot (ChatterBot聊天引擎所提供的基本语聊，涵盖语种范围广，但是数量不多，但质量较高，适合模型测试。)

  • DataSets for Natural Language Processing A little bit summary of the corpus for paper researchs (这个是人为收集总结的自然语言处理研究论文以及对应的数据资料集，主要覆盖方面包括了： Question Answering, Dialogue Systems 以及 Goal-Oriented Dialogue System 等。文本都由英文构成，可用于机器翻译和对话模型使用。)

  • 小黄鸡对话机器人训练语料 A famous dialogue corpus "xiaohuangji" published online (这就是网络上流行的小黄鸡对话机器人的训练语料，包括了 xiaohuangji50w_fenciA.conv.zip （已分词） 和 xiaohuangji50w_nofenci.conv.zip （未分词） 两个部分，分词以 “/” 区隔开来，并没有语义上的划分。语料中含有较多表情颜文字，总体对话字数较少，杂讯较多。)

  • 白鹭时代中文问答语料 A Chinese Q-A pairs dataset (由白鹭时代官方论坛问答版块的问题及回复组成，回复选取了标注 “最佳答案” 的记录为目标。人工审核资料，给每一个问题一个可以接受的答案。数量不多，多为问答模式。)

  • Cornell_Movie-Dialogs_Corpus Cornell movie dialogue corpus (康奈尔大学影视对话资料集，语料包含对话人名称信息，语料为英文，以多轮对话为主。)

  • Chinese Quatrains Corpus Chinese quatrains corpus with length five (中文古文五言绝句)

  • Obama Political Speeches Corpus Obama political speeches corpus (奥巴马总统政治演讲节选台词)

From Crawler 个人爬取语料（初步整理）

  • 中文新闻语料 Chinese news (利用爬虫从各大新闻网站上爬取的新闻头条和简讯。)

  • PTT八卦版推文 PTT twittes (利用爬虫从社交软体PTT上对于八卦分类板块的内容进行爬取，原始资料为 PTT八卦板推文.txt 其中包括一些符号和空格杂讯，过滤杂讯（利用统计方式按比例替换成固定符号，降低资料复杂度）之后，通过 单字 或 词组（jieba段词） 等不同方式建立问答语料和字典。)

License:

The copyright of the public corpus is owned by the original author, and no one may be allowed to invest in profitable activities without his/her permission, thanks for your cooperation. (公开语料的版权归原作者所有，未经允许不得一个人名义投入盈利性活动。)

Keywords:

Tags: Corpus Chatbot

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].