All Projects → zhanlaoban → NLP_PEMDC

zhanlaoban / NLP_PEMDC

Licence: other
NLP Predtrained Embeddings, Models and Datasets Collections(NLP_PEMDC). The collection will keep updating.

Projects that are alternatives of or similar to NLP PEMDC

Data-Science-and-Machine-Learning-Resources
List of Data Science and Machine Learning Resource that I frequently use
Stars: ✭ 19 (-67.24%)
Mutual labels:  collections, datasets
collections-extended
Extra Python Collections - bags (multisets), setlists (unique list / indexed set), RangeMap and IndexedDict
Stars: ✭ 41 (-29.31%)
Mutual labels:  collections
awesome-hive
A curated list of awesome Hive resources.
Stars: ✭ 20 (-65.52%)
Mutual labels:  collections
ReactiveDataDisplayManager
No description or website provided.
Stars: ✭ 35 (-39.66%)
Mutual labels:  collections
textaugment
TextAugment: Text Augmentation Library
Stars: ✭ 280 (+382.76%)
Mutual labels:  word2vec
NLP-paper
🎨 🎨NLP 自然语言处理教程 🎨🎨 https://dataxujing.github.io/NLP-paper/
Stars: ✭ 23 (-60.34%)
Mutual labels:  word2vec
cifair
A duplicate-free variant of the CIFAR test set.
Stars: ✭ 13 (-77.59%)
Mutual labels:  datasets
test word2vec uyghur
Bu Uyghur yéziqini Pythonning gensim ambiridiki word2vec algorizimida sinap baqqan misal.
Stars: ✭ 15 (-74.14%)
Mutual labels:  word2vec
mindsdb-examples
Examples for usage of Mindsdb https://www.mindsdb.com/
Stars: ✭ 25 (-56.9%)
Mutual labels:  datasets
Spatio-Temporal-papers
This project is a collection of recent research in areas such as new infrastructure and urban computing, including white papers, academic papers, AI lab and dataset etc.
Stars: ✭ 180 (+210.34%)
Mutual labels:  datasets
learningspoons
nlp lecture-notes and source code
Stars: ✭ 29 (-50%)
Mutual labels:  word2vec
kaggledatasets
Collection of Kaggle Datasets ready to use for Everyone (Looking for contributors)
Stars: ✭ 44 (-24.14%)
Mutual labels:  datasets
revery
A personal semantic search engine capable of surfacing relevant bookmarks, journal entries, notes, blogs, contacts, and more, built on an efficient document embedding algorithm and Monocle's personal search index.
Stars: ✭ 200 (+244.83%)
Mutual labels:  word2vec
word2vec-on-wikipedia
A pipeline for training word embeddings using word2vec on wikipedia corpus.
Stars: ✭ 68 (+17.24%)
Mutual labels:  word2vec
text-classification-cn
中文文本分类实践,基于搜狗新闻语料库,采用传统机器学习方法以及预训练模型等方法
Stars: ✭ 81 (+39.66%)
Mutual labels:  word2vec
v2ex-collections-search
v2ex收藏搜索
Stars: ✭ 21 (-63.79%)
Mutual labels:  collections
word-benchmarks
Benchmarks for intrinsic word embeddings evaluation.
Stars: ✭ 45 (-22.41%)
Mutual labels:  word2vec
Arabic-Word-Embeddings-Word2vec
Arabic Word Embeddings Word2vec
Stars: ✭ 26 (-55.17%)
Mutual labels:  word2vec
wmd4j
wmd4j is a Java library for calculating Word Mover's Distance (WMD)
Stars: ✭ 31 (-46.55%)
Mutual labels:  word2vec
word2vec
Rust interface to word2vec.
Stars: ✭ 22 (-62.07%)
Mutual labels:  word2vec

NLP_PEMDC

NLP Predtrained Embeddings, Models and Datasets Collections(NLP_PEMDC)

The pretrained word embeddings and datasets for NLP. The collection will keep updating. The purpose of these pre-trained word vectors and datasets is for learning and research purposes only.

不断收集我遇到的各种NLP预训练词向量、模型和数据集。这些预训练词向量和数据集的目的仅用来学习和研究。

The rankings are in no particular order, only in the order I added them. The data set belongs to the original author, thanks! If there is any infringement, please email me and let me know.

排名不分先后,仅按我添加的先后顺序。数据集所有权均属于原作者,感谢!若有侵权,请电邮我告知删除。

Pretrained Chinese Word Vectors(embeddings):

Word2vec

  1. 100+ Chinese Word Vectors 上百种预训练中文词向量

    Github

  2. Tencent AI Lab Embedding Corpus for Chinese Words and Phrases

    URL

GloVe

TODO

Chinese Pre-trained Models

  1. Chinese-BERT

    Github

  2. Chinese-BERT-wwm

    Github

  3. Chinese-XLNet

    Github1

    Github2

  4. Chinese-RoBERTa

    Github

  5. Chinese-ALBERT

    Github1

    Github2

Chinese Courpus:

  1. [集合]大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

    Github

  2. [集合]搜狗实验室语料集合

    语料数据

  3. [集合]ChineseNlpCorpus

    Github

  4. [集合]ChineseGLUE

    Github

    目前包含:

    1. LCQMC 口语化描述的语义相似度任务 Semantic Similarity Task COLING 2018
    2. XNLI 语言推断任务 Natural Language Inference EMNLP 2015
    3. TNEWS 今日头条中文新闻(短文本)分类 Short Text Classificaiton for News
    4. INEWS 互联网情感分析任务 Sentiment Analysis for Internet News
    5. THUCNEWS 长文本分类 Long Text classification
    6. iFLYTEK 长文本分类 Long Text classification
    7. DRCD 繁体阅读理解任务 Reading Comprehension for Traditional Chinese
    8. CMRC2018 简体中文阅读理解任务 Reading Comprehension for Simplified Chinese
    9. BQ 智能客服问句匹配 Question Matching for Customer Service EMNLP 2018 Download
    10. MSRANER 命名实体识别 Name Entity Recognition
    11. CHID 成语阅读理解填空 Chinese IDiom Dataset for Cloze Test
    12. CMNLI 语言推理任务 Chinese Multi-Genre NLI
  5. LCSTS: A Large Scale Chinese Short Text Summarization Dataset

    大规模中文短文本摘要数据集

    arXiv

    Download

  6. chinese-poetry: 最全中文诗歌古典文集数据库

    Github

  7. SentiBridge: 中文实体情感知识库

    Github

English Corpus:

  1. [collections]GLUE

    Download

    Including:

    1. The Corpus of Linguistic Acceptability
    2. The Stanford Sentiment Treebank
    3. Microsoft Research Paraphrase Corpus
    4. Semantic Textual Similarity Benchmark
    5. Quora Question Pairs
    6. MultiNLI Matched
    7. MultiNLI Mismatched
    8. Question NLI
    9. Recognizing Textual Entailment
    10. Winograd NLI
    11. Diagnostics Main
  2. [collections]SuperGLUE

    Download

    Including:

    1. Broadcoverage Diagnostics
    2. CommitmentBank
    3. Choice of Plausible Alternatives
    4. Multi-Sentence Reading Comprehension
    5. Recognizing Textual Entailment
    6. Words in Context
    7. The Winograd Schema Challenge
    8. BoolQ
    9. Reading Comprehension with Commonsense Reasoning
    10. Winogender Schema Diagnostics
  3. IMDB Large Movie Review Dataset

    This is a dataset for binary sentiment classification containing substantially more data than previous benchmark datasets. We provide a set of 25,000 highly polar movie reviews for training, and 25,000 for testing. There is additional unlabeled data for use as well.

    Download

  4. SQuAD2.0

    The Stanford Question Answering Dataset

    Website

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].