All Projects → yuanxiaosc → Xlnet_paper_chinese_translation

yuanxiaosc / Xlnet_paper_chinese_translation

XLNet: Generalized Autoregressive Pretraining for Language Understanding 论文的中文翻译 Paper Chinese Translation!

Projects that are alternatives of or similar to Xlnet paper chinese translation

Linux Insides Zh
Linux 内核揭秘
Stars: ✭ 5,105 (+10110%)
Mutual labels:  chinese-translation
Bert paper chinese translation
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!
Stars: ✭ 564 (+1028%)
Mutual labels:  chinese-translation
Nginx Docs
Nginx 中文文档. Chinese translation of Nginx documentation.
Stars: ✭ 809 (+1518%)
Mutual labels:  chinese-translation
Gradle Plugin User Guide Chinese Verision
Gradle Plugin User Guide 中文翻译
Stars: ✭ 426 (+752%)
Mutual labels:  chinese-translation
Sf Zh
《软件基础》中译版 Software Foundations Chinese Translation
Stars: ✭ 554 (+1008%)
Mutual labels:  chinese-translation
Opencc
Conversion between Traditional and Simplified Chinese
Stars: ✭ 5,979 (+11858%)
Mutual labels:  chinese-translation
Developing Ios 10 Apps With Swift
Stanford 公开课,Developing iOS 10 Apps with Swift 字幕翻译
Stars: ✭ 391 (+682%)
Mutual labels:  chinese-translation
Eigendocinchinese
Eigen3.3.7 Doc中文版
Stars: ✭ 28 (-44%)
Mutual labels:  chinese-translation
Translatorx
JetBrains 系列软件汉化包 关键字: Android Studio 3.5 汉化包 CLion 2019.3 汉化包 DataGrip 2019.3 汉化包 GoLand 2019.3 汉化包 IntelliJ IDEA 2019.3 汉化包 PhpStorm 2019.3 汉化包 PyCharm 2019.3 汉化包 Rider 2019.3 汉化包 RubyMine 2019.3 汉化包 WebStorm 2019.3 汉化包
Stars: ✭ 4,856 (+9612%)
Mutual labels:  chinese-translation
Springboot
Spring Boot chinese document. Spring Boot 2.1.5 中文文档
Stars: ✭ 703 (+1306%)
Mutual labels:  chinese-translation
Pydata Notebook
利用Python进行数据分析 第二版 (2017) 中文翻译笔记
Stars: ✭ 4,300 (+8500%)
Mutual labels:  chinese-translation
Microservices
Microservices from Design to Deployment 中文版 《微服务:从设计到部署》
Stars: ✭ 4,637 (+9174%)
Mutual labels:  chinese-translation
Java Virtual Machine Specification
Chinese translation of The Java® Virtual Machine Specification.《Java 虚拟机规范(第11版)》中文翻译及示例,Java SE 11 版
Stars: ✭ 649 (+1198%)
Mutual labels:  chinese-translation
Juliazh.jl
Julia语言中文文档
Stars: ✭ 425 (+750%)
Mutual labels:  chinese-translation
Game Programming Patterns Cn
《游戏编程模式》中文版
Stars: ✭ 837 (+1574%)
Mutual labels:  chinese-translation
Jetbrains In Chinese
JetBrains 系列软件汉化包 关键字: Android Studio 3.5 汉化包 CLion 2019.3 汉化包 DataGrip 2019.3 汉化包 GoLand 2019.3 汉化包 IntelliJ IDEA 2019.3 汉化包 PhpStorm 2019.3 汉化包 PyCharm 2019.3 汉化包 Rider 2019.3 汉化包 RubyMine 2019.3 汉化包 WebStorm 2019.3 汉化包
Stars: ✭ 3,912 (+7724%)
Mutual labels:  chinese-translation
Gitlab Ce Zh
GitLab Community Edition (中文社区版)
Stars: ✭ 594 (+1088%)
Mutual labels:  chinese-translation
Teachyourselfcs Cn
TeachYourselfCS 的中文翻译 | A Chinese translation of TeachYourselfCS
Stars: ✭ 11,772 (+23444%)
Mutual labels:  chinese-translation
Hhcomicviewer
[DEPRECATED] 这是一个汗汗漫画网的android平台阅读软件
Stars: ✭ 26 (-48%)
Mutual labels:  chinese-translation
Translations
🐼 Chinese translations for classic IT resources
Stars: ✭ 6,074 (+12048%)
Mutual labels:  chinese-translation

XLNet: Generalized Autoregressive Pretraining for Language Understanding 论文的中文翻译

本文是XLNet论文的全文翻译,转载注明出处和译者。

手机扫码阅读:


由于GitHub目前不能很好渲染公式符号,建议直接查看PDF版翻译在线阅读

XLNet:广义自回归预训练语言模型

摘要

由于具有双向上下文建模的能力,像BERT这样基于自动去噪的预训练语言模型比基于自回归的预训练语言模型的性能更好。然而,依赖于使用带掩码(masks)损坏的输入,BERT忽略了掩码位置之间的依赖性,由此受到了预训练-微调阶段不一致的影响。针对这些优点和缺点,我们提出了XLNet,一种广义自回归预训练方法,它(1)通过最大化输入序列的因式分解的所有排列的似然函数的期望来学习双向上下文,并且(2)并且通过其自回归方法,克服了BERT的局限性。此外,XLNet将最先进的自回归模型Transformer-XL的思想整合到预训练中。实验表明,XLNet在20个任务上常大幅度优于BERT的表现,并在18个任务中实现最先进的结果,包括问答、自然语言推理、情感分析和文档排名(注1:预训练的模型和代码可在 https://github.com/zihangdai/xlnet 获得)。


XLNet 相关资源

推荐阅读 XLNet Generalized Autoregressive Pretraining for Language Understanding

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].