All Projects → openai → Finetune Transformer Lm

openai / Finetune Transformer Lm

Licence: mit
Code and model for the paper "Improving Language Understanding by Generative Pre-Training"

Programming Languages

python
139335 projects - #7 most used programming language

Labels

Projects that are alternatives of or similar to Finetune Transformer Lm

Research And Coding
研究资源列表 A curated list of research resources
Stars: ✭ 100 (-93.77%)
Mutual labels:  paper
Kiss
Code for the paper "KISS: Keeping it Simple for Scene Text Recognition"
Stars: ✭ 108 (-93.27%)
Mutual labels:  paper
Site Reliability Engineer Guide
Stars: ✭ 112 (-93.02%)
Mutual labels:  paper
Evolution Strategies Starter
Code for the paper "Evolution Strategies as a Scalable Alternative to Reinforcement Learning"
Stars: ✭ 1,363 (-15.08%)
Mutual labels:  paper
Micromanual
A neatly typeset version of John McCarthy's classic paper
Stars: ✭ 106 (-93.4%)
Mutual labels:  paper
Bedwarsrel
Bedwars Reloaded - The Minecraft Bedwars Plugin!
Stars: ✭ 108 (-93.27%)
Mutual labels:  paper
Awesome Transfer Learning
Best transfer learning and domain adaptation resources (papers, tutorials, datasets, etc.)
Stars: ✭ 1,349 (-15.95%)
Mutual labels:  paper
Phd
A list of resources on how/why to do a PhD
Stars: ✭ 120 (-92.52%)
Mutual labels:  paper
Bingpaper
Use Bing daily photo as your wallpaper for macOS.
Stars: ✭ 105 (-93.46%)
Mutual labels:  paper
Nlp Papers
Papers and Book to look at when starting NLP 📚
Stars: ✭ 111 (-93.08%)
Mutual labels:  paper
Gate
A high performant & paralleled Minecraft proxy server with scalability, flexibility & excellent server version support - ready for the cloud!
Stars: ✭ 102 (-93.64%)
Mutual labels:  paper
Generating Reviews Discovering Sentiment
Code for "Learning to Generate Reviews and Discovering Sentiment"
Stars: ✭ 1,429 (-10.97%)
Mutual labels:  paper
Papers Notebook
📄 🇨🇳 📃 论文阅读笔记(分布式系统、虚拟化、机器学习)Papers Notebook (Distributed System, Virtualization, Machine Learning), created by @gaocegege
Stars: ✭ 1,678 (+4.55%)
Mutual labels:  paper
Library
Collection of papers in the field of distributed systems, game theory, cryptography, cryptoeconomics, zero knowledge
Stars: ✭ 100 (-93.77%)
Mutual labels:  paper
Deep K Means Pytorch
[ICML 2018] "Deep k-Means: Re-Training and Parameter Sharing with Harder Cluster Assignments for Compressing Deep Convolutions"
Stars: ✭ 115 (-92.83%)
Mutual labels:  paper
Dataset
Crop/Weed Field Image Dataset
Stars: ✭ 98 (-93.89%)
Mutual labels:  paper
Paperlib
Plugin Library for interfacing with Paper Specific API's with graceful fallback that maintains Spigot Compatibility, such as Async Chunk Loading.
Stars: ✭ 108 (-93.27%)
Mutual labels:  paper
Betonquest
An advanced and powerful quest scripting plugin for Minecraft. Features built-in RPG style conversations and integration for over 25 other plugins.
Stars: ✭ 121 (-92.46%)
Mutual labels:  paper
Commandapi
An API for the command UI introduced in Minecraft 1.13
Stars: ✭ 116 (-92.77%)
Mutual labels:  paper
Singleviewreconstruction
Official Code: 3D Scene Reconstruction from a Single Viewport
Stars: ✭ 110 (-93.15%)
Mutual labels:  paper

Status: Archive (code is provided as-is, no updates expected)

finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"

Currently this code implements the ROCStories Cloze Test result reported in the paper by running: python train.py --dataset rocstories --desc rocstories --submit --analysis --data_dir [path to data here]

Note: The code is currently non-deterministic due to various GPU ops. The median accuracy of 10 runs with this codebase (using default hyperparameters) is 85.8% - slightly lower than the reported single run of 86.5% from the paper.

The ROCStories dataset can be downloaded from the associated website.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].