salesforce / Nonauto Nmt
Licence: bsd-3-clause
PyTorch Implementation of "Non-Autoregressive Neural Machine Translation"
Stars: ✭ 222
Programming Languages
python
139335 projects - #7 most used programming language
Non-Autoregressive Transformer
Code release for Non-Autoregressive Neural Machine Translation by Jiatao Gu, James Bradbury, Caiming Xiong, Victor O.K. Li, and Richard Socher.
Requires PyTorch 0.3, torchtext 0.2.1, and SpaCy.
The pipeline for training a NAT model for a given language pair includes:
-
run_alignment_wmt_LANG.sh
(runsfast_align
for alignment supervision) -
run_LANG.sh
(trains an autoregressive model) -
run_LANG_decode.sh
(produces the distillation corpus for training the NAT) -
run_LANG_fast.sh
(trains the NAT model) -
run_LANG_fine.sh
(fine-tunes the NAT model)
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].