All Projects → pcyin → Pytorch_nmt

pcyin / Pytorch_nmt

A neural machine translation model in PyTorch

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Pytorch nmt

Opennmt Py
Open Source Neural Machine Translation in PyTorch
Stars: ✭ 5,378 (+5278%)
Mutual labels:  neural-machine-translation
Nlp Library
curated collection of papers for the nlp practitioner 📖👩‍🔬
Stars: ✭ 1,025 (+925%)
Mutual labels:  neural-machine-translation
Lang Reps
Code accompanying our EMNLP paper Learning Language Representations for Typology Prediction
Stars: ✭ 75 (-25%)
Mutual labels:  neural-machine-translation
Thumt
An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group
Stars: ✭ 550 (+450%)
Mutual labels:  neural-machine-translation
Nmt
Neural Machine Translation with RNN/ConvS2S/Transoformer
Stars: ✭ 13 (-87%)
Mutual labels:  neural-machine-translation
Transformer Dynet
An Implementation of Transformer (Attention Is All You Need) in DyNet
Stars: ✭ 57 (-43%)
Mutual labels:  neural-machine-translation
Nmt Keras
Neural Machine Translation with Keras
Stars: ✭ 501 (+401%)
Mutual labels:  neural-machine-translation
Language Translation
Neural machine translator for English2German translation.
Stars: ✭ 82 (-18%)
Mutual labels:  neural-machine-translation
Sockeye
Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet
Stars: ✭ 990 (+890%)
Mutual labels:  neural-machine-translation
Nlp Tutorial
A list of NLP(Natural Language Processing) tutorials
Stars: ✭ 1,188 (+1088%)
Mutual labels:  neural-machine-translation
Nematus
Open-Source Neural Machine Translation in Tensorflow
Stars: ✭ 730 (+630%)
Mutual labels:  neural-machine-translation
Marian
Fast Neural Machine Translation in C++
Stars: ✭ 777 (+677%)
Mutual labels:  neural-machine-translation
Na Nmt
Non-autoregressive Neural Machine Translation (not a full version)
Stars: ✭ 61 (-39%)
Mutual labels:  neural-machine-translation
Sentencepiece
Unsupervised text tokenizer for Neural Network-based text generation.
Stars: ✭ 5,540 (+5440%)
Mutual labels:  neural-machine-translation
Opennmt Tf
Neural machine translation and sequence learning using TensorFlow
Stars: ✭ 1,223 (+1123%)
Mutual labels:  neural-machine-translation
Seq2seq.pytorch
Sequence-to-Sequence learning using PyTorch
Stars: ✭ 514 (+414%)
Mutual labels:  neural-machine-translation
Rnn Nmt
基于双向RNN,Attention机制的编解码神经机器翻译模型
Stars: ✭ 46 (-54%)
Mutual labels:  neural-machine-translation
Njunmt Tf
An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.
Stars: ✭ 97 (-3%)
Mutual labels:  neural-machine-translation
Njunmt Pytorch
Stars: ✭ 79 (-21%)
Mutual labels:  neural-machine-translation
Xmunmt
An implementation of RNNsearch using TensorFlow
Stars: ✭ 69 (-31%)
Mutual labels:  neural-machine-translation

A neural machine translation model written in pytorch.

For a up-to-date PyTorch implementation of basic vanilla attentional NMT, please refer to this repo

With 256-dimensional LSTM hidden size, it achieves a training speed of 14000 words/sec and 26.9 BLEU score on the IWSLT 2014 Germen-English dataset (Ranzato et al., 2015).

File Structure

  • nmt.py: main file
  • vocab.py: script used to generate .bin vocabulary file from parallel corpus
  • util.py: script containing helper functions
  • run_raml_exp.py|test_raml_models.py: helper scripts to train|test RAML models with different temperature settings (refer to [Norouzi et al., 2016] for details)

Usage

  • Generate Vocabulary Files
python vocab.py
  • Vanilla Maximum Likelihood Training
. scripts/run_mle.sh
  • Reward Augmented Maximum Likelihood Training (Norouzi et al., 2016)
. scripts/run_raml.sh
  • Reinforcement Learning (Coming soon)

TODO:

  • batched decoding as in openNMT

License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].