All Projects → neulab → extreme-adaptation-for-personalized-translation

neulab / extreme-adaptation-for-personalized-translation

Licence: MIT license
Code for the paper "Extreme Adaptation for Personalized Neural Machine Translation"

Programming Languages

python
139335 projects - #7 most used programming language
shell
77523 projects
perl
6916 projects

Projects that are alternatives of or similar to extreme-adaptation-for-personalized-translation

Mt Reading List
A machine translation reading list maintained by Tsinghua Natural Language Processing Group
Stars: ✭ 2,166 (+5057.14%)
Mutual labels:  machine-translation
Opennmt
Open Source Neural Machine Translation in Torch (deprecated)
Stars: ✭ 2,339 (+5469.05%)
Mutual labels:  machine-translation
Neural-Morphological-Disambiguation-for-Turkish-DEPRECATED
Neural morphological disambiguation for Turkish. Implemented in DyNet
Stars: ✭ 11 (-73.81%)
Mutual labels:  dynet
Npmt
Towards Neural Phrase-based Machine Translation
Stars: ✭ 175 (+316.67%)
Mutual labels:  machine-translation
Attention Mechanisms
Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.
Stars: ✭ 203 (+383.33%)
Mutual labels:  machine-translation
ibleu
A visual and interactive scoring environment for machine translation systems.
Stars: ✭ 27 (-35.71%)
Mutual labels:  machine-translation
Mtbook
《机器翻译:基础与模型》肖桐 朱靖波 著 - Machine Translation: Foundations and Models
Stars: ✭ 2,307 (+5392.86%)
Mutual labels:  machine-translation
tvsub
TVsub: DCU-Tencent Chinese-English Dialogue Corpus
Stars: ✭ 40 (-4.76%)
Mutual labels:  machine-translation
Hardware Aware Transformers
[ACL 2020] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
Stars: ✭ 206 (+390.48%)
Mutual labels:  machine-translation
sb-nmt
Code for Synchronous Bidirectional Neural Machine Translation (SB-NMT)
Stars: ✭ 66 (+57.14%)
Mutual labels:  machine-translation
Texar
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Stars: ✭ 2,236 (+5223.81%)
Mutual labels:  machine-translation
Bleualign
Machine-Translation-based sentence alignment tool for parallel text
Stars: ✭ 199 (+373.81%)
Mutual labels:  machine-translation
transformer
Build English-Vietnamese machine translation with ProtonX Transformer. :D
Stars: ✭ 41 (-2.38%)
Mutual labels:  machine-translation
Spark Nlp
State of the Art Natural Language Processing
Stars: ✭ 2,518 (+5895.24%)
Mutual labels:  machine-translation
osdg-tool
OSDG is an open-source tool that maps and connects activities to the UN Sustainable Development Goals (SDGs) by identifying SDG-relevant content in any text. The tool is available online at www.osdg.ai. API access available for research purposes.
Stars: ✭ 22 (-47.62%)
Mutual labels:  machine-translation
Openkiwi
Open-Source Machine Translation Quality Estimation in PyTorch
Stars: ✭ 157 (+273.81%)
Mutual labels:  machine-translation
Modernmt
Neural Adaptive Machine Translation that adapts to context and learns from corrections.
Stars: ✭ 231 (+450%)
Mutual labels:  machine-translation
OPUS-MT-train
Training open neural machine translation models
Stars: ✭ 166 (+295.24%)
Mutual labels:  machine-translation
bergamot-translator
Cross platform C++ library focusing on optimized machine translation on the consumer-grade device.
Stars: ✭ 181 (+330.95%)
Mutual labels:  machine-translation
apertium-apy
📦 Apertium HTTP Server in Python
Stars: ✭ 29 (-30.95%)
Mutual labels:  machine-translation

Extreme Adaptation for Personalized Neural Machine Translation

This repository contains the code for the paper Extreme Adaptation for Personalized Neural Machine Translation.

Data

The data used in the paper is the SATED dataset, available at this url: https://pmichel31415.github.io/sated/.

Additional experiments were performed on the gender annotated europarl corpus from [1], available at this url https://www.kaggle.com/ellarabi/europarl-annotated-for-speaker-gender-and-age.

You can download all the data by running:

# SATED
wget http://www.cs.cmu.edu/~pmichel1/hosting/sated-release-0.9.0.tar.gz
tar xvzf sated-release-0.9.0.tar.gz
# Europarl
wget https://www.kaggle.com/ellarabi/europarl-annotated-for-speaker-gender-and-age/downloads/europarl-annotated-for-speaker-gender-and-age.zip
unzip europarl-annotated-for-speaker-gender-and-age.zip

Requirements

This project was coded in Dynet. It should be working with the 2.0.3 release which you can install by running:

pip install dynet==2.0.3

References

If you use this code or the SATED dataset in you research, consider citing the original paper:

TBD

Other references:

[1]: https://aclanthology.coli.uni-saarland.de/pdf/E/E17/E17-1101.pdf

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].