English
Related papers

Related papers: A Teacher-Student Framework for Zero-Resource Neur…

200 papers

Multilingual neural machine translation (NMT) enables training a single model that supports translation from multiple source languages into multiple target languages. In this paper, we push the limits of multilingual NMT in terms of number…

Computation and Language · Computer Science 2019-07-03 Roee Aharoni , Melvin Johnson , Orhan Firat

Document-level machine translation manages to outperform sentence level models by a small margin, but have failed to be widely adopted. We argue that previous research did not make a clear use of the global context, and propose a new…

Computation and Language · Computer Science 2020-09-10 Zaixiang Zheng , Xiang Yue , Shujian Huang , Jiajun Chen , Alexandra Birch

Zero-shot neural machine translation is an attractive goal because of the high cost of obtaining data and building translation systems for new translation directions. However, previous papers have reported mixed success in zero-shot…

Computation and Language · Computer Science 2020-11-04 Annette Rios , Mathias Müller , Rico Sennrich

We frame the task of machine translation evaluation as one of scoring machine translation output with a sequence-to-sequence paraphraser, conditioned on a human reference. We propose training the paraphraser as a multilingual NMT system,…

Computation and Language · Computer Science 2020-10-29 Brian Thompson , Matt Post

While neural machine translation (NMT) is making good progress in the past two years, tens of millions of bilingual sentence pairs are needed for its training. However, human labeling is very costly. To tackle this training data bottleneck,…

Computation and Language · Computer Science 2016-11-02 Yingce Xia , Di He , Tao Qin , Liwei Wang , Nenghai Yu , Tie-Yan Liu , Wei-Ying Ma

It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, often requiring large amounts of auxiliary data to achieve competitive results. An effective method of generating auxiliary…

Computation and Language · Computer Science 2021-04-06 Lidia Kidane , Sachin Kumar , Yulia Tsvetkov

Current multimodal machine translation (MMT) systems rely on fully supervised data (i.e models are trained on sentences with their translations and accompanying images). However, this type of data is costly to collect, limiting the…

Computation and Language · Computer Science 2025-03-12 Matthieu Futeral , Cordelia Schmid , Benoît Sagot , Rachel Bawden

Multilingual neural machine translation (MNMT) trained in multiple language pairs has attracted considerable attention due to fewer model parameters and lower training costs by sharing knowledge among multiple languages. Nonetheless,…

Computation and Language · Computer Science 2022-07-21 Jian Yang , Yuwei Yin , Shuming Ma , Dongdong Zhang , Zhoujun Li , Furu Wei

While Active Learning (AL) techniques are explored in Neural Machine Translation (NMT), only a few works focus on tackling low annotation budgets where a limited number of sentences can get translated. Such situations are especially…

Computation and Language · Computer Science 2022-01-19 Sai Koneru , Danni Liu , Jan Niehues

End-to-end neural machine translation has overtaken statistical machine translation in terms of translation quality for some language pairs, specially those with large amounts of parallel data. Besides this palpable improvement, neural…

Computation and Language · Computer Science 2017-11-16 Cristina España-Bonet , Ádám Csaba Varga , Alberto Barrón-Cedeño , Josef van Genabith

Sequence-to-sequence neural translation models learn semantic and syntactic relations between sentence pairs by optimizing the likelihood of the target given the source, i.e., $p(y|x)$, an objective that ignores other potentially useful…

Computation and Language · Computer Science 2016-03-24 Jiwei Li , Dan Jurafsky

A good translation should not only translate the original content semantically, but also incarnate personal traits of the original text. For a real-world neural machine translation (NMT) system, these user traits (e.g., topic preference,…

Computation and Language · Computer Science 2021-06-14 Huan Lin , Liang Yao , Baosong Yang , Dayiheng Liu , Haibo Zhang , Weihua Luo , Degen Huang , Jinsong Su

An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use of the back-translations of the target-side monolingual data. The standard back-translation…

Computation and Language · Computer Science 2021-11-04 Idris Abdulmumin , Bashir Shehu Galadanci , Aliyu Garba

Exploiting a common language as an auxiliary for better translation has a long tradition in machine translation and lets supervised learning-based machine translation enjoy the enhancement delivered by the well-used pivot language in the…

Computation and Language · Computer Science 2020-10-12 Zuchao Li , Hai Zhao , Rui Wang , Masao Utiyama , Eiichiro Sumita

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

We investigate pivot-based translation between related languages in a low resource, phrase-based SMT setting. We show that a subword-level pivot-based SMT model using a related pivot language is substantially better than word and…

Computation and Language · Computer Science 2017-10-06 Anoop Kunchukuttan , Maulik Shah , Pradyot Prakash , Pushpak Bhattacharyya

Transferring representations from large supervised tasks to downstream tasks has shown promising results in AI fields such as Computer Vision and Natural Language Processing (NLP). In parallel, the recent progress in Machine Translation…

Computation and Language · Computer Science 2018-09-14 Akiko Eriguchi , Melvin Johnson , Orhan Firat , Hideto Kazawa , Wolfgang Macherey

Neural translation models have proven to be effective in capturing sufficient information from a source sentence and generating a high-quality target sentence. However, it is not easy to get the best effect for bidirectional translation,…

Computation and Language · Computer Science 2020-11-25 Parnia Bahar , Christopher Brix , Hermann Ney

Unsupervised cross-lingual pretraining has achieved strong results in neural machine translation (NMT), by drastically reducing the need for large parallel data. Most approaches adapt masked-language modeling (MLM) to sequence-to-sequence…

Computation and Language · Computer Science 2021-06-11 Christos Baziotis , Ivan Titov , Alexandra Birch , Barry Haddow

Multimodal neural machine translation (NMT) has become an increasingly important area of research over the years because additional modalities, such as image data, can provide more context to textual data. Furthermore, the viability of…

Computation and Language · Computer Science 2020-10-20 Andrew Merritt , Chenhui Chu , Yuki Arase