English
Related papers

Related papers: Neural Machine Translation with Pivot Languages

200 papers

Recent years have witnessed the rapid advance in neural machine translation (NMT), the core of which lies in the encoder-decoder architecture. Inspired by the recent progress of large-scale pre-trained language models on machine translation…

Computation and Language · Computer Science 2021-06-28 Shuo Wang , Zhaopeng Tu , Zhixing Tan , Wenxuan Wang , Maosong Sun , Yang Liu

Neural Machine Translation (NMT) typically leverages monolingual data in training through backtranslation. We investigate an alternative simple method to use monolingual data for NMT training: We combine the scores of a pre-trained and…

Computation and Language · Computer Science 2019-01-25 Felix Stahlberg , James Cross , Veselin Stoyanov

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

Computation and Language · Computer Science 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Pivot language is employed as a way to solve the data sparseness problem in machine translation, especially when the data for a particular language pair does not exist. The combination of source-to-pivot and pivot-to-target translation…

Computation and Language · Computer Science 2015-12-02 Yiming Cui , Conghui Zhu , Xiaoning Zhu , Tiejun Zhao

In this paper, we explore alternative ways to train a neural machine translation system in a multi-domain scenario. We investigate data concatenation (with fine tuning), model stacking (multi-level fine tuning), data selection and…

Computation and Language · Computer Science 2018-11-21 Hassan Sajjad , Nadir Durrani , Fahim Dalvi , Yonatan Belinkov , Stephan Vogel

Neural Machine Translation (NMT) models achieve their best performance when large sets of parallel data are used for training. Consequently, techniques for augmenting the training set have become popular recently. One of these methods is…

Computation and Language · Computer Science 2019-09-10 Alberto Poncelas , Maja Popovic , Dimitar Shterionov , Gideon Maillette de Buy Wenniger , Andy Way

While Transformer-based neural machine translation (NMT) is very effective in high-resource settings, many languages lack the necessary large parallel corpora to benefit from it. In the context of low-resource (LR) MT between two…

Computation and Language · Computer Science 2024-06-19 Niyati Bafna , Philipp Koehn , David Yarowsky

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

When the amount of parallel sentences available to train a neural machine translation is scarce, a common practice is to generate new synthetic training samples from them. A number of approaches have been proposed to produce synthetic…

Computation and Language · Computer Science 2024-01-30 Víctor M. Sánchez-Cartagena , Miquel Esplà-Gomis , Juan Antonio Pérez-Ortiz , Felipe Sánchez-Martínez

Many valid translations exist for a given sentence, yet machine translation (MT) is trained with a single reference translation, exacerbating data sparsity in low-resource settings. We introduce Simulated Multiple Reference Training (SMRT),…

Computation and Language · Computer Science 2021-04-23 Huda Khayrallah , Brian Thompson , Matt Post , Philipp Koehn

Recently, neural machine translation (NMT) has been extended to multilinguality, that is to handle more than one translation direction with a single system. Multilingual NMT showed competitive performance against pure bilingual systems.…

Computation and Language · Computer Science 2018-06-22 Surafel M. Lakew , Mauro Cettolo , Marcello Federico

Zero-shot neural machine translation is an attractive goal because of the high cost of obtaining data and building translation systems for new translation directions. However, previous papers have reported mixed success in zero-shot…

Computation and Language · Computer Science 2020-11-04 Annette Rios , Mathias Müller , Rico Sennrich

Multilingual neural machine translation has shown the capability of directly translating between language pairs unseen in training, i.e. zero-shot translation. Despite being conceptually attractive, it often suffers from low output quality.…

Computation and Language · Computer Science 2021-07-02 Danni Liu , Jan Niehues , James Cross , Francisco Guzmán , Xian Li

Standard context-aware neural machine translation (NMT) typically relies on parallel document-level data, exploiting both source and target contexts. Concatenation-based approaches in particular, still a strong baseline for document-level…

Computation and Language · Computer Science 2024-02-12 Harritxu Gete , Thierry Etchegoyhen

A prerequisite for training corpus-based machine translation (MT) systems -- either Statistical MT (SMT) or Neural MT (NMT) -- is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT…

Computation and Language · Computer Science 2018-04-18 Alberto Poncelas , Dimitar Shterionov , Andy Way , Gideon Maillette de Buy Wenniger , Peyman Passban

In this paper, we explore a simple solution to "Multi-Source Neural Machine Translation" (MSNMT) which only relies on preprocessing a N-way multilingual corpus without modifying the Neural Machine Translation (NMT) architecture or training…

Computation and Language · Computer Science 2019-03-05 Raj Dabre , Fabien Cromieres , Sadao Kurohashi

Neural Machine Translation (MT) has radically changed the way systems are developed. A major difference with the previous generation (Phrase-Based MT) is the way monolingual target data, which often abounds, is used in these two paradigms.…

Computation and Language · Computer Science 2019-03-28 Franck Burlot , François Yvon

Multilingual machine translation has recently been in vogue given its potential for improving machine translation performance for low-resource languages via transfer learning. Empirical examinations demonstrating the success of existing…

Computation and Language · Computer Science 2020-05-13 Ion Madrazo Azpiazu , Maria Soledad Pera

Simultaneous machine translation (SiMT) aims to translate a continuous input text stream into another language with the lowest latency and highest quality possible. The translation thus has to start with an incomplete source text, which is…

Computation and Language · Computer Science 2020-10-14 Ozan Caglayan , Julia Ive , Veneta Haralampieva , Pranava Madhyastha , Loïc Barrault , Lucia Specia

Recently, numbers of works shows that the performance of neural machine translation (NMT) can be improved to a certain extent with using visual information. However, most of these conclusions are drawn from the analysis of experimental…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 ZhenHao Tang , XiaoBing Zhang , Zi Long , XiangHua Fu