English
Related papers

Related papers: Multilingual Neural Machine Translation with Task-…

200 papers

We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of…

Computation and Language · Computer Science 2016-01-07 Orhan Firat , Kyunghyun Cho , Yoshua Bengio

Multilingual Neural Machine Translation approaches are based on the use of task-specific models and the addition of one more language can only be done by retraining the whole system. In this work, we propose a new training schedule that…

Computation and Language · Computer Science 2019-07-12 Carlos Escolano , Marta R. Costa-Jussà , José A. R. Fonollosa

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

Computation and Language · Computer Science 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Massively multilingual models for neural machine translation (NMT) are theoretically attractive, but often underperform bilingual models and deliver poor zero-shot translations. In this paper, we explore ways to improve them. We argue that…

Computation and Language · Computer Science 2020-04-27 Biao Zhang , Philip Williams , Ivan Titov , Rico Sennrich

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

In state-of-the-art Neural Machine Translation (NMT), an attention mechanism is used during decoding to enhance the translation. At every step, the decoder uses this mechanism to focus on different parts of the source sentence to gather the…

Computation and Language · Computer Science 2018-05-31 Jean-Benoit Delbrouck , Stéphane Dupont

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

Computation and Language · Computer Science 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

The attention mechanism is an important part of the neural machine translation (NMT) where it was reported to produce richer source representation compared to fixed-length encoding sequence-to-sequence models. Recently, the effectiveness of…

Computation and Language · Computer Science 2016-09-14 Ozan Caglayan , Loïc Barrault , Fethi Bougares

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

Computation and Language · Computer Science 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Multilingual neural machine translation (NMT) enables training a single model that supports translation from multiple source languages into multiple target languages. In this paper, we push the limits of multilingual NMT in terms of number…

Computation and Language · Computer Science 2019-07-03 Roee Aharoni , Melvin Johnson , Orhan Firat

In recent years, Neural Machine Translation (NMT) has been shown to be more effective than phrase-based statistical methods, thus quickly becoming the state of the art in machine translation (MT). However, NMT systems are limited in…

Computation and Language · Computer Science 2019-09-17 Surafel M. Lakew , Marcello Federico , Matteo Negri , Marco Turchi

Multilingual Neural Machine Translation (NMT) models are capable of translating between multiple source and target languages. Despite various approaches to train such models, they have difficulty with zero-shot translation: translating…

Computation and Language · Computer Science 2019-03-19 Naveen Arivazhagan , Ankur Bapna , Orhan Firat , Roee Aharoni , Melvin Johnson , Wolfgang Macherey

Neural machine translation requires large amounts of parallel training text to learn a reasonable-quality translation model. This is particularly inconvenient for language pairs for which enough parallel text is not available. In this…

Computation and Language · Computer Science 2018-05-14 Poorya Zaremoodi , Gholamreza Haffari

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for…

Computation and Language · Computer Science 2022-01-06 Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei

Multi-source translation systems translate from multiple languages to a single target language. By using information from these multiple sources, these systems achieve large gains in accuracy. To train these systems, it is necessary to have…

Computation and Language · Computer Science 2018-11-09 Yuta Nishimura , Katsuhito Sudoh , Graham Neubig , Satoshi Nakamura

Multilingual Neural Machine Translation (NMT) enables one model to serve all translation directions, including ones that are unseen during training, i.e. zero-shot translation. Despite being theoretically attractive, current models often…

Computation and Language · Computer Science 2022-01-20 Yilin Yang , Akiko Eriguchi , Alexandre Muzio , Prasad Tadepalli , Stefan Lee , Hany Hassan

Multilingual neural machine translation (NMT) has recently been investigated from different aspects (e.g., pivot translation, zero-shot translation, fine-tuning, or training from scratch) and in different settings (e.g., rich resource and…

Computation and Language · Computer Science 2019-12-30 Xu Tan , Yichong Leng , Jiale Chen , Yi Ren , Tao Qin , Tie-Yan Liu

Multilingual neural machine translation can translate unseen language pairs during training, i.e. zero-shot translation. However, the zero-shot translation is always unstable. Although prior works attributed the instability to the…

Computation and Language · Computer Science 2022-09-12 Zhi Qu , Taro Watanabe

The attention mechanisim is appealing for neural machine translation, since it is able to dynam- ically encode a source sentence by generating a alignment between a target word and source words. Unfortunately, it has been proved to be worse…

Computation and Language · Computer Science 2016-09-15 Lemao Liu , Masao Utiyama , Andrew Finch , Eiichiro Sumita

Recently, neural machine translation (NMT) has been extended to multilinguality, that is to handle more than one translation direction with a single system. Multilingual NMT showed competitive performance against pure bilingual systems.…

Computation and Language · Computer Science 2018-06-22 Surafel M. Lakew , Mauro Cettolo , Marcello Federico
‹ Prev 1 2 3 10 Next ›