English
Related papers

Related papers: The UMD Neural Machine Translation Systems at WMT1…

200 papers

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of…

Computation and Language · Computer Science 2016-01-07 Orhan Firat , Kyunghyun Cho , Yoshua Bengio

In recent years, reinforcement learning and bandits have transformed a wide range of real-world applications including healthcare, finance, recommendation systems, robotics, and last but not least, the speech and natural language…

Artificial Intelligence · Computer Science 2023-10-20 Baihan Lin

We present an approach to neural machine translation (NMT) that supports multiple domains in a single model and allows switching between the domains when translating. The core idea is to treat text domains as distinct languages and use…

Computation and Language · Computer Science 2018-05-08 Sander Tars , Mark Fishel

Existing machine translation decoding algorithms generate translations in a strictly monotonic fashion and never revisit previous decisions. As a result, earlier mistakes cannot be corrected at a later stage. In this paper, we present a…

Computation and Language · Computer Science 2018-04-17 Roman Novak , Michael Auli , David Grangier

One of the vital breakthroughs in the history of machine translation is the development of the Transformer model. Not only it is revolutionary for various translation tasks, but also for a majority of other NLP tasks. In this paper, we aim…

Computation and Language · Computer Science 2022-09-29 Hassan Soliman

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

Computation and Language · Computer Science 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

This paper describes Oregon State University's submissions to the shared WMT'17 task "multimodal translation task I". In this task, all the sentence pairs are image captions in different languages. The key difference between this task and…

Computation and Language · Computer Science 2017-12-15 Mingbo Ma , Dapeng Li , Kai Zhao , Liang Huang

This paper describes the submission of LMU Munich to the WMT 2020 unsupervised shared task, in two language directions, German<->Upper Sorbian. Our core unsupervised neural machine translation (UNMT) system follows the strategy of…

Computation and Language · Computer Science 2020-10-27 Alexandra Chronopoulou , Dario Stojanovski , Viktor Hangya , Alexander Fraser

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the…

Computation and Language · Computer Science 2023-12-11 Ke Wang , Jun Xie , Yuqi Zhang , Yu Zhao

Building conversational speech recognition systems for new languages is constrained by the availability of utterances that capture user-device interactions. Data collection is both expensive and limited by the speed of manual transcription.…

Computation and Language · Computer Science 2019-12-03 Surabhi Punjabi , Harish Arsikere , Sri Garimella

Recent work achieved remarkable results in training neural machine translation (NMT) systems in a fully unsupervised way, with new and dedicated architectures that rely on monolingual corpora only. In this work, we propose to define…

Computation and Language · Computer Science 2018-10-31 Benjamin Marie , Atsushi Fujita

Machine translation (MT) systems, especially when designed for an industrial setting, are trained with general parallel data derived from the Web. Thus, their style is typically driven by word/structure distribution coming from the average…

Computation and Language · Computer Science 2021-02-23 Thuy Vu , Alessandro Moschitti

We present the results of the application of a grammatical test suite for German$\rightarrow$English MT on the systems submitted at WMT19, with a detailed analysis for 107 phenomena organized in 14 categories. The systems still translate…

Computation and Language · Computer Science 2019-10-17 Eleftherios Avramidis , Vivien Macketanz , Ursula Strohriegel , Hans Uszkoreit

Neural machine translation is a recently proposed approach to machine translation. Unlike the traditional statistical machine translation, the neural machine translation aims at building a single neural network that can be jointly tuned to…

Computation and Language · Computer Science 2016-05-23 Dzmitry Bahdanau , Kyunghyun Cho , Yoshua Bengio

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

We introduce our efforts towards building a universal neural machine translation (NMT) system capable of translating between any language pair. We set a milestone towards this goal by building a single massively multilingual NMT model…

We propose a method to transfer knowledge across neural machine translation (NMT) models by means of a shared dynamic vocabulary. Our approach allows to extend an initial model for a given language pair to cover new languages by adapting…

Computation and Language · Computer Science 2018-11-06 Surafel M. Lakew , Aliia Erofeeva , Matteo Negri , Marcello Federico , Marco Turchi

We consider two problems of NMT domain adaptation using meta-learning. First, we want to reach domain robustness, i.e., we want to reach high quality on both domains seen in the training data and unseen domains. Second, we want our systems…

Computation and Language · Computer Science 2022-10-05 Wen Lai , Jindřich Libovický , Alexander Fraser

Fine-tuning pre-trained Neural Machine Translation (NMT) models is the dominant approach for adapting to new languages and domains. However, fine-tuning requires adapting and maintaining a separate model for each target task. We propose a…

Computation and Language · Computer Science 2019-09-19 Ankur Bapna , Naveen Arivazhagan , Orhan Firat