English
Related papers

Related papers: Domain Robustness in Neural Machine Translation

200 papers

Statistical machine translation (SMT) systems perform poorly when it is applied to new target domains. Our goal is to explore domain adaptation approaches and techniques for improving the translation quality of domain-specific SMT systems.…

Computation and Language · Computer Science 2018-04-06 Longyue Wang

We consider two problems of NMT domain adaptation using meta-learning. First, we want to reach domain robustness, i.e., we want to reach high quality on both domains seen in the training data and unseen domains. Second, we want our systems…

Computation and Language · Computer Science 2022-10-05 Wen Lai , Jindřich Libovický , Alexander Fraser

Domain adaptation has been well-studied in supervised neural machine translation (SNMT). However, it has not been well-studied for unsupervised neural machine translation (UNMT), although UNMT has recently achieved remarkable results in…

Computation and Language · Computer Science 2020-05-06 Haipeng Sun , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao , Chenhui Chu

State-of-the-art neural machine translation (NMT) systems are data-hungry and perform poorly on new domains with no supervised data. As data collection is expensive and infeasible in many cases, domain adaptation methods are needed. In this…

Computation and Language · Computer Science 2020-06-09 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

Computation and Language · Computer Science 2016-12-22 Markus Freitag , Yaser Al-Onaizan

Neural machine translation (NMT) is a deep learning based approach for machine translation, which yields the state-of-the-art translation performance in scenarios where large-scale parallel corpora are available. Although the high-quality…

Computation and Language · Computer Science 2018-06-04 Chenhui Chu , Rui Wang

Multilingual Neural Machine Translation (MNMT) models leverage many language pairs during training to improve translation quality for low-resource languages by transferring knowledge from high-resource languages. We study the quality of a…

Computation and Language · Computer Science 2022-12-06 Miguel Rios , Raluca-Maria Chereji , Alina Secara , Dragos Ciobanu

The development of deep learning techniques has allowed Neural Machine Translation (NMT) models to become extremely powerful, given sufficient training data and training time. However, systems struggle when translating text from a new…

Computation and Language · Computer Science 2022-03-23 Danielle Saunders

It has been previously noted that neural machine translation (NMT) is very sensitive to domain shift. In this paper, we argue that this is a dual effect of the highly lexicalized nature of NMT, resulting in failure for sentences with large…

Computation and Language · Computer Science 2019-06-04 Junjie Hu , Mengzhou Xia , Graham Neubig , Jaime Carbonell

Machine translation systems are very sensitive to the domains they were trained on. Several domain adaptation techniques have been deeply studied. We propose a new technique for neural machine translation (NMT) that we call domain control…

Computation and Language · Computer Science 2017-09-13 Catherine Kobus , Josep Crego , Jean Senellart

Neural Machine Translation (NMT) models have been proved strong when translating clean texts, but they are very sensitive to noise in the input. Improving NMT models robustness can be seen as a form of "domain" adaption to noise. The…

Computation and Language · Computer Science 2019-11-12 Zhenhao Li , Lucia Specia

Recent literature has demonstrated the potential of multilingual Neural Machine Translation (mNMT) models. However, the most efficient models are not well suited to specialized industries. In these cases, internal data is scarce and…

Computation and Language · Computer Science 2022-10-28 Mathieu Grosso , Pirashanth Ratnamogan , Alexis Mathey , William Vanhuffel , Michael Fotso Fotso

Previous works mostly focus on either multilingual or multi-domain aspects of neural machine translation (NMT). This paper investigates whether the domain information can be transferred across languages on the composition of multi-domain…

Computation and Language · Computer Science 2022-10-24 Thuy-Trang Vu , Shahram Khadivi , Xuanli He , Dinh Phung , Gholamreza Haffari

We present an approach to neural machine translation (NMT) that supports multiple domains in a single model and allows switching between the domains when translating. The core idea is to treat text domains as distinct languages and use…

Computation and Language · Computer Science 2018-05-08 Sander Tars , Mark Fishel

Machine translation systems are vulnerable to domain mismatch, especially in a low-resource scenario. Out-of-domain translations are often of poor quality and prone to hallucinations, due to exposure bias and the decoder acting as a…

Computation and Language · Computer Science 2021-09-22 Nikolay Bogoychev , Pinzhen Chen

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

Neural Machine Translation (NMT) models are sensitive to small perturbations in the input. Robustness to such perturbations is typically measured using translation quality metrics such as BLEU on the noisy input. This paper proposes…

Computation and Language · Computer Science 2020-05-05 Xing Niu , Prashant Mathur , Georgiana Dinu , Yaser Al-Onaizan

Many works proposed methods to improve the performance of Neural Machine Translation (NMT) models in a domain/multi-domain adaptation scenario. However, an understanding of how NMT baselines represent text domain information internally is…

Computation and Language · Computer Science 2021-09-17 Maksym Del , Elizaveta Korotkova , Mark Fishel

Small perturbations in the input can severely distort intermediate representations and thus impact translation quality of neural machine translation (NMT) models. In this paper, we propose to improve the robustness of NMT models with…

Computation and Language · Computer Science 2018-05-17 Yong Cheng , Zhaopeng Tu , Fandong Meng , Junjie Zhai , Yang Liu

Neural Machine Translation (NMT) systems built on multilingual sequence-to-sequence Language Models (msLMs) fail to deliver expected results when the amount of parallel data for a language, as well as the language's representation in the…

‹ Prev 1 2 3 10 Next ›