English
Related papers

Related papers: Domain Control for Neural Machine Translation

200 papers

Recent advancements in neural machine translation (NMT) have revolutionized the field, yet the dependency on extensive parallel corpora limits progress for low-resource languages and domains. Cross-lingual transfer learning offers a…

Computation and Language · Computer Science 2024-09-24 Lia Shahnazaryan , Meriem Beloucif

Machine Translation models are trained to translate a variety of documents from one language into another. However, models specifically trained for a particular characteristics of the documents tend to perform better. Fine-tuning is a…

Computation and Language · Computer Science 2019-10-09 Alberto Poncelas , Gideon Maillette de Buy Wenniger , Andy Way

Translating text that diverges from the training domain is a key challenge for machine translation. Domain robustness---the generalization of models to unseen test domains---is low for both statistical (SMT) and neural machine translation…

Computation and Language · Computer Science 2020-09-28 Mathias Müller , Annette Rios , Rico Sennrich

Most data selection research in machine translation focuses on improving a single domain. We perform data selection for multiple domains at once. This is achieved by carefully introducing instance-level domain-relevance features and…

Computation and Language · Computer Science 2020-05-05 Wei Wang , Ye Tian , Jiquan Ngiam , Yinfei Yang , Isaac Caswell , Zarana Parekh

Preservation of domain knowledge from the source to target is crucial in any translation workflow. It is common in the translation industry to receive highly specialized projects, where there is hardly any parallel in-domain data. In such…

Computation and Language · Computer Science 2022-09-15 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Many works proposed methods to improve the performance of Neural Machine Translation (NMT) models in a domain/multi-domain adaptation scenario. However, an understanding of how NMT baselines represent text domain information internally is…

Computation and Language · Computer Science 2021-09-17 Maksym Del , Elizaveta Korotkova , Mark Fishel

The key challenge of multi-domain translation lies in simultaneously encoding both the general knowledge shared across domains and the particular knowledge distinctive to each domain in a unified model. Previous work shows that the standard…

Computation and Language · Computer Science 2019-11-25 Yong Wang , Longyue Wang , Shuming Shi , Victor O. K. Li , Zhaopeng Tu

Recently, $k$NN-MT has shown the promising capability of directly incorporating the pre-trained neural machine translation (NMT) model with domain-specific token-level $k$-nearest-neighbor ($k$NN) retrieval to achieve domain adaptation…

Computation and Language · Computer Science 2022-05-26 Xin Zheng , Zhirui Zhang , Shujian Huang , Boxing Chen , Jun Xie , Weihua Luo , Jiajun Chen

Multi-domain Neural Machine Translation (NMT) trains a single model with multiple domains. It is appealing because of its efficacy in handling multiple domains within one model. An ideal multi-domain NMT should learn distinctive domain…

Computation and Language · Computer Science 2022-10-25 Jiyoung Lee , Hantae Kim , Hyunchang Cho , Edward Choi , Cheonbok Park

Neural network methods exhibit strong performance only in a few resource-rich domains. Practitioners, therefore, employ domain adaptation from resource-rich domains that are, in most cases, distant from the target domain. Domain adaptation…

Computation and Language · Computer Science 2020-11-03 Shoetsu Sato , Jin Sakuma , Naoki Yoshinaga , Masashi Toyoda , Masaru Kitsuregawa

Neural machine translation (NMT) models learn representations containing substantial linguistic information. However, it is not clear if such information is fully distributed or if some of it can be attributed to individual neurons. We…

Computation and Language · Computer Science 2018-11-06 Anthony Bau , Yonatan Belinkov , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

Neural Machine Translation (NMT) models often lack diversity in their generated translations, even when paired with search algorithm, like beam search. A challenge is that the diversity in translations are caused by the variability in the…

Machine Learning · Computer Science 2020-09-22 Marie-Anne Lachaux , Armand Joulin , Guillaume Lample

In this paper, we explore alternative ways to train a neural machine translation system in a multi-domain scenario. We investigate data concatenation (with fine tuning), model stacking (multi-level fine tuning), data selection and…

Computation and Language · Computer Science 2018-11-21 Hassan Sajjad , Nadir Durrani , Fahim Dalvi , Yonatan Belinkov , Stephan Vogel

The recent advances introduced by neural machine translation (NMT) are rapidly expanding the application fields of machine translation, as well as reshaping the quality level to be targeted. In particular, if translations have to fit some…

Computation and Language · Computer Science 2019-10-28 Surafel Melaku Lakew , Mattia Di Gangi , Marcello Federico

Neural networks are known to be data hungry and domain sensitive, but it is nearly impossible to obtain large quantities of labeled data for every domain we are interested in. This necessitates the use of domain adaptation strategies. One…

Computation and Language · Computer Science 2019-10-08 Zi-Yi Dou , Xinyi Wang , Junjie Hu , Graham Neubig

Domain Adaptation is widely used in practical applications of neural machine translation, which aims to achieve good performance on both the general-domain and in-domain. However, the existing methods for domain adaptation usually suffer…

Computation and Language · Computer Science 2021-04-15 Shuhao Gu , Yang Feng , Wanying Xie

As neural machine translation (NMT) systems become an important part of professional translator pipelines, a growing body of work focuses on combining NMT with terminologies. In many scenarios and particularly in cases of domain adaptation,…

Neural machine translation (NMT) is sensitive to domain shift. In this paper, we address this problem in an active learning setting where we can spend a given budget on translating in-domain data, and gradually fine-tune a pre-trained…

Computation and Language · Computer Science 2021-06-23 Junjie Hu , Graham Neubig

Machine translation (MT) systems, especially when designed for an industrial setting, are trained with general parallel data derived from the Web. Thus, their style is typically driven by word/structure distribution coming from the average…

Computation and Language · Computer Science 2021-02-23 Thuy Vu , Alessandro Moschitti

We consider two problems of NMT domain adaptation using meta-learning. First, we want to reach domain robustness, i.e., we want to reach high quality on both domains seen in the training data and unseen domains. Second, we want our systems…

Computation and Language · Computer Science 2022-10-05 Wen Lai , Jindřich Libovický , Alexander Fraser