English
Related papers

Related papers: Multi-Domain Neural Machine Translation

200 papers

Neural Machine Translation (NMT) methodologies have burgeoned from using simple feed-forward architectures to the state of the art; viz. BERT model. The use cases of NMT models have been broadened from just language translations to…

Computation and Language · Computer Science 2024-09-05 Rohan Jagtap , Sudhir N. Dhage

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

Computation and Language · Computer Science 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Recently, neural machine translation (NMT) has been extended to multilinguality, that is to handle more than one translation direction with a single system. Multilingual NMT showed competitive performance against pure bilingual systems.…

Computation and Language · Computer Science 2018-06-22 Surafel M. Lakew , Mauro Cettolo , Marcello Federico

Preservation of domain knowledge from the source to target is crucial in any translation workflow. It is common in the translation industry to receive highly specialized projects, where there is hardly any parallel in-domain data. In such…

Computation and Language · Computer Science 2022-09-15 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

In recent years, natural language processing (NLP) has got great development with deep learning techniques. In the sub-field of machine translation, a new approach named Neural Machine Translation (NMT) has emerged and got massive attention…

Computation and Language · Computer Science 2020-02-19 Shuoheng Yang , Yuxin Wang , Xiaowen Chu

Neural machine translation (NMT) is sensitive to domain shift. In this paper, we address this problem in an active learning setting where we can spend a given budget on translating in-domain data, and gradually fine-tune a pre-trained…

Computation and Language · Computer Science 2021-06-23 Junjie Hu , Graham Neubig

Despite the impressive quality improvements yielded by neural machine translation (NMT) systems, controlling their translation output to adhere to user-provided terminology constraints remains an open problem. We describe our approach to…

Computation and Language · Computer Science 2018-05-11 Eva Hasler , Adrià De Gispert , Gonzalo Iglesias , Bill Byrne

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

Statistical machine translation (SMT) systems perform poorly when it is applied to new target domains. Our goal is to explore domain adaptation approaches and techniques for improving the translation quality of domain-specific SMT systems.…

Computation and Language · Computer Science 2018-04-06 Longyue Wang

Machine translation (MT) systems, especially when designed for an industrial setting, are trained with general parallel data derived from the Web. Thus, their style is typically driven by word/structure distribution coming from the average…

Computation and Language · Computer Science 2021-02-23 Thuy Vu , Alessandro Moschitti

Machine translation (MT) systems translate text between different languages by automatically learning in-depth knowledge of bilingual lexicons, grammar and semantics from the training examples. Although neural machine translation (NMT) has…

Computation and Language · Computer Science 2020-04-29 Shilin He , Xing Wang , Shuming Shi , Michael R. Lyu , Zhaopeng Tu

Multilingual neural machine translation models (MNMT) yield state-of-the-art performance when evaluated on data from a domain and language pair seen at training time. However, when a MNMT model is used to translate under domain shift or to…

Computation and Language · Computer Science 2022-10-24 Wen Lai , Alexandra Chronopoulou , Alexander Fraser

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for…

Computation and Language · Computer Science 2022-01-06 Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei

Neural chat translation (NCT) aims to translate a cross-lingual chat between speakers of different languages. Existing context-aware NMT models cannot achieve satisfactory performances due to the following inherent problems: 1) limited…

Computation and Language · Computer Science 2023-01-30 Chulun Zhou , Yunlong Liang , Fandong Meng , Jie Zhou , Jinan Xu , Hongji Wang , Min Zhang , Jinsong Su

Pre-training and fine-tuning have achieved great success in the natural language process field. The standard paradigm of exploiting them includes two steps: first, pre-training a model, e.g. BERT, with a large scale unlabeled monolingual…

Computation and Language · Computer Science 2019-12-05 Rongxiang Weng , Heng Yu , Shujian Huang , Shanbo Cheng , Weihua Luo

Differently from the traditional statistical MT that decomposes the translation task into distinct separately learned components, neural machine translation uses a single neural network to model the entire translation process. Despite…

Computation and Language · Computer Science 2021-09-06 Elena Voita , Rico Sennrich , Ivan Titov

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

We consider two problems of NMT domain adaptation using meta-learning. First, we want to reach domain robustness, i.e., we want to reach high quality on both domains seen in the training data and unseen domains. Second, we want our systems…

Computation and Language · Computer Science 2022-10-05 Wen Lai , Jindřich Libovický , Alexander Fraser