English
Related papers

Related papers: Iterative Dual Domain Adaptation for Neural Machin…

200 papers

While neural machine translation (NMT) is making good progress in the past two years, tens of millions of bilingual sentence pairs are needed for its training. However, human labeling is very costly. To tackle this training data bottleneck,…

Computation and Language · Computer Science 2016-11-02 Yingce Xia , Di He , Tao Qin , Liwei Wang , Nenghai Yu , Tie-Yan Liu , Wei-Ying Ma

Neural chat translation (NCT) aims to translate a cross-lingual chat between speakers of different languages. Existing context-aware NMT models cannot achieve satisfactory performances due to the following inherent problems: 1) limited…

Computation and Language · Computer Science 2023-01-30 Chulun Zhou , Yunlong Liang , Fandong Meng , Jie Zhou , Jinan Xu , Hongji Wang , Min Zhang , Jinsong Su

We investigate techniques for supervised domain adaptation for neural machine translation where an existing model trained on a large out-of-domain dataset is adapted to a small in-domain dataset. In this scenario, overfitting is a major…

Computation and Language · Computer Science 2017-08-01 Antonio Valerio Miceli Barone , Barry Haddow , Ulrich Germann , Rico Sennrich

Machine Translation models are trained to translate a variety of documents from one language into another. However, models specifically trained for a particular characteristics of the documents tend to perform better. Fine-tuning is a…

Computation and Language · Computer Science 2019-10-09 Alberto Poncelas , Gideon Maillette de Buy Wenniger , Andy Way

Preservation of domain knowledge from the source to target is crucial in any translation workflow. It is common in the translation industry to receive highly specialized projects, where there is hardly any parallel in-domain data. In such…

Computation and Language · Computer Science 2022-09-15 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Variational Neural Machine Translation (VNMT) is an attractive framework for modeling the generation of target translations, conditioned not only on the source sentence but also on some latent random variables. The latent variable modeling…

Computation and Language · Computer Science 2020-05-29 Hendra Setiawan , Matthias Sperber , Udhay Nallasamy , Matthias Paulik

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

Computation and Language · Computer Science 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Neural Machine Translation (NMT) is the task of translating a text from one language to another with the use of a trained neural network. Several existing works aim at incorporating external information into NMT models to improve or control…

Computation and Language · Computer Science 2024-04-30 Charles Brazier , Jean-Luc Rouas

$k$NN-MT is a straightforward yet powerful approach for fast domain adaptation, which directly plugs pre-trained neural machine translation (NMT) models with domain-specific token-level $k$-nearest-neighbor ($k$NN) retrieval to achieve…

Computation and Language · Computer Science 2023-02-24 Yuhan Dai , Zhirui Zhang , Qiuzhi Liu , Qu Cui , Weihua Li , Yichao Du , Tong Xu

Neural Machine Translation (NMT) systems built on multilingual sequence-to-sequence Language Models (msLMs) fail to deliver expected results when the amount of parallel data for a language, as well as the language's representation in the…

k-nearest-neighbor machine translation (NN-MT), proposed by Khandelwal et al. (2021), has achieved many state-of-the-art results in machine translation tasks. Although effective, NN-MT requires conducting NN searches through the large…

Computation and Language · Computer Science 2022-05-03 Zhixian Yang , Renliang Sun , Xiaojun Wan

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for…

Computation and Language · Computer Science 2022-01-06 Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

Unsupervised neural machine translation (UNMT) has recently achieved remarkable results for several language pairs. However, it can only translate between a single language pair and cannot produce translation results for multiple language…

Computation and Language · Computer Science 2020-04-22 Haipeng Sun , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao

Though remarkable successes have been achieved by Neural Machine Translation (NMT) in recent years, it still suffers from the inadequate-translation problem. Previous studies show that explicitly modeling the Past and Future contents of the…

Computation and Language · Computer Science 2020-07-20 Jianhao Yan , Fandong Meng , Jie Zhou

Many domain adaptation approaches rely on learning cross domain shared representations to transfer the knowledge learned in one domain to other domains. Traditional domain adaptation only considers adapting for one task. In this paper, we…

Computation and Language · Computer Science 2017-05-31 Nanyun Peng , Mark Dredze

Although neural machine translation (NMT) models perform well in the general domain, it remains rather challenging to control their generation behavior to satisfy the requirement of different users. Given the expensive training cost and the…

Computation and Language · Computer Science 2024-03-22 Yuzhuang Xu , Shuo Wang , Peng Li , Xuebo Liu , Xiaolong Wang , Weidong Liu , Yang Liu

Statistical machine translation (SMT) systems perform poorly when it is applied to new target domains. Our goal is to explore domain adaptation approaches and techniques for improving the translation quality of domain-specific SMT systems.…

Computation and Language · Computer Science 2018-04-06 Longyue Wang

Existing Neural Machine Translation (NMT) models mainly handle translation in the general domain, while overlooking domains with special writing formulas, such as e-commerce and legal documents. Taking e-commerce as an example, the texts…

Computation and Language · Computer Science 2024-04-09 Kaidi Chen , Ben Chen , Dehong Gao , Huangyu Dai , Wen Jiang , Wei Ning , Shanqing Yu , Libin Yang , Xiaoyan Cai