English
Related papers

Related papers: DaLC: Domain Adaptation Learning Curve Prediction …

200 papers

Neural machine translation (NMT) is a deep learning based approach for machine translation, which yields the state-of-the-art translation performance in scenarios where large-scale parallel corpora are available. Although the high-quality…

Computation and Language · Computer Science 2018-06-04 Chenhui Chu , Rui Wang

Neural networks are known to be data hungry and domain sensitive, but it is nearly impossible to obtain large quantities of labeled data for every domain we are interested in. This necessitates the use of domain adaptation strategies. One…

Computation and Language · Computer Science 2019-10-08 Zi-Yi Dou , Xinyi Wang , Junjie Hu , Graham Neubig

Meta-learning has been sufficiently validated to be beneficial for low-resource neural machine translation (NMT). However, we find that meta-trained NMT fails to improve the translation performance of the domain unseen at the meta-training…

Computation and Language · Computer Science 2021-03-04 Runzhe Zhan , Xuebo Liu , Derek F. Wong , Lidia S. Chao

Many of the world's languages have insufficient data to train high-performing general neural machine translation (NMT) models, let alone domain-specific models, and often the only available parallel data are small amounts of religious…

Computation and Language · Computer Science 2025-02-24 Ali Marashian , Enora Rice , Luke Gessler , Alexis Palmer , Katharina von der Wense

Machine reading comprehension (MRC) has become a core component in a variety of natural language processing (NLP) applications such as question answering and dialogue systems. It becomes a practical challenge that an MRC model needs to…

Information Retrieval · Computer Science 2020-08-26 Lixin Su , Jiafeng Guo , Ruqing Zhang , Yixing Fan , Yanyan Lan , Xueqi Cheng

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

Computation and Language · Computer Science 2016-12-22 Markus Freitag , Yaser Al-Onaizan

Recently, $k$NN-MT has shown the promising capability of directly incorporating the pre-trained neural machine translation (NMT) model with domain-specific token-level $k$-nearest-neighbor ($k$NN) retrieval to achieve domain adaptation…

Computation and Language · Computer Science 2022-05-26 Xin Zheng , Zhirui Zhang , Shujian Huang , Boxing Chen , Jun Xie , Weihua Luo , Jiajun Chen

Neural Machine Translation (NMT) systems built on multilingual sequence-to-sequence Language Models (msLMs) fail to deliver expected results when the amount of parallel data for a language, as well as the language's representation in the…

The development of deep learning techniques has allowed Neural Machine Translation (NMT) models to become extremely powerful, given sufficient training data and training time. However, systems struggle when translating text from a new…

Computation and Language · Computer Science 2022-03-23 Danielle Saunders

Recent literature has demonstrated the potential of multilingual Neural Machine Translation (mNMT) models. However, the most efficient models are not well suited to specialized industries. In these cases, internal data is scarce and…

Computation and Language · Computer Science 2022-10-28 Mathieu Grosso , Pirashanth Ratnamogan , Alexis Mathey , William Vanhuffel , Michael Fotso Fotso

This paper considers the unsupervised domain adaptation problem for neural machine translation (NMT), where we assume the access to only monolingual text in either the source or target language in the new domain. We propose a cross-lingual…

Computation and Language · Computer Science 2021-09-10 Thuy-Trang Vu , Xuanli He , Dinh Phung , Gholamreza Haffari

Domain alignment (DA) has been widely used in unsupervised domain adaptation. Many existing DA methods assume that a low source risk, together with the alignment of distributions of source and target, means a low target risk. In this paper,…

Machine Learning · Computer Science 2020-06-12 Yueming Yin , Zhen Yang , Haifeng Hu , Xiaofu Wu

Unsupervised domain adaption (UDA) aims to adapt models learned from a well-annotated source domain to a target domain, where only unlabeled samples are given. Current UDA approaches learn domain-invariant features by aligning source and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Chunjiang Ge , Rui Huang , Mixue Xie , Zihang Lai , Shiji Song , Shuang Li , Gao Huang

State-of-the-art neural machine translation (NMT) systems are data-hungry and perform poorly on new domains with no supervised data. As data collection is expensive and infeasible in many cases, domain adaptation methods are needed. In this…

Computation and Language · Computer Science 2020-06-09 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits

Domain adaptation has been well-studied in supervised neural machine translation (SNMT). However, it has not been well-studied for unsupervised neural machine translation (UNMT), although UNMT has recently achieved remarkable results in…

Computation and Language · Computer Science 2020-05-06 Haipeng Sun , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao , Chenhui Chu

Existing data augmentation approaches for neural machine translation (NMT) have predominantly relied on back-translating in-domain (IND) monolingual corpora. These methods suffer from issues associated with a domain information gap, which…

Computation and Language · Computer Science 2020-04-07 Wei Peng , Chongxuan Huang , Tianhao Li , Yun Chen , Qun Liu

Domain adaptation is a key feature in Machine Translation. It generally encompasses terminology, domain and style adaptation, especially for human post-editing workflows in Computer Assisted Translation (CAT). With Neural Machine…

Computation and Language · Computer Science 2016-12-20 Christophe Servan , Josep Crego , Jean Senellart

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

Previous studies on the domain adaptation for neural machine translation (NMT) mainly focus on the one-pass transferring out-of-domain translation knowledge to in-domain NMT model. In this paper, we argue that such a strategy fails to fully…

Computation and Language · Computer Science 2019-12-17 Jiali Zeng , Yang Liu , Jinsong Su , Yubin Ge , Yaojie Lu , Yongjing Yin , Jiebo Luo

Domain-adaptive pre-training (or DA-training for short), also known as post-training, aims to train a pre-trained general-purpose language model (LM) using an unlabeled corpus of a particular domain to adapt the LM so that end-tasks in the…

Computation and Language · Computer Science 2023-01-24 Zixuan Ke , Yijia Shao , Haowei Lin , Hu Xu , Lei Shu , Bing Liu
‹ Prev 1 2 3 10 Next ›