English
Related papers

Related papers: Revisiting Simple Domain Adaptation Methods in Uns…

200 papers

Meta-learning has been sufficiently validated to be beneficial for low-resource neural machine translation (NMT). However, we find that meta-trained NMT fails to improve the translation performance of the domain unseen at the meta-training…

Computation and Language · Computer Science 2021-03-04 Runzhe Zhan , Xuebo Liu , Derek F. Wong , Lidia S. Chao

Despite the reported success of unsupervised machine translation (MT), the field has yet to examine the conditions under which these methods succeed, and where they fail. We conduct an extensive empirical evaluation of unsupervised MT using…

Computation and Language · Computer Science 2020-11-20 Kelly Marchisio , Kevin Duh , Philipp Koehn

We investigate techniques for supervised domain adaptation for neural machine translation where an existing model trained on a large out-of-domain dataset is adapted to a small in-domain dataset. In this scenario, overfitting is a major…

Computation and Language · Computer Science 2017-08-01 Antonio Valerio Miceli Barone , Barry Haddow , Ulrich Germann , Rico Sennrich

Unsupervised cross-lingual pretraining has achieved strong results in neural machine translation (NMT), by drastically reducing the need for large parallel data. Most approaches adapt masked-language modeling (MLM) to sequence-to-sequence…

Computation and Language · Computer Science 2021-06-11 Christos Baziotis , Ivan Titov , Alexandra Birch , Barry Haddow

Unsupervised domain adaptation aims to transfer knowledge from a source domain to a target domain so that the target domain data can be recognized without any explicit labelling information for this domain. One limitation of the problem…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Qian Wang , Penghui Bu , Toby P. Breckon

Supervised learning with large scale labeled datasets and deep layered models has made a paradigm shift in diverse areas in learning and recognition. However, this approach still suffers generalization issues under the presence of a domain…

Machine Learning · Statistics 2016-03-28 Ozan Sener , Hyun Oh Song , Ashutosh Saxena , Silvio Savarese

A novel approach for unsupervised domain adaptation for neural networks is proposed. It relies on metric-based regularization of the learning process. The metric-based regularization aims at domain-invariant latent feature representations…

In this paper, we focus on the domain-specific translation with low resources, where in-domain parallel corpora are scarce or nonexistent. One common and effective strategy for this case is exploiting in-domain monolingual data with the…

Computation and Language · Computer Science 2020-10-07 Hao-Ran Wei , Zhirui Zhang , Boxing Chen , Weihua Luo

Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by…

Machine Learning · Computer Science 2019-06-25 Jun Wen , Nenggan Zheng , Junsong Yuan , Zhefeng Gong , Changyou Chen

Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large-scale data annotation is costly and time-consuming. In semantic segmentation, it is attractive to train models…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Luke Melas-Kyriazi , Arjun K. Manrai

Neural Machine Translation (NMT) systems built on multilingual sequence-to-sequence Language Models (msLMs) fail to deliver expected results when the amount of parallel data for a language, as well as the language's representation in the…

Machine translation systems are vulnerable to domain mismatch, especially in a low-resource scenario. Out-of-domain translations are often of poor quality and prone to hallucinations, due to exposure bias and the decoder acting as a…

Computation and Language · Computer Science 2021-09-22 Nikolay Bogoychev , Pinzhen Chen

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

Machine Learning · Computer Science 2020-02-10 Garrett Wilson , Diane J. Cook

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2023-05-10 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Recently unsupervised domain adaptation for the semantic segmentation task has become more and more popular due to high-cost of pixel-level annotation on real-world images. However, most domain adaptation methods are only restricted to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Takashi Isobe , Xu Jia , Shuaijun Chen , Jianzhong He , Yongjie Shi , Jianzhuang Liu , Huchuan Lu , Shengjin Wang

Although deep neural networks have achieved remarkable results for the task of semantic segmentation, they usually fail to generalize towards new domains, especially when performing synthetic-to-real adaptation. Such domain shift is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Adriano Cardace , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

In this paper, we focus on a less explored, but more realistic and complex problem of domain adaptation in LiDAR semantic segmentation. There is a significant drop in performance of an existing segmentation model when training (source…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Mrigank Rochan , Shubhra Aich , Eduardo R. Corral-Soto , Amir Nabatchian , Bingbing Liu

Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the…

Machine Learning · Computer Science 2019-05-31 Mikołaj Bińkowski , R Devon Hjelm , Aaron Courville

Machine translation (MT) systems, especially when designed for an industrial setting, are trained with general parallel data derived from the Web. Thus, their style is typically driven by word/structure distribution coming from the average…

Computation and Language · Computer Science 2021-02-23 Thuy Vu , Alessandro Moschitti