English
Related papers

Related papers: Domain Differential Adaptation for Neural Machine …

200 papers

Domain adaptation methods reduce domain shift typically by learning domain-invariant features. Most existing methods are built on distribution matching, e.g., adversarial domain adaptation, which tends to corrupt feature discriminability.…

Machine Learning · Computer Science 2023-02-14 Zenan Huang , Jun Wen , Siheng Chen , Linchao Zhu , Nenggan Zheng

Domain adaptation (DA) aims to alleviate the domain shift between source domain and target domain. Most DA methods require access to the source data, but often that is not possible (e.g. due to data privacy or intellectual property). In…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Shiqi Yang , Yaxing Wang , Joost van de Weijer , Luis Herranz , Shangling Jui

Previous studies on the domain adaptation for neural machine translation (NMT) mainly focus on the one-pass transferring out-of-domain translation knowledge to in-domain NMT model. In this paper, we argue that such a strategy fails to fully…

Computation and Language · Computer Science 2019-12-17 Jiali Zeng , Yang Liu , Jinsong Su , Yubin Ge , Yaojie Lu , Yongjing Yin , Jiebo Luo

Partial Domain adaptation (PDA) aims to solve a more practical cross-domain learning problem that assumes target label space is a subset of source label space. However, the mismatched label space causes significant negative transfer. A…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jian Hu , Hongya Tuo , Shizhao Zhang , Chao Wang , Haowen Zhong , Zhikang Zou , Zhongliang Jing , Henry Leung , Ruping Zou

Domain adaptation (DA) tries to tackle the scenarios when the test data does not fully follow the same distribution of the training data, and multi-source domain adaptation (MSDA) is very attractive for real world applications. By learning…

Machine Learning · Computer Science 2024-01-17 Jin Yuan , Feng Hou , Yangzhou Du , Zhongchao Shi , Xin Geng , Jianping Fan , Yong Rui

In this work we explore Unsupervised Domain Adaptation (UDA) of pretrained language models for downstream tasks. We introduce UDALM, a fine-tuning procedure, using a mixed classification and Masked Language Model loss, that can adapt to the…

Computation and Language · Computer Science 2021-04-16 Constantinos Karouzos , Georgios Paraskevopoulos , Alexandros Potamianos

Unsupervised domain adaptation (UDA) is a statistical learning problem when the distribution of training (source) data is different from that of test (target) data. In this setting, one has access to labeled data only from the source domain…

Machine Learning · Computer Science 2026-02-24 Seonghwi Kim , Sung Ho Jo , Wooseok Ha , Minwoo Chae

Although current face anti-spoofing methods achieve promising results under intra-dataset testing, they suffer from poor generalization to unseen attacks. Most existing works adopt domain adaptation (DA) or domain generalization (DG)…

Computer Vision and Pattern Recognition · Computer Science 2021-02-25 Jingjing Wang , Jingyi Zhang , Ying Bian , Youyi Cai , Chunmao Wang , Shiliang Pu

Unsupervised domain adaptation aims at learning a shared model for two related, but not identical, domains by leveraging supervision from a source domain to an unsupervised target domain. A number of effective domain adaptation approaches…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Jinming Cao , Oren Katzir , Peng Jiang , Dani Lischinski , Danny Cohen-Or , Changhe Tu , Yangyan Li

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

The performance of a classifier trained on data coming from a specific domain typically degrades when applied to a related but different one. While annotating many samples from the new domain would address this issue, it is often too…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

This paper explores domain adaptation for enabling question answering (QA) systems to answer questions posed against documents in new specialized domains. Current QA systems using deep neural network (DNN) technology have proven effective…

Computation and Language · Computer Science 2019-11-11 Timothy J. Hazen , Shehzaad Dhuliawala , Daniel Boies

Unsupervised domain adaptation (UDA) is a technique used to transfer knowledge from a labeled source domain to a different but related unlabeled target domain. While many UDA methods have shown success in the past, they often assume that…

Machine Learning · Computer Science 2023-02-07 Yiling Liu , Juncheng Dong , Ziyang Jiang , Ahmed Aloui , Keyu Li , Hunter Klein , Vahid Tarokh , David Carlson

Recent deep learning methods for object detection rely on a large amount of bounding box annotations. Collecting these annotations is laborious and costly, yet supervised models do not generalize well when testing on images from a different…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Han-Kai Hsu , Chun-Han Yao , Yi-Hsuan Tsai , Wei-Chih Hung , Hung-Yu Tseng , Maneesh Singh , Ming-Hsuan Yang

The task of unsupervised domain adaptation is proposed to transfer the knowledge of a label-rich domain (source domain) to a label-scarce domain (target domain). Matching feature distributions between different domains is a widely applied…

Machine Learning · Computer Science 2018-12-19 Toshihiko Matsuura , Kuniaki Saito , Tatsuya Harada

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

Machine Learning · Computer Science 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan

We propose a simple domain adaptation method for neural networks in a supervised setting. Supervised domain adaptation is a way of improving the generalization performance on the target domain by using the source domain dataset, assuming…

Computation and Language · Computer Science 2016-07-05 Yusuke Watanabe , Kazuma Hashimoto , Yoshimasa Tsuruoka

Deep neural networks excel at learning from labeled data and achieve state-of-the-art resultson a wide array of Natural Language Processing tasks. In contrast, learning from unlabeled data, especially under domain shift, remains a…

Computation and Language · Computer Science 2020-10-29 Alan Ramponi , Barbara Plank

In unsupervised domain adaptation (UDA), directly adapting from the source to the target domain usually suffers significant discrepancies and leads to insufficient alignment. Thus, many UDA works attempt to vanish the domain gap gradually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Lin Chen , Zhixiang Wei , Xin Jin , Huaian Chen , Miao Zheng , Kai Chen , Yi Jin