English
Related papers

Related papers: Incorporating Pre-training Data Matters in Unsuper…

200 papers

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Unsupervised Domain Adaptation (UDA) is a learning technique that transfers knowledge learned in the source domain from labelled training data to the target domain with only unlabelled data. It is of significant importance to medical image…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Lingrui Li , Yanfeng Zhou , Ge Yang

This paper uses information-theoretic tools to analyze the generalization error in unsupervised domain adaptation (UDA). We present novel upper bounds for two notions of generalization errors. The first notion measures the gap between the…

Machine Learning · Computer Science 2023-03-03 Ziqiao Wang , Yongyi Mao

Unsupervised domain adaptation (uDA) models focus on pairwise adaptation settings where there is a single, labeled, source and a single target domain. However, in many real-world settings one seeks to adapt to multiple, but somewhat…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Behnam Gholami , Pritish Sahu , Ognjen Rudovic , Konstantinos Bousmalis , Vladimir Pavlovic

We introduce an unsupervised domain adaption (UDA) strategy that combines multiple image translations, ensemble learning and self-supervised learning in one coherent approach. We focus on one of the standard tasks of UDA in which a semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Fabrizio J. Piva , Gijs Dubbelman

Arguably one of the top success stories of deep learning is transfer learning. The finding that pre-training a network on a rich source set (eg., ImageNet) can help boost performance once fine-tuned on a usually much smaller target set, has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Saining Xie , Jiatao Gu , Demi Guo , Charles R. Qi , Leonidas J. Guibas , Or Litany

Unsupervised domain adaptation (UDA) aims at adapting the model trained on a labeled source-domain dataset to an unlabeled target-domain dataset. The task of UDA on open-set person re-identification (re-ID) is even more challenging as the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yixiao Ge , Feng Zhu , Dapeng Chen , Rui Zhao , Xiaogang Wang , Hongsheng Li

Unsupervised domain adaptation (UDA) has been successfully applied to transfer knowledge from a labeled source domain to target domains without their labels. Recently introduced transferable prototypical networks (TPN) further addresses…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Fangxu Xing , Jia You , Jun Lu , C. -C. Jay Kuo , Georges El Fakhri , Jonghye Woo

The majority of existing Unsupervised Domain Adaptation (UDA) methods presumes source and target domain data to be simultaneously available during training. Such an assumption may not hold in practice, as source data is often inaccessible…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Waqar Ahmed , Pietro Morerio , Vittorio Murino

Enhancing model prediction confidence on target data is an important objective in Unsupervised Domain Adaptation (UDA). In this paper, we explore adversarial training on penultimate activations, i.e., input features of the final linear…

Machine Learning · Computer Science 2023-02-28 Tao Sun , Cheng Lu , Haibin Ling

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Recent works have focused on source-free UDA, where only target data is available. This is challenging as models…

Machine Learning · Computer Science 2024-10-10 Chrisantus Eze , Christopher Crick

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

We consider unsupervised domain adaptation: given labelled examples from a source domain and unlabelled examples from a related target domain, the goal is to infer the labels of target examples. Under the assumption that features from…

Machine Learning · Statistics 2019-01-08 Jeroen Manders , Twan van Laarhoven , Elena Marchiori

Large pre-trained models are usually fine-tuned on downstream task data, and tested on unseen data. When the train and test data come from different domains, the model is likely to struggle, as it is not adapted to the test domain. We…

Computation and Language · Computer Science 2022-06-02 Omer Antverg , Eyal Ben-David , Yonatan Belinkov

Unsupervised Domain Adaptation (UDA) aims to align the labeled source distribution with the unlabeled target distribution to obtain domain invariant predictive models. However, the application of well-known UDA approaches does not…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Ankit Singh

Unsupervised Domain Adaptation (UDA) endeavors to bridge the gap between a model trained on a labeled source domain and its deployment in an unlabeled target domain. However, current high-performance models demand significant resources,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Minhee Cho , Hyesong Choi , Hayeon Jo , Dongbo Min

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

Current adversarial adaptation methods attempt to align the cross-domain features, whereas two challenges remain unsolved: 1) the conditional distribution mismatch and 2) the bias of the decision boundary towards the source domain. To solve…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Can Qin , Lichen Wang , Qianqian Ma , Yu Yin , Huan Wang , Yun Fu

Unsupervised domain adaptation (UDA) aims to transfer the knowledge from the labeled source domain to the unlabeled target domain. Existing self-training based UDA approaches assign pseudo labels for target data and treat them as ground…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Xiaoqing Guo , Chen Yang , Baopu Li , Yixuan Yuan

Heterogeneous unsupervised domain adaptation (HUDA) is the most challenging domain adaptation setting where the feature spaces of source and target domains are heterogeneous, and the target domain has only unlabeled data. Existing HUDA…

Machine Learning · Computer Science 2024-02-01 Junki Mori , Ryo Furukawa , Isamu Teranishi , Jun Sakuma