English
Related papers

Related papers: KL Guided Domain Adaptation

200 papers

A predictor, $f_A : X \to Y$, learned with data from a source domain (A) might not be accurate on a target domain (B) when their distributions are different. Domain adaptation aims to reduce the negative effects of this distribution…

Machine Learning · Computer Science 2022-01-17 Roberto Vega , Russell Greiner

Domain shift is a fundamental problem in visual recognition which typically arises when the source and target data follow different distributions. The existing domain adaptation approaches which tackle this problem work in the closed-set…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Yadan Luo , Zijian Wang , Zi Huang , Mahsa Baktashmotlagh

Most visual recognition methods implicitly assume the data distribution remains unchanged from training to testing. However, in practice domain shift often exists, where real-world factors such as lighting and sensor type change between…

Machine Learning · Computer Science 2015-07-30 Yongxin Yang , Timothy Hospedales

In real-world visual recognition problems, the assumption that the training data (source domain) and test data (target domain) are sampled from the same distribution is often violated. This is known as the domain adaptation problem. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Hongyu Xu , Jingjing Zheng , Azadeh Alavi , Rama Chellappa

Unlike human learning, machine learning often fails to handle changes between training (source) and test (target) input distributions. Such domain shifts, common in practical scenarios, severely damage the performance of conventional…

Computer Vision and Pattern Recognition · Computer Science 2015-12-10 Baochen Sun , Jiashi Feng , Kate Saenko

This paper addresses the problem of unsupervised domain adaption from theoretical and algorithmic perspectives. Existing domain adaptation theories naturally imply minimax optimization algorithms, which connect well with the domain…

Machine Learning · Computer Science 2019-07-24 Yuchen Zhang , Tianle Liu , Mingsheng Long , Michael I. Jordan

Training generative models to sample from unnormalized density functions is an important and challenging task in machine learning. Traditional training methods often rely on the reverse Kullback-Leibler (KL) divergence due to its…

Machine Learning · Computer Science 2025-03-05 Jiajun He , Wenlin Chen , Mingtian Zhang , David Barber , José Miguel Hernández-Lobato

Traditional machine learning algorithms assume that the training and test data have the same distribution, while this assumption does not necessarily hold in real applications. Domain adaptation methods take into account the deviations in…

Machine Learning · Statistics 2019-02-26 Elif Vural

Deep networks are prone to performance degradation when there is a domain shift between the source (training) data and target (test) data. Recent test-time adaptation methods update batch normalization layers of pre-trained source models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Wenyu Zhang , Li Shen , Wanyue Zhang , Chuan-Sheng Foo

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

Machine Learning · Statistics 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo

Domain adaptation aims at adapting the knowledge acquired on a source domain to a new different but related target domain. Several approaches have beenproposed for classification tasks in the unsupervised scenario, where no labeled target…

Computer Vision and Pattern Recognition · Computer Science 2015-04-30 Basura Fernando , Tatiana Tommasi , Tinne Tuytelaars

An important goal common to domain adaptation and causal inference is to make accurate predictions when the distributions for the source (or training) domain(s) and target (or test) domain(s) differ. In many cases, these different…

Machine Learning · Computer Science 2022-08-31 Sara Magliacane , Thijs van Ommen , Tom Claassen , Stephan Bongers , Philip Versteeg , Joris M. Mooij

This thesis contributes to the mathematical foundation of domain adaptation as emerging field in machine learning. In contrast to classical statistical learning, the framework of domain adaptation takes into account deviations between…

Machine Learning · Statistics 2020-04-23 Werner Zellinger

In this paper, we address the problem of unsupervised Domain Adaptation. The need for such an adaptation arises when the distribution of the target data differs from that which is used to develop the model and the ground truth information…

Machine Learning · Computer Science 2022-10-04 Siddharth Roheda , Ashkan Panahi , Hamid Krim

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

Machine Learning · Computer Science 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan

Unsupervised domain adaptation is used in many machine learning applications where, during training, a model has access to unlabeled data in the target domain, and a related labeled dataset. In this paper, we introduce a novel and general…

Machine Learning · Computer Science 2021-06-23 David Acuna , Guojun Zhang , Marc T. Law , Sanja Fidler

Domain Adaptation (DA) has recently received significant attention due to its potential to adapt a learning model across source and target domains with mismatched distributions. Since DA methods rely exclusively on the given source and…

Machine Learning · Statistics 2022-11-01 Akram S. Awad , George K. Atia

Domain adaptation refers to the learning scenario that a model learned from the source data is applied on the target data which have the same categories but different distribution. While it has been widely applied, the distribution…

Machine Learning · Computer Science 2020-10-13 Sitong Mao , Jiaxin Chen , Xiao Shen , Fu-lai Chung

We address the problem of unsupervised domain adaptation under the setting of generalized target shift (joint class-conditional and label shifts). For this framework, we theoretically show that, for good generalization, it is necessary to…

Machine Learning · Computer Science 2021-10-20 Alain Rakotomamonjy , Rémi Flamary , Gilles Gasso , Mokhtar Z. Alaya , Maxime Berar , Nicolas Courty

Domain adaptation techniques address the problem of reducing the sensitivity of machine learning methods to the so-called domain shift, namely the difference between source (training) and target (test) data distributions. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Pietro Morerio , Vittorio Murino