English
Related papers

Related papers: Domain Adaptation: Learning Bounds and Algorithms

200 papers

Unsupervised domain adaptation aims to generalize the supervised model trained on a source domain to an unlabeled target domain. Marginal distribution alignment of feature spaces is widely used to reduce the domain discrepancy between the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Pengfei Ge , Chuan-Xian Ren , Dao-Qing Dai , Hong Yan

Domain adaptation has received a lot of attention in recent years, and many algorithms have been proposed with impressive progress. However, it is still not fully explored concerning the joint probability distribution (P(X, Y)) distance for…

Machine Learning · Computer Science 2021-01-26 Wei Wang , Baopu Li , Shuhui Yang , Jing Sun , Zhengming Ding , Junyang Chen , Xiao Dong , Zhihui Wang , Haojie Li

Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain…

Machine Learning · Computer Science 2022-06-17 Wenyu Zhang , Mohamed Ragab , Chuan-Sheng Foo

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

The goal of domain generalization algorithms is to predict well on distributions different from those seen during training. While a myriad of domain generalization algorithms exist, inconsistencies in experimental conditions -- datasets,…

Machine Learning · Computer Science 2020-07-06 Ishaan Gulrajani , David Lopez-Paz

We present a novel instance-based approach to handle regression tasks in the context of supervised domain adaptation under an assumption of covariate shift. The approach developed in this paper is based on the assumption that the task on…

Machine Learning · Computer Science 2021-09-16 Antoine de Mathelin , Guillaume Richard , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

Domain adaptation (DA) is transfer learning which aims to leverage labeled data in a related source domain to achieve informed knowledge transfer and help the classification of unlabeled data in a target domain. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2017-05-25 Lingkun Luo , Xiaofang Wang , Shiqiang Hu , Liming Chen

This paper provides a theoretical analysis of domain adaptation based on the PAC-Bayesian theory. We propose an improvement of the previous domain adaptation bound obtained by Germain et al. in two ways. We first give another generalization…

Machine Learning · Statistics 2015-01-14 Pascal Germain , Amaury Habrard , Francois Laviolette , Emilie Morvant

We propose new bounds on the error of learning algorithms in terms of a data-dependent notion of complexity. The estimates we establish give optimal rates and are based on a local and empirical version of Rademacher averages, in the sense…

Statistics Theory · Mathematics 2007-06-13 Peter L. Bartlett , Olivier Bousquet , Shahar Mendelson

Domain adaptation aims to leverage a label-rich domain (the source domain) to help model learning in a label-scarce domain (the target domain). Most domain adaptation methods require the co-existence of source and target domain samples to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Jiayi Tian , Jing Zhang , Wen Li , Dong Xu

Robust domain adaptation against adversarial attacks is a critical research area that aims to develop models capable of maintaining consistent performance across diverse and challenging domains. In this paper, we derive a new generalization…

Artificial Intelligence · Computer Science 2025-05-13 Dongyoon Yang , Jihu Lee , Yongdai Kim

Federated learning improves data privacy and efficiency in machine learning performed over networks of distributed devices, such as mobile phones, IoT and wearable devices, etc. Yet models trained with federated learning can still fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xingchao Peng , Zijun Huang , Yizhe Zhu , Kate Saenko

In this paper, we propose to tackle the problem of reducing discrepancies between multiple domains referred to as multi-source domain adaptation and consider it under the target shift assumption: in all domains we aim to solve a…

Machine Learning · Statistics 2019-03-15 Ievgen Redko , Nicolas Courty , Rémi Flamary , Devis Tuia

Transferring reinforcement learning policies trained in physics simulation to the real hardware remains a challenge, known as the "sim-to-real" gap. Domain randomization is a simple yet effective technique to address dynamics discrepancies…

Robotics · Computer Science 2021-04-05 Ioannis Exarchos , Yifeng Jiang , Wenhao Yu , C. Karen Liu

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

Machine Learning · Computer Science 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

The ability to build a model on a source task and subsequently adapt such model on a new target task is a pervasive need in many astronomical applications. The problem is generally known as transfer learning in machine learning, where…

Machine Learning · Computer Science 2019-09-25 Ricardo Vilalta , Kinjal Dhar Gupta , Dainis Boumber , Mikhail M. Meskhi

Deep neural networks suffer from performance decay when there is domain shift between the labeled source domain and unlabeled target domain, which motivates the research on domain adaptation (DA). Conventional DA methods usually assume that…

Machine Learning · Computer Science 2020-02-10 Sicheng Zhao , Guangzhi Wang , Shanghang Zhang , Yang Gu , Yaxian Li , Zhichao Song , Pengfei Xu , Runbo Hu , Hua Chai , Kurt Keutzer

Natural language processing (NLP) algorithms are rapidly improving but often struggle when applied to out-of-distribution examples. A prominent approach to mitigate the domain gap is domain adaptation, where a model trained on a source…

Computation and Language · Computer Science 2022-09-05 Eyal Ben-David , Yftah Ziser , Roi Reichart

Multi-source domain adaptation aims to reduce performance degradation when applying machine learning models to unseen domains. A fundamental challenge is devising the optimal strategy for feature selection. Existing literature is somewhat…

Machine Learning · Statistics 2024-03-12 Ziliang Samuel Zhong , Xiang Pan , Qi Lei

In this paper, we aim to solve for unsupervised domain adaptation of classifiers where we have access to label information for the source domain while these are not available for a target domain. While various methods have been proposed for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Vinod Kumar Kurmi , Shanu Kumar , Vinay P Namboodiri