English
Related papers

Related papers: Adaptation Algorithm and Theory Based on Generaliz…

200 papers

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

We present a novel instance-based approach to handle regression tasks in the context of supervised domain adaptation under an assumption of covariate shift. The approach developed in this paper is based on the assumption that the task on…

Machine Learning · Computer Science 2021-09-16 Antoine de Mathelin , Guillaume Richard , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

Domain adaptation arises as an important problem in statistical learning theory when the data-generating processes differ between training and test samples, respectively called source and target domains. Recent theoretical advances show…

Machine Learning · Statistics 2022-10-25 Mourad El Hamri , Younès Bennani , Issam Falih

Domain alignment is currently the most prevalent solution to unsupervised domain-adaptation tasks and are often being presented as minimizers of some theoretical upper-bounds on risk in the target domain. However, further works revealed…

Machine Learning · Computer Science 2021-09-17 Rodrigue Siry , Louis Hémadou , Loïc Simon , Frédéric Jurie

Object counting models suffer when deployed across domains with differing density variety, since density shifts are inherently task-relevant and violate standard domain adaptation assumptions. To address this, we propose a theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zhuonan Liang , Dongnan Liu , Jianan Fan , Yaxuan Song , Qiang Qu , Runnan Chen , Yu Yao , Peng Fu , Weidong Cai

Theoretically, domain adaptation is a well-researched problem. Further, this theory has been well-used in practice. In particular, we note the bound on target error given by Ben-David et al. (2010) and the well-known domain-aligning…

Machine Learning · Computer Science 2022-03-21 Anthony Sicilia , Xingchen Zhao , Seong Jae Hwang

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

Machine Learning · Computer Science 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains. Data augmentation approaches have emerged as a promising alternative for DG. However,…

Machine Learning · Computer Science 2020-12-29 Hoang Son Le , Rini Akmeliawati , Gustavo Carneiro

Selecting or designing an appropriate domain adaptation algorithm for a given problem remains challenging. This paper presents a Transformer model that can provably approximate and opt for domain adaptation methods for a given dataset in…

Machine Learning · Computer Science 2024-05-28 Ryuichiro Hataya , Kota Matsui , Masaaki Imaizumi

We reveal the incoherence between the widely-adopted empirical domain adversarial training and its generally-assumed theoretical counterpart based on $\mathcal{H}$-divergence. Concretely, we find that $\mathcal{H}$-divergence is not…

Machine Learning · Computer Science 2020-07-31 Changjian Shui , Qi Chen , Jun Wen , Fan Zhou , Christian Gagné , Boyu Wang

We propose a simple neural network model to deal with the domain adaptation problem in object recognition. Our model incorporates the Maximum Mean Discrepancy (MMD) measure as a regularization in the supervised learning to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Muhammad Ghifary , W. Bastiaan Kleijn , Mengjie Zhang

Transfer learning is known to perform efficiently in many applications empirically, yet limited literature reports the mechanism behind the scene. This study establishes both formal derivations and heuristic analysis to formulate the theory…

Machine Learning · Computer Science 2023-05-10 Huan-Hsin Tseng , Hsin-Yi Lin , Kuo-Hsuan Hung , Yu Tsao

Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. The hope is that the…

Machine Learning · Computer Science 2019-05-31 Han Zhao , Remi Tachet des Combes , Kun Zhang , Geoffrey J. Gordon

Domain shift remains a key challenge in deploying machine learning models to the real world. Unsupervised domain adaptation (UDA) aims to address this by minimising domain discrepancy during training, but the discrepancy estimates suffer…

Machine Learning · Computer Science 2026-05-07 Andrea Napoli , Paul White

Unsupervised domain adaptation (UDA) plays a crucial role in addressing distribution shifts in machine learning. In this work, we improve the theoretical foundations of UDA proposed in Acuna et al. (2021) by refining their…

Machine Learning · Statistics 2024-10-29 Ziqiao Wang , Yongyi Mao

The vast majority of existing algorithms for unsupervised domain adaptation (UDA) focus on adapting from a labeled source domain to an unlabeled target domain directly in a one-off way. Gradual domain adaptation (GDA), on the other hand,…

Machine Learning · Computer Science 2022-07-11 Haoxiang Wang , Bo Li , Han Zhao

Standard domain adaptation methods do not work well when a large gap exists between the source and target domains. Gradual domain adaptation is one of the approaches used to address the problem. It involves leveraging the intermediate…

Machine Learning · Statistics 2024-01-24 Shogo Sagawa , Hideitsu Hino

Domain adaptation problems arise in a variety of applications, where a training dataset from the \textit{source} domain and a test dataset from the \textit{target} domain typically follow different distributions. The primary difficulty in…

Machine Learning · Computer Science 2017-08-11 Wenhao Jiang , Cheng Deng , Wei Liu , Feiping Nie , Fu-lai Chung , Heng Huang

Learning generalizable visual representations across different embodied environments is essential for effective robotic manipulation in real-world scenarios. However, the limited scale and diversity of robot demonstration data pose a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiaming Zhou , Teli Ma , Kun-Yu Lin , Zifan Wang , Ronghe Qiu , Junwei Liang