English

On $f$-Divergence Principled Domain Adaptation: An Improved Framework

Machine Learning 2024-10-29 v2 Computer Vision and Pattern Recognition Machine Learning

Abstract

Unsupervised domain adaptation (UDA) plays a crucial role in addressing distribution shifts in machine learning. In this work, we improve the theoretical foundations of UDA proposed in Acuna et al. (2021) by refining their ff-divergence-based discrepancy and additionally introducing a new measure, ff-domain discrepancy (ff-DD). By removing the absolute value function and incorporating a scaling parameter, ff-DD obtains novel target error and sample complexity bounds, allowing us to recover previous KL-based results and bridging the gap between algorithms and theory presented in Acuna et al. (2021). Using a localization technique, we also develop a fast-rate generalization bound. Empirical results demonstrate the superior performance of ff-DD-based learning algorithms over previous works in popular UDA benchmarks.

Keywords

Cite

@article{arxiv.2402.01887,
  title  = {On $f$-Divergence Principled Domain Adaptation: An Improved Framework},
  author = {Ziqiao Wang and Yongyi Mao},
  journal= {arXiv preprint arXiv:2402.01887},
  year   = {2024}
}

Comments

Accepted at NeurIPS 2024

R2 v1 2026-06-28T14:36:43.082Z