English
Related papers

Related papers: PAC-Bayesian Domain Adaptation Bounds for Multi-vi…

200 papers

Symmetries are known to improve the empirical performance of machine learning models, yet theoretical guarantees explaining these gains remain limited. Prior work has focused mainly on compact group symmetries and often assumes that the…

Machine Learning · Computer Science 2025-10-21 Armin Beck , Peter Ochs

Object counting models suffer when deployed across domains with differing density variety, since density shifts are inherently task-relevant and violate standard domain adaptation assumptions. To address this, we propose a theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zhuonan Liang , Dongnan Liu , Jianan Fan , Yaxuan Song , Qiang Qu , Runnan Chen , Yu Yao , Peng Fu , Weidong Cai

Theoretically, domain adaptation is a well-researched problem. Further, this theory has been well-used in practice. In particular, we note the bound on target error given by Ben-David et al. (2010) and the well-known domain-aligning…

Machine Learning · Computer Science 2022-03-21 Anthony Sicilia , Xingchen Zhao , Seong Jae Hwang

Distance metric learning is an important component for many tasks, such as statistical classification and content-based image retrieval. Existing approaches for learning distance metrics from pairwise constraints typically suffer from two…

Machine Learning · Computer Science 2012-06-26 Liu Yang , Rong Jin , Rahul Sukthankar

Existing domain adaptation methods assume that domain discrepancies are caused by a few discrete attributes and variations, e.g., art, real, painting, quickdraw, etc. We argue that this is not realistic as it is implausible to define the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Yinsong Xu , Zhuqing Jiang , Aidong Men , Yang Liu , Qingchao Chen

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains. Data augmentation approaches have emerged as a promising alternative for DG. However,…

Machine Learning · Computer Science 2020-12-29 Hoang Son Le , Rini Akmeliawati , Gustavo Carneiro

Equivariant networks capture the inductive bias about the symmetry of the learning task by building those symmetries into the model. In this paper, we study how equivariance relates to generalization error utilizing PAC Bayesian analysis…

Machine Learning · Computer Science 2022-10-25 Arash Behboodi , Gabriele Cesa , Taco Cohen

We make three related contributions motivated by the challenge of training stochastic neural networks, particularly in a PAC-Bayesian setting: (1) we show how averaging over an ensemble of stochastic neural networks enables a new class of…

Machine Learning · Computer Science 2021-12-16 Felix Biggs , Benjamin Guedj

Domain adaptation (DA) addresses the challenge of transferring knowledge from a source domain to a target domain where image data distributions may differ. Existing DA methods often require access to source domain data, adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Debopom Sutradhar , Md. Abdur Rahman , Mohaimenul Azam Khan Raiaan , Reem E. Mohamed , Sami Azam

We present a new algorithm for domain adaptation improving upon a discrepancy minimization algorithm previously shown to outperform a number of algorithms for this task. Unlike many previous algorithms for domain adaptation, our algorithm…

Machine Learning · Computer Science 2015-02-24 Corinna Cortes , Mehryar Mohri , Andres Muñoz Medina

Person re-identification is a key technology for analyzing video-based human behavior; however, its application is still challenging in practical situations due to the performance degradation for domains different from those in the training…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 S. Takeuchi , F. Li , S. Iwasaki , J. Ning , G. Suzuki

PAC-Bayesian bounds have proven to be a valuable tool for deriving generalization bounds and for designing new learning algorithms in machine learning. However, it typically focus on providing generalization bounds with respect to a chosen…

Machine Learning · Statistics 2024-08-19 The Tien Mai

Despite remarkable success in a variety of applications, it is well-known that deep learning can fail catastrophically when presented with out-of-distribution data. Toward addressing this challenge, we consider the domain generalization…

Machine Learning · Statistics 2021-11-16 Alexander Robey , George J. Pappas , Hamed Hassani

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

Deep learning models such as convolutional neural networks and transformers have been widely applied to solve 3D object detection problems in the domain of autonomous driving. While existing models have achieved outstanding performance on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ruixiao Zhang , Juheon Lee , Xiaohao Cai , Adam Prugel-Bennett

Multi-distribution learning is a natural generalization of PAC learning to settings with multiple data distributions. There remains a significant gap between the known upper and lower bounds for PAC-learnable classes. In particular, though…

Machine Learning · Computer Science 2023-07-25 Pranjal Awasthi , Nika Haghtalab , Eric Zhao

Domain adaptation for semantic image segmentation is very necessary since manually labeling large datasets with pixel-level labels is expensive and time consuming. Existing domain adaptation techniques either work on limited datasets, or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Yunsheng Li , Lu Yuan , Nuno Vasconcelos

Semi-Supervised Domain Adaptation (SSDA) leverages knowledge from a fully labeled source domain to classify data in a partially labeled target domain. Due to the limited number of labeled samples in the target domain, there can be intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yuting Hong , Li Dong , Xiaojie Qiu , Hui Xiao , Baochen Yao , Siming Zheng , Chengbin Peng

Learning generalizable visual representations across different embodied environments is essential for effective robotic manipulation in real-world scenarios. However, the limited scale and diversity of robot demonstration data pose a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiaming Zhou , Teli Ma , Kun-Yu Lin , Zifan Wang , Ronghe Qiu , Junwei Liang

We study the problem of domain adaptation under distribution shift, where the shift is due to a change in the distribution of an unobserved, latent variable that confounds both the covariates and the labels. In this setting, neither the…