English
Related papers

Related papers: A New PAC-Bayesian Perspective on Domain Adaptatio…

200 papers

Multi-source domain adaptation aims at leveraging the knowledge from multiple tasks for predicting a related target domain. Hence, a crucial aspect is to properly combine different sources based on their relations. In this paper, we…

Machine Learning · Computer Science 2021-06-16 Changjian Shui , Zijian Li , Jiaqi Li , Christian Gagné , Charles Ling , Boyu Wang

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

Machine Learning · Computer Science 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

The primary objective of domain adaptation methods is to transfer knowledge from a source domain to a target domain that has similar but different data distributions. Thus, in order to correctly classify the unlabeled target domain samples,…

Machine Learning · Computer Science 2019-08-12 Rohith AP , Ambedkar Dukkipati , Gaurav Pandey

In this work, we present a method for unsupervised domain adaptation. Many adversarial learning methods train domain classifier networks to distinguish the features as either a source or target and train a feature generator network to mimic…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Kuniaki Saito , Kohei Watanabe , Yoshitaka Ushiku , Tatsuya Harada

Meta learning automatically infers an inductive bias, that includes the hyperparameter of the base-learning algorithm, by observing data from a finite number of related tasks. This paper studies PAC-Bayes bounds on meta generalization gap.…

Machine Learning · Computer Science 2022-06-14 Arezou Rezazadeh

One of the central problems in machine learning is domain adaptation. Unlike past theoretical work, we consider a new model for subpopulation shift in the input or representation space. In this work, we propose a provably effective…

Machine Learning · Computer Science 2021-07-21 Tianle Cai , Ruiqi Gao , Jason D. Lee , Qi Lei

Control policies from imitation learning can often fail to generalize to novel environments due to imperfect demonstrations or the inability of imitation learning algorithms to accurately infer the expert's policies. In this paper, we…

Robotics · Computer Science 2020-12-04 Allen Z. Ren , Sushant Veer , Anirudha Majumdar

We present a new framework for deriving bounds on the generalization bound of statistical learning algorithms from the perspective of online learning. Specifically, we construct an online learning game called the "generalization game",…

Machine Learning · Statistics 2024-10-18 Gábor Lugosi , Gergely Neu

Domain adaptation (DA) aims at transferring knowledge from a labeled source domain to an unlabeled target domain. Though many DA theories and algorithms have been proposed, most of them are tailored into classification settings and may fail…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Junguang Jiang , Yifei Ji , Ximei Wang , Yufeng Liu , Jianmin Wang , Mingsheng Long

Domain generalization approaches aim to learn a domain invariant prediction model for unknown target domains from multiple training source domains with different distributions. Significant efforts have recently been committed to broad…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Mohammad Mahfujur Rahman , Clinton Fookes , Sridha Sridharan

In this paper, we propose energy-based sample adaptation at test time for domain generalization. Where previous works adapt their models to target domains, we adapt the unseen target samples to source-trained models. To this end, we design…

Machine Learning · Computer Science 2023-02-23 Zehao Xiao , Xiantong Zhen , Shengcai Liao , Cees G. M. Snoek

As a more practical setting for unsupervised domain adaptation, Universal Domain Adaptation (UDA) is recently introduced, where the target label set is unknown. One of the big challenges in UDA is how to determine the common label set…

Artificial Intelligence · Computer Science 2020-10-13 Yueming Yin , Zhen Yang , Xiaofu Wu , Haifeng Hu

We develop an algorithm for adapting a semantic segmentation model that is trained using a labeled source domain to generalize well in an unlabeled target domain. A similar problem has been studied extensively in the unsupervised domain…

Machine Learning · Computer Science 2021-01-12 Serban Stan , Mohammad Rostami

Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Previous methods focus on learning domain-invariant features to decrease the discrepancy between the feature distributions…

Machine Learning · Computer Science 2021-06-30 Yuntao Du , Yinghao Chen , Fengli Cui , Xiaowen Zhang , Chongjun Wang

Domain adaptation (DA) attempts to transfer the knowledge from a labeled source domain to an unlabeled target domain that follows different distribution from the source. To achieve this, DA methods include a source classification objective…

Machine Learning · Computer Science 2021-12-10 Fangrui Lv , Jian Liang , Kaixiong Gong , Shuang Li , Chi Harold Liu , Han Li , Di Liu , Guoren Wang

Meta-learning can successfully acquire useful inductive biases from data. Yet, its generalization properties to unseen learning tasks are poorly understood. Particularly if the number of meta-training tasks is small, this raises concerns…

Machine Learning · Statistics 2021-06-21 Jonas Rothfuss , Vincent Fortuin , Martin Josifoski , Andreas Krause

Generalisation of deep neural networks becomes vulnerable when distribution shifts are encountered between train (source) and test (target) domain data. Few-shot domain adaptation mitigates this issue by adapting deep neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Youssef Dawoud , Gustavo Carneiro , Vasileios Belagiannis

In the unsupervised open set domain adaptation (UOSDA), the target domain contains unknown classes that are not observed in the source domain. Researchers in this area aim to train a classifier to accurately: 1) recognize unknown target…

Machine Learning · Computer Science 2020-06-24 Li Zhong , Zhen Fang , Feng Liu , Bo Yuan , Guangquan Zhang , Jie Lu

A learning method is self-certified if it uses all available data to simultaneously learn a predictor and certify its quality with a tight statistical certificate that is valid on unseen data. Recent work has shown that neural network…

Machine Learning · Computer Science 2021-12-13 Maria Perez-Ortiz , Omar Rivasplata , Emilio Parrado-Hernandez , Benjamin Guedj , John Shawe-Taylor

We develop a unified Data Processing Inequality PAC-Bayesian framework -- abbreviated DPI-PAC-Bayesian -- for deriving generalization error bounds in the supervised learning setting. By embedding the Data Processing Inequality (DPI) into…

Information Theory · Computer Science 2025-08-26 Muhan Guan , Farhad Farokhi , Jingge Zhu