English
Related papers

Related papers: Domain-Specific Risk Minimization for Out-of-Distr…

200 papers

A common explanation for the failure of deep networks to generalize out-of-distribution is that they fail to recover the "correct" features. We challenge this notion with a simple experiment which suggests that ERM already learns sufficient…

Machine Learning · Computer Science 2022-10-31 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

As a recent noticeable topic, domain generalization aims to learn a generalizable model on multiple source domains, which is expected to perform well on unseen test domains. Great efforts have been made to learn domain-invariant features by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jianxin Lin , Yongqiang Tang , Junping Wang , Wensheng Zhang

Domain generalization (DG) aims to learn models that perform well on unseen target domains by training on multiple source domains. Sharpness-Aware Minimization (SAM), known for finding flat minima that improve generalization, has therefore…

Machine Learning · Statistics 2025-07-01 Youngjun Song , Youngsik Hwang , Jonghun Lee , Heechang Lee , Dong-Young Lim

Domain adaptation aims to leverage a label-rich domain (the source domain) to help model learning in a label-scarce domain (the target domain). Most domain adaptation methods require the co-existence of source and target domain samples to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Jiayi Tian , Jing Zhang , Wen Li , Dong Xu

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

In the field of object detection, domain generalisation (DG) aims to ensure robust performance across diverse and unseen target domains by learning the robust domain-invariant features corresponding to the objects of interest across…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shuvam Jena , Sushmetha Sumathi Rajendran , Karthik Seemakurthy , Sasithradevi A , Vijayalakshmi M , Prakash Poornachari

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

Machine Learning · Computer Science 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

While domain adaptation methods address data shifts, most assume target populations align with at least one source population, neglecting mixtures that combine sources influenced by factors like demographics. Additional challenges in…

Methodology · Statistics 2025-05-02 Keyao Zhan , Xin Xiong , Zijian Guo , Tianxi Cai , Molei Liu

Out-of-distribution (OOD) generalisation is challenging because it involves not only learning from empirical data, but also deciding among various notions of generalisation, e.g., optimising the average-case risk, worst-case risk, or…

Machine Learning · Computer Science 2024-05-31 Anurag Singh , Siu Lun Chau , Shahine Bouabid , Krikamol Muandet

Domain generalization (DG) aims to learn a generalized model to an unseen target domain using only limited source domains. Previous attempts to DG fail to learn domain-invariant representations only from the source domains due to the…

Machine Learning · Computer Science 2022-07-25 Junbum Cha , Kyungjae Lee , Sungrae Park , Sanghyuk Chun

Domain generalization aims to learn invariance across multiple training domains, thereby enhancing generalization against out-of-distribution data. While gradient or representation matching algorithms have achieved remarkable success, these…

Machine Learning · Computer Science 2024-06-17 Yuxin Dong , Tieliang Gong , Hong Chen , Shuangyong Song , Weizhan Zhang , Chen Li

Domain generalization (DG) methods aim to develop models that generalize to settings where the test distribution is different from the training data. In this paper, we focus on the challenging problem of multi-source zero shot DG (MDG),…

Machine Learning · Computer Science 2022-11-07 Kowshik Thopalli , Sameeksha Katoch , Pavan Turaga , Jayaraman J. Thiagarajan

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

Machine Learning · Computer Science 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

We consider a regression setting where observations are collected in different environments modeled by different data distributions. The field of out-of-distribution (OOD) generalization aims to design methods that generalize better to test…

Machine Learning · Statistics 2026-03-12 Francesco Freni , Anya Fries , Linus Kühne , Markus Reichstein , Jonas Peters

We investigate the fundamental performance limitations of learning algorithms in several Domain Generalisation (DG) settings. Motivated by the difficulty with which previously proposed methods have in reliably outperforming Empirical Risk…

Machine Learning · Statistics 2024-05-24 Henry Gouk , Ondrej Bohdal , Da Li , Timothy Hospedales

As the volume of data continues to expand, it becomes increasingly common for data to be aggregated from multiple sources. Leveraging multiple sources for model training typically achieves better predictive performance on test datasets.…

Methodology · Statistics 2025-03-05 Congbin Xu , Chengde Qian , Zhaojun Wang , Changliang Zou

This paper uses information-theoretic tools to analyze the generalization error in unsupervised domain adaptation (UDA). We present novel upper bounds for two notions of generalization errors. The first notion measures the gap between the…

Machine Learning · Computer Science 2023-03-03 Ziqiao Wang , Yongyi Mao

Domain adaptation is an important problem and often needed for real-world applications. In this problem, instead of i.i.d. training and testing datapoints, we assume that the source (training) data and the target (testing) data have…

Machine Learning · Computer Science 2022-03-15 A. Tuan Nguyen , Toan Tran , Yarin Gal , Philip H. S. Torr , Atılım Güneş Baydin

Supervised learning results typically rely on assumptions of i.i.d. data. Unfortunately, those assumptions are commonly violated in practice. In this work, we tackle such problem by focusing on domain generalization: a formalization where…

Machine Learning · Computer Science 2024-10-30 Isabela Albuquerque , João Monteiro , Mohammad Darvishi , Tiago H. Falk , Ioannis Mitliagkas