中文
相关论文

相关论文: Domain-Specific Risk Minimization for Out-of-Distr…

200 篇论文

A common explanation for the failure of deep networks to generalize out-of-distribution is that they fail to recover the "correct" features. We challenge this notion with a simple experiment which suggests that ERM already learns sufficient…

机器学习 · 计算机科学 2022-10-31 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

机器学习 · 统计学 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

As a recent noticeable topic, domain generalization aims to learn a generalizable model on multiple source domains, which is expected to perform well on unseen test domains. Great efforts have been made to learn domain-invariant features by…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Jianxin Lin , Yongqiang Tang , Junping Wang , Wensheng Zhang

Domain generalization (DG) aims to learn models that perform well on unseen target domains by training on multiple source domains. Sharpness-Aware Minimization (SAM), known for finding flat minima that improve generalization, has therefore…

机器学习 · 统计学 2025-07-01 Youngjun Song , Youngsik Hwang , Jonghun Lee , Heechang Lee , Dong-Young Lim

Domain adaptation aims to leverage a label-rich domain (the source domain) to help model learning in a label-scarce domain (the target domain). Most domain adaptation methods require the co-existence of source and target domain samples to…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Jiayi Tian , Jing Zhang , Wen Li , Dong Xu

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

机器学习 · 计算机科学 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

In the field of object detection, domain generalisation (DG) aims to ensure robust performance across diverse and unseen target domains by learning the robust domain-invariant features corresponding to the objects of interest across…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Shuvam Jena , Sushmetha Sumathi Rajendran , Karthik Seemakurthy , Sasithradevi A , Vijayalakshmi M , Prakash Poornachari

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

机器学习 · 计算机科学 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

While domain adaptation methods address data shifts, most assume target populations align with at least one source population, neglecting mixtures that combine sources influenced by factors like demographics. Additional challenges in…

统计方法学 · 统计学 2025-05-02 Keyao Zhan , Xin Xiong , Zijian Guo , Tianxi Cai , Molei Liu

Out-of-distribution (OOD) generalisation is challenging because it involves not only learning from empirical data, but also deciding among various notions of generalisation, e.g., optimising the average-case risk, worst-case risk, or…

机器学习 · 计算机科学 2024-05-31 Anurag Singh , Siu Lun Chau , Shahine Bouabid , Krikamol Muandet

Domain generalization (DG) aims to learn a generalized model to an unseen target domain using only limited source domains. Previous attempts to DG fail to learn domain-invariant representations only from the source domains due to the…

机器学习 · 计算机科学 2022-07-25 Junbum Cha , Kyungjae Lee , Sungrae Park , Sanghyuk Chun

Domain generalization aims to learn invariance across multiple training domains, thereby enhancing generalization against out-of-distribution data. While gradient or representation matching algorithms have achieved remarkable success, these…

机器学习 · 计算机科学 2024-06-17 Yuxin Dong , Tieliang Gong , Hong Chen , Shuangyong Song , Weizhan Zhang , Chen Li

Domain generalization (DG) methods aim to develop models that generalize to settings where the test distribution is different from the training data. In this paper, we focus on the challenging problem of multi-source zero shot DG (MDG),…

机器学习 · 计算机科学 2022-11-07 Kowshik Thopalli , Sameeksha Katoch , Pavan Turaga , Jayaraman J. Thiagarajan

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

机器学习 · 计算机科学 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

We consider a regression setting where observations are collected in different environments modeled by different data distributions. The field of out-of-distribution (OOD) generalization aims to design methods that generalize better to test…

机器学习 · 统计学 2026-03-12 Francesco Freni , Anya Fries , Linus Kühne , Markus Reichstein , Jonas Peters

We investigate the fundamental performance limitations of learning algorithms in several Domain Generalisation (DG) settings. Motivated by the difficulty with which previously proposed methods have in reliably outperforming Empirical Risk…

机器学习 · 统计学 2024-05-24 Henry Gouk , Ondrej Bohdal , Da Li , Timothy Hospedales

As the volume of data continues to expand, it becomes increasingly common for data to be aggregated from multiple sources. Leveraging multiple sources for model training typically achieves better predictive performance on test datasets.…

统计方法学 · 统计学 2025-03-05 Congbin Xu , Chengde Qian , Zhaojun Wang , Changliang Zou

This paper uses information-theoretic tools to analyze the generalization error in unsupervised domain adaptation (UDA). We present novel upper bounds for two notions of generalization errors. The first notion measures the gap between the…

机器学习 · 计算机科学 2023-03-03 Ziqiao Wang , Yongyi Mao

Domain adaptation is an important problem and often needed for real-world applications. In this problem, instead of i.i.d. training and testing datapoints, we assume that the source (training) data and the target (testing) data have…

机器学习 · 计算机科学 2022-03-15 A. Tuan Nguyen , Toan Tran , Yarin Gal , Philip H. S. Torr , Atılım Güneş Baydin

Supervised learning results typically rely on assumptions of i.i.d. data. Unfortunately, those assumptions are commonly violated in practice. In this work, we tackle such problem by focusing on domain generalization: a formalization where…

机器学习 · 计算机科学 2024-10-30 Isabela Albuquerque , João Monteiro , Mohammad Darvishi , Tiago H. Falk , Ioannis Mitliagkas