English
Related papers

Related papers: ERM++: An Improved Baseline for Domain Generalizat…

200 papers

Given data from diverse sets of distinct distributions, domain generalization aims to learn models that generalize to unseen distributions. A common approach is designing a data-driven surrogate penalty to capture generalization and…

Machine Learning · Computer Science 2023-08-31 Ozan Sener , Vladlen Koltun

Domain Generalization (DG) aims to generalize a model trained on multiple source domains to an unseen target domain. The source domains always require precise annotations, which can be cumbersome or even infeasible to obtain in practice due…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Luojun Lin , Han Xie , Zhishu Sun , Weijie Chen , Wenxi Liu , Yuanlong Yu , Lei Zhang

In this paper, we study the generalization performance of global minima for implementing empirical risk minimization (ERM) on over-parameterized deep ReLU nets. Using a novel deepening scheme for deep ReLU nets, we rigorously prove that…

Machine Learning · Computer Science 2023-03-01 Shao-Bo Lin , Yao Wang , Ding-Xuan Zhou

Domain generalization (DG) is the problem of generalizing from several distributions (or domains), for which labeled training data are available, to a new test domain for which no labeled data is available. For the prevailing benchmark…

Machine Learning · Computer Science 2026-02-05 Yilun Zhu , Naihao Deng , Naichen Shi , Aditya Gangrade , Clayton Scott

Domain generalization (DG) is an important problem that learns a model which generalizes to unseen test domains leveraging one or more source domains, under the assumption of shared label spaces. However, most DG methods assume access to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Christopher Liao , Christian So , Theodoros Tsiligkaridis , Brian Kulis

Despite the huge effort in developing novel regularizers for Domain Generalization (DG), adding simple data augmentation to the vanilla ERM which is a practical implementation of the Vicinal Risk Minimization principle (VRM)…

Machine Learning · Computer Science 2023-12-12 Sobhan Hemati , Mahdi Beitollahi , Amir Hossein Estiri , Bassel Al Omari , Xi Chen , Guojun Zhang

Multi-domain generalization (mDG) is universally aimed to minimize the discrepancy between training and testing distributions to enhance marginal-to-label distribution mapping. However, existing mDG literature lacks a general learning…

Machine Learning · Computer Science 2024-12-19 Zhaorui Tan , Xi Yang , Kaizhu Huang

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla

Domain generalization aims to learn a predictive model from multiple different but related source tasks that can generalize well to a target task without the need of accessing any target data. Existing domain generalization methods ignore…

Machine Learning · Computer Science 2022-06-08 William Wei Wang , Gezheng Xu , Ruizhi Pu , Jiaqi Li , Fan Zhou , Changjian Shui , Charles Ling , Christian Gagné , Boyu Wang

Domain Generalization (DG) research has gained considerable traction as of late, since the ability to generalize to unseen data distributions is a requirement that eludes even state-of-the-art training algorithms. In this paper we observe…

Machine Learning · Computer Science 2025-07-22 Aristotelis Ballas , Christos Diou

Domain generalization aims at performing well on unseen test environments with data from a limited number of training environments. Despite a proliferation of proposal algorithms for this task, assessing their performance both theoretically…

Machine Learning · Computer Science 2021-11-24 Yining Chen , Elan Rosenfeld , Mark Sellke , Tengyu Ma , Andrej Risteski

This paper focuses on domain generalization (DG), the task of learning from multiple source domains a model that generalizes well to unseen domains. A main challenge for DG is that the available source domains often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Empirical risk minimization (ERM) is known in practice to be non-robust to distributional shift where the training and the test distributions are different. A suite of approaches, such as importance weighting, and variants of…

Machine Learning · Computer Science 2023-02-08 Runtian Zhai , Chen Dan , Zico Kolter , Pradeep Ravikumar

Domain Generalization (DG) aims to enhance model robustness in unseen or distributionally shifted target domains through training exclusively on source domains. Although existing DG techniques, such as data manipulation, learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hai Huang , Yan Xia , Sashuai Zhou , Hanting Wang , Shulei Wang , Zhou Zhao

While deep neural networks demonstrate state-of-the-art performance on a variety of learning tasks, their performance relies on the assumption that train and test distributions are the same, which may not hold in real-world applications.…

Machine Learning · Computer Science 2021-02-18 Wenyu Zhang , Mohamed Ragab , Ramon Sagarna

In Domain Generalization (DG) settings, models trained independently on a given set of training domains have notoriously chaotic performance on distribution shifted test domains, and stochasticity in optimization (e.g. seed) plays a big…

Machine Learning · Computer Science 2022-10-14 Devansh Arpit , Huan Wang , Yingbo Zhou , Caiming Xiong

Deep learning models often struggle to maintain performance when deployed on data distributions different from their training data, particularly in real-world applications where environmental conditions frequently change. While Multi-source…

Machine Learning · Computer Science 2025-05-30 Shohei Enomoto

Medical imaging datasets usually exhibit domain shift due to the variations of scanner vendors, imaging protocols, etc. This raises the concern about the generalization capacity of machine learning models. Domain generalization (DG), which…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Chenxin Li , Qi Qi , Xinghao Ding , Yue Huang , Dong Liang , Yizhou Yu

Handling out-of-distribution samples is a long-lasting challenge for deep visual models. In particular, domain generalization (DG) is one of the most relevant tasks that aims to train a model with a generalization capability on novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Sang-Yeong Jo , Sung Whan Yoon

Domain generalization (DG) enables generalizing a learning machine from multiple seen source domains to an unseen target one. The general objective of DG methods is to learn semantic representations that are independent of domain labels,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Chaoqi Chen , Luyao Tang , Feng Liu , Gangming Zhao , Yue Huang , Yizhou Yu