English
Related papers

Related papers: Domain Generalization without Excess Empirical Ris…

200 papers

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

Machine Learning · Computer Science 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

In this paper, we propose a novel domain generalization (DG) framework based on a new upper bound to the risk on the unseen domain. Particularly, our framework proposes to jointly minimize both the covariate-shift as well as the…

Machine Learning · Computer Science 2022-08-02 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

Domain Generalization (DG) aims to develop classifiers that can generalize to new, unseen data distributions, a critical capability when collecting new domain-specific data is impractical. A common DG baseline minimizes the empirical risk…

Machine Learning · Computer Science 2024-12-11 Piotr Teterwak , Kuniaki Saito , Theodoros Tsiligkaridis , Kate Saenko , Bryan A. Plummer

This paper focuses on the domain generalization task where domain knowledge is unavailable, and even worse, only samples from a single domain can be utilized during training. Our motivation originates from the recent progresses in deep…

Machine Learning · Computer Science 2022-03-08 Chris Xing Tian , Haoliang Li , Xiaofei Xie , Yang Liu , Shiqi Wang

The goal of domain generalization is to learn from multiple source domains to generalize to unseen target domains under distribution discrepancy. Current state-of-the-art methods in this area are fully supervised, but for many real-world…

Machine Learning · Computer Science 2020-10-01 Hossein Sharifi-Noghabi , Hossein Asghari , Nazanin Mehrasa , Martin Ester

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

Machine Learning · Computer Science 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales

Generalization capability to unseen domains is crucial for machine learning models when deploying to real-world conditions. We investigate the challenging problem of domain generalization, i.e., training a model on multi-domain source data…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Qi Dou , Daniel C. Castro , Konstantinos Kamnitsas , Ben Glocker

Domain generalization (DG) is the problem of generalizing from several distributions (or domains), for which labeled training data are available, to a new test domain for which no labeled data is available. For the prevailing benchmark…

Machine Learning · Computer Science 2026-02-05 Yilun Zhu , Naihao Deng , Naichen Shi , Aditya Gangrade , Clayton Scott

We propose to harness the potential of simulation for the semantic segmentation of real-world self-driving scenes in a domain generalization fashion. The segmentation network is trained without any data of target domains and tested on the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Xiangyu Yue , Yang Zhang , Sicheng Zhao , Alberto Sangiovanni-Vincentelli , Kurt Keutzer , Boqing Gong

We study the problem of out-of-distribution (o.o.d.) generalization where spurious correlations of attributes vary across training and test domains. This is known as the problem of correlation shift and has posed concerns on the reliability…

Machine Learning · Computer Science 2023-03-17 Yuhui Li , Zejia Wu , Chao Zhang , Hongyang Zhang

We propose $\textbf{UniDG}$, a novel and $\textbf{Uni}$fied framework for $\textbf{D}$omain $\textbf{G}$eneralization that is capable of significantly enhancing the out-of-distribution generalization performance of foundation models…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yiyuan Zhang , Kaixiong Gong , Xiaohan Ding , Kaipeng Zhang , Fangrui Lv , Kurt Keutzer , Xiangyu Yue

Domain generalization approaches aim to learn a domain invariant prediction model for unknown target domains from multiple training source domains with different distributions. Significant efforts have recently been committed to broad…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Mohammad Mahfujur Rahman , Clinton Fookes , Sridha Sridharan

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xin Zhang , Ying-Cong Chen

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of…

Machine Learning · Computer Science 2024-02-19 Sepidehsadat Hosseini , Mengyao Zhai , Hossein Hajimirsadegh , Frederick Tung

We investigate the fundamental performance limitations of learning algorithms in several Domain Generalisation (DG) settings. Motivated by the difficulty with which previously proposed methods have in reliably outperforming Empirical Risk…

Machine Learning · Statistics 2024-05-24 Henry Gouk , Ondrej Bohdal , Da Li , Timothy Hospedales

Despite being very powerful in standard learning settings, deep learning models can be extremely brittle when deployed in scenarios different from those on which they were trained. Domain generalization methods investigate this problem and…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Francesco Cappio Borlino , Antonio D'Innocente , Tatiana Tommasi

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

We are concerned with a worst-case scenario in model generalization, in the sense that a model aims to perform well on many unseen domains while there is only one single domain available for training. We propose Meta-Learning based…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Xi Peng , Fengchun Qiao , Long Zhao

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla