English
Related papers

Related papers: When Neural Networks Fail to Generalize? A Model S…

200 papers

Source-free domain adaptation (SFDA) aims to adapt a well-trained source model to an unlabelled target domain without accessing the source dataset, making it applicable in a variety of real-world scenarios. Existing SFDA methods ONLY assess…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Longxiang Tang , Kai Li , Chunming He , Yulun Zhang , Xiu Li

The goal of domain generalization (DG) is to enhance the generalization capability of the model learned from a source domain to other unseen domains. The recently developed Sharpness-Aware Minimization (SAM) method aims to achieve this goal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Pengfei Wang , Zhaoxiang Zhang , Zhen Lei , Lei Zhang

Domain Generalization (DG) aims to generalize to arbitrary unseen domains. A promising approach to improve model generalization in DG is the identification of flat minima. One typical method for this task is SWAD, which involves averaging…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

In Domain Generalization (DG) tasks, models are trained by using only training data from the source domains to achieve generalization on an unseen target domain, this will suffer from the distribution shift problem. So it's important to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Cheng Dai , Yingqiao Lin , Fan Li , Xiyao Li , Donglin Xie

We are concerned with learning models that generalize well to different \emph{unseen} domains. We consider a worst-case formulation over data distributions that are near the source domain in the feature space. Only using training data from…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Riccardo Volpi , Hongseok Namkoong , Ozan Sener , John Duchi , Vittorio Murino , Silvio Savarese

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

Federated Domain Generalization (FedDG) aims to train the global model for generalization ability to unseen domains with multi-domain training samples. However, clients in federated learning networks are often confined to a single, non-IID…

Artificial Intelligence · Computer Science 2024-09-24 Yuan Liu , Shu Wang , Zhe Qu , Xingyu Li , Shichao Kan , Jianxin Wang

We are concerned with a worst-case scenario in model generalization, in the sense that a model aims to perform well on many unseen domains while there is only one single domain available for training. We propose a new method named…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Fengchun Qiao , Long Zhao , Xi Peng

Deep neural networks have achieved impressive performance in a wide variety of medical imaging tasks. However, these models often fail on data not used during training, such as data originating from a different medical centre. How to…

Image and Video Processing · Electrical Eng. & Systems 2022-12-05 Joona Pohjonen , Carolin Stürenberg , Atte Föhr , Reija Randen-Brady , Lassi Luomala , Jouni Lohi , Esa Pitkänen , Antti Rannikko , Tuomas Mirtti

One of the main drawbacks of deep Convolutional Neural Networks (DCNN) is that they lack generalization capability. In this work, we focus on the problem of heterogeneous domain generalization which aims to improve the generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Yufei Wang , Haoliang Li , Alex C. Kot

Deep models trained on source domain lack generalization when evaluated on unseen target domains with different data distributions. The problem becomes even more pronounced when we have no access to target domain samples for adaptation. In…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Duo Peng , Yinjie Lei , Munawar Hayat , Yulan Guo , Wen Li

This paper introduces a concept of neural network specialization via task-specific domain constraining, aimed at enhancing network performance on data subspace in which the network operates. The study presents experiments on training…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Roman Malashin , Daniil Ilyukhin

Domain generalization (DG) is the problem of generalizing from several distributions (or domains), for which labeled training data are available, to a new test domain for which no labeled data is available. For the prevailing benchmark…

Machine Learning · Computer Science 2026-02-05 Yilun Zhu , Naihao Deng , Naichen Shi , Aditya Gangrade , Clayton Scott

Modern deep neural networks suffer from performance degradation when evaluated on testing data under different distributions from training data. Domain generalization aims at tackling this problem by learning transferable knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Qinwei Xu , Ruipeng Zhang , Ya Zhang , Yanfeng Wang , Qi Tian

Neural networks trained with SGD were recently shown to rely preferentially on linearly-predictive features and can ignore complex, equally-predictive ones. This simplicity bias can explain their lack of robustness out of distribution…

Machine Learning · Computer Science 2022-09-13 Damien Teney , Ehsan Abbasnejad , Simon Lucey , Anton van den Hengel

Single domain generalization aims to learn a model from a single training domain (source domain) and apply it to multiple unseen test domains (target domains). Existing methods focus on expanding the distribution of the training domain to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jin Chen , Zhi Gao , Xinxiao Wu , Jiebo Luo

Open-set single-source domain generalization aims to use a single-source domain to learn a robust model that can be generalized to unknown target domains with both domain shifts and label shifts. The scarcity of the source domain and the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Pengkun Jiao , Na Zhao , Jingjing Chen , Yu-Gang Jiang

Deep learning techniques often perform poorly in the presence of domain shift, where the test data follows a different distribution than the training data. The most practically desirable approach to address this issue is Single Domain…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 WeiQin Chuah , Ruwan Tennakoon , Reza Hoseinnezhad , David Suter , Alireza Bab-Hadiashar

Domain generalization (DG) has attracted much attention in person re-identification (ReID) recently. It aims to make a model trained on multiple source domains generalize to an unseen target domain. Although achieving promising progress,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Lei Qi , Jiaqi Liu , Lei Wang , Yinghuan Shi , Xin Geng

Domain Generalization (DG) aims to resolve distribution shifts between source and target domains, and current DG methods are default to the setting that data from source and target domains share identical categories. Nevertheless, there…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zining Chen , Weiqiu Wang , Zhicheng Zhao , Fei Su , Aidong Men , Hongying Meng