English
Related papers

Related papers: Exploring Flat Minima for Domain Generalization wi…

200 papers

Single Domain Generalization (SDG) tackles the problem of training a model on a single source domain so that it generalizes to any unseen target domain. While this has been well studied for image classification, the literature on SDG object…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Vidit Vidit , Martin Engilberge , Mathieu Salzmann

Information-theoretic (IT) generalization bounds have been used to study the generalization of learning algorithms. These bounds are intrinsically data- and algorithm-dependent so that one can exploit the properties of data and algorithm to…

Machine Learning · Computer Science 2026-01-06 Ze Peng , Jian Zhang , Yisen Wang , Lei Qi , Yinghuan Shi , Yang Gao

Domain generalization (DG) is a branch of transfer learning that aims to train the learning models on several seen domains and subsequently apply these pre-trained models to other unseen (unknown but related) domains. To deal with…

Machine Learning · Computer Science 2022-10-28 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

Learning in Deep Neural Networks (DNN) takes place by minimizing a non-convex high-dimensional loss function, typically by a stochastic gradient descent (SGD) strategy. The learning process is observed to be able to find good minimizers…

Machine Learning · Computer Science 2020-03-12 Carlo Baldassi , Fabrizio Pittorino , Riccardo Zecchina

In the field of object detection, domain generalisation (DG) aims to ensure robust performance across diverse and unseen target domains by learning the robust domain-invariant features corresponding to the objects of interest across…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shuvam Jena , Sushmetha Sumathi Rajendran , Karthik Seemakurthy , Sasithradevi A , Vijayalakshmi M , Prakash Poornachari

The single domain generalization(SDG) based on meta-learning has emerged as an effective technique for solving the domain-shift problem. However, the inadequate match of data distribution between source and augmented domains and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Can Sun , Hao Zheng , Zhigang Hu , Liu Yang , Meiguang Zheng , Bo Xu

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xin Zhang , Ying-Cong Chen

Point-cloud-based 3D object detection suffers from performance degradation when encountering data with novel domain gaps. To tackle it, the single-domain generalization (SDG) aims to generalize the detection model trained in a limited…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Shuangzhi Li , Lei Ma , Xingyu Li

Deep neural networks often suffer performance drops when test data distribution differs from training data. Domain Generalization (DG) aims to address this by focusing on domain-invariant features or augmenting data for greater diversity.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Nam Duong Tran , Nam Nguyen Phuong , Hieu H. Pham , Phi Le Nguyen , My T. Thai

The problem of domain generalization is to learn from multiple training domains, and extract a domain-agnostic model that can then be applied to an unseen domain. Domain generalization (DG) has a clear motivation in contexts where there are…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales

Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , Timothy M. Hospedales

Weight decay is often used to ensure good generalization in the training practice of deep neural networks with batch normalization (BN-DNNs), where some convolution layers are invariant to weight rescaling due to the normalization. In this…

Machine Learning · Computer Science 2022-06-22 Ziquan Liu , Yufei Cui , Jia Wan , Yu Mao , Antoni B. Chan

Medical imaging datasets usually exhibit domain shift due to the variations of scanner vendors, imaging protocols, etc. This raises the concern about the generalization capacity of machine learning models. Domain generalization (DG), which…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Chenxin Li , Qi Qi , Xinghao Ding , Yue Huang , Dong Liang , Yizhou Yu

Deep neural networks are often trained in the over-parametrized regime (i.e. with far more parameters than training examples), and understanding why the training converges to solutions that generalize remains an open problem. Several…

Machine Learning · Statistics 2018-03-23 Hartmut Maennel , Olivier Bousquet , Sylvain Gelly

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

Machine Learning · Computer Science 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

The backpropagation networks are notably susceptible to catastrophic forgetting, where networks tend to forget previously learned skills upon learning new ones. To address such the 'sensitivity-stability' dilemma, most previous efforts have…

Machine Learning · Computer Science 2021-10-12 Danruo Deng , Guangyong Chen , Jianye Hao , Qiong Wang , Pheng-Ann Heng

Deep Neural Networks (DNNs) suffer from domain shift when the test dataset follows a distribution different from the training dataset. Domain generalization aims to tackle this issue by learning a model that can generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yu Ding , Lei Wang , Bin Liang , Shuming Liang , Yang Wang , Fang Chen

Unarguably, deep learning models capable of generalizing to unseen domain data while leveraging a few labels are of great practical significance due to low developmental costs. In search of this endeavor, we study the challenging problem of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chamuditha Jayanaga Galappaththige , Zachary Izzo , Xilin He , Honglu Zhou , Muhammad Haris Khan

Domain generalization (DG) deals with the problem of domain shift where a machine learning model trained on multiple-source domains fail to generalize well on a target domain with different statistics. Multiple approaches have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP