English
Related papers

Related papers: Finding Competence Regions in Domain Generalizatio…

200 papers

Domain adaption (DA) and domain generalization (DG) are two closely related methods which are both concerned with the task of assigning labels to an unlabeled data set. The only dissimilarity between these approaches is that DA can access…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

Two prevalent types of distributional shifts in machine learning are the covariate shift (as observed across different domains) and the semantic shift (as seen across different classes). Traditional OOD detection techniques typically…

Artificial Intelligence · Computer Science 2023-09-20 Haoliang Wang , Chen Zhao , Yunhui Guo , Kai Jiang , Feng Chen

Deep neural networks (DNNs) often suffer from the overconfidence issue, where incorrect predictions are made with high confidence scores, hindering the applications in critical systems. In this paper, we propose a novel approach called…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Yijun Liu , Jiequan Cui , Zhuotao Tian , Senqiao Yang , Qingdong He , Xiaoling Wang , Jingyong Su

Recommender systems use users' historical interactions to learn their preferences and deliver personalized recommendations from a vast array of candidate items. Current recommender systems primarily rely on the assumption that the training…

Information Retrieval · Computer Science 2024-04-24 Zhuhang Li , Ning Yang

Recent studies have addressed the concern of detecting and rejecting the out-of-distribution (OOD) samples as a major challenge in the safe deployment of deep learning (DL) models. It is desired that the DL model should only be confident…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Umar Khalid , Ashkan Esmaeili , Nazmul Karim , Nazanin Rahnavard

Domain generalization (DG) aims to learn models that perform well on unseen target domains by training on multiple source domains. Sharpness-Aware Minimization (SAM), known for finding flat minima that improve generalization, has therefore…

Machine Learning · Statistics 2025-07-01 Youngjun Song , Youngsik Hwang , Jonghun Lee , Heechang Lee , Dong-Young Lim

Domain Generalization (DG) aims to resolve distribution shifts between source and target domains, and current DG methods are default to the setting that data from source and target domains share identical categories. Nevertheless, there…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zining Chen , Weiqiu Wang , Zhicheng Zhao , Fei Su , Aidong Men , Hongying Meng

During the past decade, deep neural networks have led to fast-paced progress and significant achievements in computer vision problems, for both academia and industry. Yet despite their success, state-of-the-art image classification…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Aristotelis Ballas , Christos Diou

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla

Machine learning algorithms have revolutionized different fields, including natural language processing, computer vision, signal processing, and medical data processing. Despite the excellent capabilities of machine learning algorithms in…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Gita Sarafraz , Armin Behnamnia , Mehran Hosseinzadeh , Ali Balapour , Amin Meghrazi , Hamid R. Rabiee

Domain generalization(DG) endeavors to develop robust models that possess strong generalizability while preserving excellent discriminability. Nonetheless, pivotal DG techniques tend to improve the feature generalizability by learning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shaocong Long , Qianyu Zhou , Chenhao Ying , Lizhuang Ma , Yuan Luo

Adversarial robustness continues to be a major challenge for deep learning. A core issue is that robustness to one type of attack often fails to transfer to other attacks. While prior work establishes a theoretical trade-off in robustness…

Machine Learning · Computer Science 2023-06-27 Adam Ibrahim , Charles Guille-Escuret , Ioannis Mitliagkas , Irina Rish , David Krueger , Pouya Bashivan

This study demonstrates that the modern generation of Large Language Models (LLMs, such as GPT-4) suffers from the same out-of-domain (OOD) performance gap observed in prior research on pre-trained Language Models (PLMs, such as BERT). We…

Computation and Language · Computer Science 2024-12-31 Dmitri Roussinov , Serge Sharoff , Nadezhda Puchnina

Change detection has essential significance for the region's development, in which pseudo-changes between bitemporal images induced by imaging environmental factors are key challenges. Existing transformation-based methods regard…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Qi Zang , Shuang Wang , Dong Zhao , Dou Quan , Yang Hu , Licheng Jiao

Due to the existence of dataset shifts, the distributions of data acquired from different working conditions show significant differences in real-world industrial applications, which leads to performance degradation of traditional machine…

Signal Processing · Electrical Eng. & Systems 2021-01-28 Huanjie Wang , Jie Tan , Xiwei Bai , Jiechao Yang

Domain generalization in medical image classification is an important problem for trustworthy machine learning to be deployed in healthcare. We find that existing approaches for domain generalization which utilize ground-truth abnormality…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Jupinder Parmar , Khaled Saab , Brian Pogatchnik , Daniel Rubin , Christopher Ré

Distribution shifts introduce uncertainty that undermines the robustness and generalization capabilities of machine learning models. While conventional wisdom suggests that learning causal-invariant representations enhances robustness to…

Machine Learning · Computer Science 2025-05-28 Abbavaram Gowtham Reddy , Celia Rubio-Madrigal , Rebekka Burkholz , Krikamol Muandet

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Domain generalization (DG) aims to generalize a model trained on multiple source (i.e., training) domains to a distributionally different target (i.e., test) domain. In contrast to the conventional DG that strictly requires the availability…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zijian Wang , Yadan Luo , Ruihong Qiu , Zi Huang , Mahsa Baktashmotlagh

We study the understanding of deep neural networks from the scope in which they are trained on. While the accuracy of these models is usually impressive on the aggregate level, they still make mistakes, sometimes on cases that appear to be…

Machine Learning · Computer Science 2023-12-12 Roozbeh Yousefzadeh