English
Related papers

Related papers: Invariant Representation via Decoupling Style and …

200 papers

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Out-of-Distribution (OOD) detection requires sensitivity to subtle shifts without overreacting to natural In-Distribution (ID) diversity. However, from the viewpoint of detection granularity, global representation inevitably suppress local…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Wenrui Liu , Hong Chang , Ruibing Hou , Shiguang Shan , Xilin Chen

Machine learning models are vulnerable to Out-Of-Distribution (OOD) examples, and such a problem has drawn much attention. However, current methods lack a full understanding of different types of OOD data: there are benign OOD data that can…

Machine Learning · Computer Science 2023-04-11 Zhuo Huang , Xiaobo Xia , Li Shen , Bo Han , Mingming Gong , Chen Gong , Tongliang Liu

The automatic detection of skin diseases via dermoscopic images can improve the efficiency in diagnosis and help doctors make more accurate judgments. However, conventional skin disease recognition systems may produce high confidence for…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Zhongzheng Huang , Tao Wang , Yuanzheng Cai , Lingyu Liang

We consider the task of out-of-distribution (OOD) generalization, where the distribution shift is due to an unobserved confounder ($Z$) affecting both the covariates ($X$) and the labels ($Y$). This confounding introduces heterogeneity in…

Machine Learning · Computer Science 2025-08-14 Parjanya Prashant , Seyedeh Baharan Khatami , Bruno Ribeiro , Babak Salimi

Detecting out-of-distribution (OOD) data is critical for machine learning, be it for safety reasons or to enable open-ended learning. However, beyond mere detection, choosing an appropriate course of action typically hinges on the type of…

Machine Learning · Computer Science 2026-04-28 Achref Jaziri , Martin Rogmann , Martin Mundt , Visvanathan Ramesh

In recent years, machine learning models have achieved success based on the independently and identically distributed assumption. However, this assumption can be easily violated in real-world applications, leading to the Out-of-Distribution…

Machine Learning · Computer Science 2024-03-27 Yifan Hao , Yong Lin , Difan Zou , Tong Zhang

Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH) address this…

Machine Learning · Computer Science 2023-10-26 Zhuo Huang , Muyang Li , Li Shen , Jun Yu , Chen Gong , Bo Han , Tongliang Liu

Empirical risk minimization (ERM) is not robust to changes in the distribution of data. When the distribution of test data is different from that of training data, the problem is known as out-of-distribution generalization. Recently, two…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Shijian Xu

Generalization to out-of-distribution (OOD) data is a critical challenge in machine learning. Ensemble-based methods, like weight space ensembles that interpolate model parameters, have been shown to achieve superior OOD performance.…

Machine Learning · Computer Science 2024-07-16 Yong Lin , Lu Tan , Yifan Hao , Honam Wong , Hanze Dong , Weizhong Zhang , Yujiu Yang , Tong Zhang

This paper develops a new EiHi net to solve the out-of-distribution (OoD) generalization problem in deep learning. EiHi net is a model learning paradigm that can be blessed on any visual backbone. This paradigm can change the previous…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Qinglai Wei , Beiming Yuan , Diancheng Chen

This paper proposes a novel out-of-distribution (OOD) detection framework named MoodCat for image classifiers. MoodCat masks a random portion of the input image and uses a generative model to synthesize the masked image to a new image…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Yijun Yang , Ruiyuan Gao , Qiang Xu

We present a theory for the construction of out-of-distribution (OOD) detection features for neural networks. We introduce random features for OOD through a novel information-theoretic loss functional consisting of two terms, the first…

Machine Learning · Computer Science 2025-06-18 Sudeepta Mondal , Zhuolin Jiang , Ganesh Sundaramoorthi

Deep learning models are challenged by the distribution shift between the training data and test data. Recently, the large models pre-trained on diverse data have demonstrated unprecedented robustness to various distribution shifts.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Yao Xiao , Ziyi Tang , Pengxu Wei , Cong Liu , Liang Lin

Diffusion models have emerged as a key pillar of foundation models in visual domains. One of their critical applications is to universally solve different downstream inverse tasks via a single diffusion prior without re-training for each…

Machine Learning · Computer Science 2023-10-03 Morteza Mardani , Jiaming Song , Jan Kautz , Arash Vahdat

A major bottleneck in the real-world applications of machine learning models is their failure in generalizing to unseen domains whose data distribution is not i.i.d to the training domains. This failure often stems from learning…

Machine Learning · Computer Science 2021-09-28 Soroosh Shahtalebi , Jean-Christophe Gagnon-Audet , Touraj Laleh , Mojtaba Faramarzi , Kartik Ahuja , Irina Rish

Out-of-distribution (OOD) generalization deals with the prevalent learning scenario where test distribution shifts from training distribution. With rising application demands and inherent complexity, graph OOD problems call for specialized…

Machine Learning · Computer Science 2024-06-06 Xiner Li , Shurui Gui , Youzhi Luo , Shuiwang Ji

Encouraging progress has been made towards Visual Question Answering (VQA) in recent years, but it is still challenging to enable VQA models to adaptively generalize to out-of-distribution (OOD) samples. Intuitively, recompositions of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Jingjing Jiang , Ziyi Liu , Yifan Liu , Zhixiong Nan , Nanning Zheng

Despite notable advances in image denoising, existing models often struggle to generalize beyond in-distribution noise patterns, particularly when confronted with out-of-distribution (OOD) conditions characterized by spatially variant…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Dawei Zhang , Xiaojie Guo

Domain generalization aims to develop a model that can perform well on unseen target domains by learning from multiple source domains. However, recent-proposed domain generalization models usually rely on domain labels, which may not be…

Machine Learning · Computer Science 2024-06-11 Zongbin Wang , Bin Pan , Zhenwei Shi