English
Related papers

Related papers: Invariant Representation via Decoupling Style and …

200 papers

Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of machine learning models. While effective for small models,…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Yong Lin , Renjie Pi , Weizhong Zhang , Renzhe Xu , Peng Cui , Tong Zhang

Existing vision-language model (VLM)-based methods for out-of-distribution (OOD) detection typically rely on similarity scores between input images and in-distribution (ID) text prototypes. However, the modality gap between image and text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yimu Wang , Evelien Riddell , Adrian Chow , Sean Sedwards , Krzysztof Czarnecki

Existing out-of-distribution (OOD) detection literature clearly defines semantic shift as a sign of OOD but does not have a consensus over covariate shift. Samples experiencing covariate shift but not semantic shift are either excluded from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jingkang Yang , Kaiyang Zhou , Ziwei Liu

The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

We present a new methodology for detecting out-of-distribution (OOD) images by utilizing norms of the score estimates at multiple noise scales. A score is defined to be the gradient of the log density with respect to the input data. Our…

Machine Learning · Computer Science 2021-03-24 Ahsan Mahmood , Junier Oliva , Martin Styner

Out-of-distribution (OOD) detection represents a critical challenge in remote sensing applications, where reliable identification of novel or anomalous patterns is essential for autonomous monitoring, disaster response, and environmental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Chenhao Wang , Yingrui Ji , Yu Meng , Yunjian Zhang , Yao Zhu

Out-of-distribution (OOD) detection is essential for ensuring the reliability of deep learning models in medical imaging applications. This work is motivated by the observation that class activation maps (CAMs) for in-distribution (ID) data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Yu-Jen Chen , Xueyang Li , Yiyu Shi , Tsung-Yi Ho

Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.e., In-Distribution (InD), or from OoD. Diffusion Models (DMs) are recently utilized in OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Kun Fang , Qinghua Tao , Zuopeng Yang , Xiaolin Huang , Jie Yang

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

In this paper, we focus on the out-of-distribution (OOD) generalization of self-supervised learning (SSL). By analyzing the mini-batch construction during the SSL training phase, we first give one plausible explanation for SSL having OOD…

Machine Learning · Computer Science 2025-05-23 Wenwen Qiang , Jingyao Wang , Zeen Song , Jiangmeng Li , Changwen Zheng

Out-of-distribution generalization under distributional shifts remains a critical challenge for graph neural networks. Existing methods generally adopt the Invariant Risk Minimization (IRM) framework, requiring costly environment…

Machine Learning · Computer Science 2025-10-24 Yang Qiu , Yixiong Zou , Jun Wang , Wei Liu , Xiangyu Fu , Ruixuan Li

The core of out-of-distribution (OOD) detection is to learn the in-distribution (ID) representation, which is distinguishable from OOD samples. Previous work applied recognition-based methods to learn the ID features, which tend to learn…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jingyao Li , Pengguang Chen , Shaozuo Yu , Zexin He , Shu Liu , Jiaya Jia

Out-of-distribution (OOD) detection aims to detect "unknown" data whose labels have not been seen during the in-distribution (ID) training process. Recent progress in representation learning gives rise to distance-based OOD detection that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ji Zhang , Lianli Gao , Bingguang Hao , Hao Huang , Jingkuan Song , Hengtao Shen

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Recent research underscores the pivotal role of the Out-of-Distribution (OOD) feature representation field scale in determining the efficacy of models in OOD detection. Consequently, the adoption of model ensembles has emerged as a…

Machine Learning · Computer Science 2024-08-19 Chenhui Xu , Fuxun Yu , Zirui Xu , Nathan Inkawhich , Xiang Chen

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we…

Machine Learning · Computer Science 2021-01-22 Haotian Ye , Chuanlong Xie , Yue Liu , Zhenguo Li

Existing image restoration models are typically designed for specific tasks and struggle to generalize to out-of-sample degradations not encountered during training. While zero-shot methods can address this limitation by fine-tuning model…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Runhua Jiang , Yahong Han

Out-of-distribution (OOD) detection remains a critical challenge in open-world learning, where models must adapt to evolving data distributions. While recent vision-language models (VLMS) like CLIP enable multimodal OOD detection through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Aditi Naiknaware , Salimeh Sekeh

Out-of-distribution (OOD) detection helps models identify data outside the training categories, crucial for security applications. While feature-based post-hoc methods address this by evaluating data differences in the feature space without…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Yingsheng Wang , Shuo Lu , Jian Liang , Aihua Zheng , Ran He

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira