English
Related papers

Related papers: Feature Space Singularity for Out-of-Distribution …

200 papers

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature. However, the field currently lacks a unified,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jingkang Yang , Pengyun Wang , Dejian Zou , Zitang Zhou , Kunyuan Ding , Wenxuan Peng , Haoqi Wang , Guangyao Chen , Bo Li , Yiyou Sun , Xuefeng Du , Kaiyang Zhou , Wayne Zhang , Dan Hendrycks , Yixuan Li , Ziwei Liu

Detecting out-of-distribution (OOD) instances is crucial for the reliable deployment of machine learning models in real-world scenarios. OOD inputs are commonly expected to cause a more uncertain prediction in the primary task; however,…

Machine Learning · Computer Science 2024-05-22 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Cinà

Detecting out-of-distribution (OOD) nodes in the graph-based machine-learning field is challenging, particularly when in-distribution (ID) node multi-category labels are unavailable. Thus, we focus on feature space rather than label space…

Machine Learning · Computer Science 2025-10-24 Shenzhi Yang , Junbo Zhao , Sharon Li , Shouqing Yang , Dingyu Yang , Xiaofang Zhang , Haobo Wang

We consider the problem of detecting OoD(Out-of-Distribution) input data when using deep neural networks, and we propose a simple yet effective way to improve the robustness of several popular OoD detection methods against label shift. Our…

Machine Learning · Computer Science 2022-07-04 Matteo Guarrera , Baihong Jin , Tung-Wei Lin , Maria Zuluaga , Yuxin Chen , Alberto Sangiovanni-Vincentelli

Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models, especially in areas where security is critical. However, traditional OOD detection methods often fail to capture complex data distributions from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Armando Zhu , Jiabei Liu , Keqin Li , Shuying Dai , Bo Hong , Peng Zhao , Changsong Wei

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Reliable out-of-distribution (OOD) detection is a critical requirement for the safe deployment of machine learning systems. Despite recent progress, state-of-the-art OOD detectors are highly susceptible to adversarial attacks, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Maria Stoica , Abdelrahman Hekal , Alessio Lomuscio

The reliability of artificial intelligence (AI) systems in open-world settings depends heavily on their ability to flag out-of-distribution (OOD) inputs unseen during training. Recent advances in large-scale vision-language models (VLMs)…

Machine Learning · Computer Science 2025-10-14 Faizul Rakib Sayem , Shahana Ibrahim

We present a new methodology for detecting out-of-distribution (OOD) images by utilizing norms of the score estimates at multiple noise scales. A score is defined to be the gradient of the log density with respect to the input data. Our…

Machine Learning · Computer Science 2021-03-24 Ahsan Mahmood , Junier Oliva , Martin Styner

The superior performance of object detectors is often established under the condition that the test samples are in the same distribution as the training data. However, in many practical applications, out-of-distribution (OOD) instances are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Tianhao Zhang , Shenglin Wang , Nidhal Bouaynaya , Radu Calinescu , Lyudmila Mihaylova

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

Out-of-distribution (OOD) detection is essential for model trustworthiness which aims to sensitively identify semantic OOD samples and robustly generalize for covariate-shifted OOD samples. However, we discover that the superior OOD…

Machine Learning · Computer Science 2024-10-16 Qingyang Zhang , Qiuxuan Feng , Joey Tianyi Zhou , Yatao Bian , Qinghua Hu , Changqing Zhang

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

In this work, we train a network to simultaneously perform segmentation and pixel-wise Out-of-Distribution (OoD) detection, such that the segmentation of unknown regions of scenes can be rejected. This is made possible by leveraging an OoD…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 David Williams , Matthew Gadd , Daniele De Martini , Paul Newman

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

Machine Learning · Computer Science 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Out-of-distribution (OoD) detection for data-based programs is a goal of paramount importance. Common approaches in the literature tend to train detectors requiring inside-of-distribution (in-distribution, or IoD) and OoD validation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Romain Xu-Darme , Julien Girard-Satabin , Darryl Hond , Gabriele Incorvaia , Zakaria Chihani

Deep Learning models perform unreliably when the data comes from a distribution different from the training one. In critical applications such as medical imaging, out-of-distribution (OOD) detection methods help to identify such data…

Image and Video Processing · Electrical Eng. & Systems 2023-06-26 Anton Vasiliuk , Daria Frolova , Mikhail Belyaev , Boris Shirokikh

Modern machine learning models, that excel on computer vision tasks such as classification and object detection, are often overconfident in their predictions for Out-of-Distribution (OOD) examples, resulting in unpredictable behaviour for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Brian K. S. Isaac-Medina , Mauricio Che , Yona F. A. Gaus , Samet Akcay , Toby P. Breckon

Detecting out-of-distribution (OOD) instances is crucial for NLP models in practical applications. Although numerous OOD detection methods exist, most of them are empirical. Backed by theoretical analysis, this paper advocates for the…

Machine Learning · Computer Science 2023-10-10 Haowei Lin , Yuntian Gu