English
Related papers

Related papers: Improving Robustness to Out-of-Distribution Data b…

200 papers

Deep neural networks achieve superior performance for learning from independent and identically distributed (i.i.d.) data. However, their performance deteriorates significantly when handling out-of-distribution (OoD) data, where the…

Machine Learning · Computer Science 2023-07-25 Haoyue Bai , Ceyuan Yang , Yinghao Xu , S. -H. Gary Chan , Bolei Zhou

Out-of-distribution (OOD) generalization deals with the prevalent learning scenario where test distribution shifts from training distribution. With rising application demands and inherent complexity, graph OOD problems call for specialized…

Machine Learning · Computer Science 2024-06-06 Xiner Li , Shurui Gui , Youzhi Luo , Shuiwang Ji

While deep learning models have seen widespread success in controlled environments, there are still barriers to their adoption in open-world settings. One critical task for safe deployment is the detection of anomalous or…

Machine Learning · Computer Science 2023-11-03 Connor Mclaughlin , Jason Matterer , Michael Yee

One barrier to the clinical deployment of deep learning-based models is the presence of images at runtime that lie far outside the training distribution of a given model. We aim to detect these out-of-distribution (OOD) images with a…

Image and Video Processing · Electrical Eng. & Systems 2023-07-21 McKell Woodland , John Wood , Caleb O'Connor , Ankit B. Patel , Kristy K. Brock

Out-of-distribution (OOD) detection is a critical task for deploying machine learning models in the open world. Distance-based methods have demonstrated promise, where testing samples are detected as OOD if they are relatively far away from…

Machine Learning · Computer Science 2022-12-09 Yiyou Sun , Yifei Ming , Xiaojin Zhu , Yixuan Li

The problem of detecting whether a test sample is from in-distribution (i.e., training distribution by a classifier) or out-of-distribution sufficiently different from it arises in many real-world machine learning applications. However, the…

Machine Learning · Statistics 2018-02-27 Kimin Lee , Honglak Lee , Kibok Lee , Jinwoo Shin

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

Denoising diffusion models have emerged as the go-to generative framework for solving inverse problems in imaging. A critical concern regarding these models is their performance on out-of-distribution tasks, which remains an under-explored…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Riccardo Barbano , Alexander Denker , Hyungjin Chung , Tae Hoon Roh , Simon Arridge , Peter Maass , Bangti Jin , Jong Chul Ye

We demonstrate that L2 normalization over feature space can produce capable performance for Out-of-Distribution (OoD) detection for some models and datasets. Although it does not demonstrate outright state-of-the-art performance, this…

Machine Learning · Computer Science 2024-02-02 Jarrod Haas , William Yolland , Bernhard Rabus

Deep Neural Networks (DNNs) have demonstrated exceptional recognition capabilities in traditional computer vision (CV) tasks. However, existing CV models often suffer a significant decrease in accuracy when confronted with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Shuangchen Zhao , Changde Du , Hui Li , Huiguang He

Out-of-distribution (OOD) detection can be used in deep learning-based applications to reject outlier samples from being unreliably classified by deep neural networks. Learning to classify between OOD and in-distribution samples is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Jaeyoung Kim , Seo Taek Kong , Dongbin Na , Kyu-Hwan Jung

Detecting out-of-distribution (OOD) data is critical for machine learning, be it for safety reasons or to enable open-ended learning. However, beyond mere detection, choosing an appropriate course of action typically hinges on the type of…

Machine Learning · Computer Science 2026-04-28 Achref Jaziri , Martin Rogmann , Martin Mundt , Visvanathan Ramesh

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

Out-of-distribution (OOD) detection is crucial for the reliable deployment of machine learning models in real-world scenarios, enabling the identification of unknown samples or objects. A prominent approach to enhance OOD detection…

Machine Learning · Statistics 2025-08-05 Heng Gao , Jun Li

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

Pretrained Transformers achieve remarkable performance when training and test data are from the same distribution. However, in real-world scenarios, the model often faces out-of-distribution (OOD) instances that can cause severe semantic…

Computation and Language · Computer Science 2022-01-24 Wenxuan Zhou , Fangyu Liu , Muhao Chen

Deep neural networks are known to be vulnerable to unseen data: they may wrongly assign high confidence stcores to out-distribuion samples. Recent works try to solve the problem using representation learning methods and specific metrics. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Haowei He , Jiaye Teng , Yang Yuan

"Effective robustness" measures the extra out-of-distribution (OOD) robustness beyond what can be predicted from the in-distribution (ID) performance. Existing effective robustness evaluations typically use a single test set such as…

Machine Learning · Computer Science 2023-10-31 Zhouxing Shi , Nicholas Carlini , Ananth Balashankar , Ludwig Schmidt , Cho-Jui Hsieh , Alex Beutel , Yao Qin

Out-of-distribution (OOD) detection, crucial for reliable pattern classification, discerns whether a sample originates outside the training distribution. This paper concentrates on the high-dimensional features output by the final…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Qiuyu Zhu , Yiwei He

Recent studies have addressed the concern of detecting and rejecting the out-of-distribution (OOD) samples as a major challenge in the safe deployment of deep learning (DL) models. It is desired that the DL model should only be confident…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Umar Khalid , Ashkan Esmaeili , Nazmul Karim , Nazanin Rahnavard