English
Related papers

Related papers: Transformer-based out-of-distribution detection fo…

200 papers

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

The core of out-of-distribution (OOD) detection is to learn the in-distribution (ID) representation, which is distinguishable from OOD samples. Previous work applied recognition-based methods to learn the ID features, which tend to learn…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jingyao Li , Pengguang Chen , Shaozuo Yu , Zexin He , Shu Liu , Jiaya Jia

Out-of-distribution (OOD) detection, crucial for reliable pattern classification, discerns whether a sample originates outside the training distribution. This paper concentrates on the high-dimensional features output by the final…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Qiuyu Zhu , Yiwei He

Detecting out-of-distribution (OOD) samples is crucial to the safe deployment of a classifier in the real world. However, deep neural networks are known to be overconfident for abnormal data. Existing works directly design score function by…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Wenyu Jiang , Yuxin Ge , Hao Cheng , Mingcai Chen , Shuai Feng , Chongjun Wang

Out-of-domain (OOD) detection is a crucial component in industrial applications as it helps identify when a model encounters inputs that are outside the training distribution. Most industrial pipelines rely on pre-trained models for…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Grégor Jouet , Clément Duhart , Francis Rousseaux , Julio Laborde , Cyril de Runz

Out-of-distribution (OOD) detection is a critical task in machine learning that seeks to identify abnormal samples. Traditionally, unsupervised methods utilize a deep generative model for OOD detection. However, such approaches require a…

Machine Learning · Computer Science 2024-10-25 Alvin Heng , Alexandre H. Thiery , Harold Soh

In image classification, a lot of development has happened in detecting out-of-distribution (OoD) data. However, most OoD detection methods are evaluated on a standard set of datasets, arbitrarily different from training data. There is no…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Jishnu Mukhoti , Tsung-Yu Lin , Bor-Chun Chen , Ashish Shah , Philip H. S. Torr , Puneet K. Dokania , Ser-Nam Lim

Out-of-distribution (OOD) detection is essential for building reliable AI systems, as models that produce outputs for invalid inputs cannot be trusted. Although deep learning (DL) is often assumed to outperform traditional machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Jihyeon Baek , Seunghoon Lee , Gitaek Kwon , Doohyun Park

When testing data and training data come from different distributions, deep neural networks (DNNs) will face significant safety risks in practical applications. Therefore, out-of-distribution (OOD) detection techniques, which can identify…

Machine Learning · Computer Science 2026-04-01 Cheng Yang , Yu Hao , Qi Zhang , Chuan Shi

In medical imaging, unsupervised out-of-distribution (OOD) detection offers an attractive approach for identifying pathological cases with extremely low incidence rates. In contrast to supervised methods, OOD-based approaches function…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Lemar Abdi , Francisco Caetano , Amaan Valiuddin , Christiaan Viviers , Hamdi Joudeh , Fons van der Sommen

Convolutional Neural Networks (CNNs) are nowadays often employed in vision-based perception stacks for safetycritical applications such as autonomous driving or Unmanned Aerial Vehicles (UAVs). Due to the safety requirements in those use…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Yannik Blei , Nicolas Jourdan , Nils Gählert

Despite the significant research efforts on trajectory prediction for automated driving, limited work exists on assessing the prediction reliability. To address this limitation we propose an approach that covers two sources of error, namely…

Robotics · Computer Science 2023-08-07 Julian Wiederer , Julian Schmidt , Ulrich Kressel , Klaus Dietmayer , Vasileios Belagiannis

Transformers excel in natural language processing and computer vision tasks. However, they still face challenges in generalizing to Out-of-Distribution (OOD) datasets, i.e. data whose distribution differs from that seen during training. OOD…

Machine Learning · Computer Science 2026-01-30 Yijin Zhou , Yutang Ge , Wenyuan Xie , Linqian Zeng , Xiaowen Dong , Yuguang Wang

Out-of-distribution (OOD) detection plays a crucial role in ensuring the safe deployment of deep neural network (DNN) classifiers. While a myriad of methods have focused on improving the performance of OOD detectors, a critical gap remains…

Machine Learning · Computer Science 2023-06-07 Jihye Choi , Jayaram Raghuram , Ryan Feng , Jiefeng Chen , Somesh Jha , Atul Prakash

Recent advances in out-of-distribution (OOD) detection on image data show that pre-trained neural network classifiers can separate in-distribution (ID) from OOD data well, leveraging the class-discriminative ability of the model itself.…

Machine Learning · Computer Science 2024-05-29 Maximilian Granz , Manuel Heurich , Tim Landgraf

Out-of-Distribution(OOD) detection, a fundamental machine learning task aimed at identifying abnormal samples, traditionally requires model retraining for different inlier distributions. While recent research demonstrates the applicability…

Machine Learning · Computer Science 2025-02-25 Hongzhe Cheng , Tianyou Zheng , Tianyi Zhang , Matthew Johnson-Roberson , Weiming Zhi

Machine learning models deployed on medical imaging tasks must be equipped with out-of-distribution detection capabilities in order to avoid erroneous predictions. It is unsure whether out-of-distribution detection models reliant on deep…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Sebastian G. Popescu , David J. Sharp , James H. Cole , Konstantinos Kamnitsas , Ben Glocker

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

The complex and dynamic real-world clinical environment demands reliable deep learning (DL) systems. Out-of-distribution (OOD) detection plays a critical role in enhancing the reliability and generalizability of DL models when encountering…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Jiangbei Yue , Darren Treanor , Venkataraman Subramanian , Sharib Ali

Likelihood-based deep generative models (DGMs) have gained significant attention for their ability to approximate the distributions of high-dimensional data. However, these models lack a performance guarantee in assigning higher likelihood…

Machine Learning · Computer Science 2025-02-04 Behrooz Montazeran , Ullrich Köthe