English
Related papers

Related papers: Likelihood Ratios for Out-of-Distribution Detectio…

200 papers

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Deep neural networks (DNNs) often exhibit overconfidence when encountering out-of-distribution (OOD) samples, posing significant challenges for deployment. Since DNNs are trained on in-distribution (ID) datasets, the information flow of ID…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Guide Yang , Chao Hou , Weilong Peng , Xiang Fang , Yongwei Nie , Peican Zhu , Keke Tang

Efficient and effective Out-of-Distribution (OOD) detection is essential for the safe deployment of AI systems. Existing feature space methods, while effective, often incur significant computational overhead due to their reliance on…

Machine Learning · Computer Science 2024-06-05 Litian Liu , Yao Qin

Modern neural networks are very powerful predictive models, but they are often incapable of recognizing when their predictions may be wrong. Closely related to this is the task of out-of-distribution detection, where a network must…

Machine Learning · Statistics 2018-02-15 Terrance DeVries , Graham W. Taylor

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Standard recognition approaches are unable to deal with novel categories at test time. Their overconfidence on the known classes makes the predictions unreliable for safety-critical applications such as healthcare or autonomous driving.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Lorenzo Li Lu , Giulia D'Ascenzi , Francesco Cappio Borlino , Tatiana Tommasi

3D object detection is an essential part of automated driving, and deep neural networks (DNNs) have achieved state-of-the-art performance for this task. However, deep models are notorious for assigning high confidence scores to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Chengjie Huang , Van Duong Nguyen , Vahdat Abdelzad , Christopher Gus Mannes , Luke Rowe , Benjamin Therien , Rick Salay , Krzysztof Czarnecki

Image classification plays a pivotal role across diverse applications, yet challenges persist when models are deployed in real-world scenarios. Notably, these models falter in detecting unfamiliar classes that were not incorporated during…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Butian Xiong , Liguang Zhou , Tin Lun Lam , Yangsheng Xu

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Deep neural network, despite its remarkable capability of discriminating targeted in-distribution samples, shows poor performance on detecting anomalous out-of-distribution data. To address this defect, state-of-the-art solutions choose to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Boxi Wu , Jie Jiang , Haidong Ren , Zifan Du , Wenxiao Wang , Zhifeng Li , Deng Cai , Xiaofei He , Binbin Lin , Wei Liu

Most existing deep learning models are trained based on the closed-world assumption, where the test data is assumed to be drawn i.i.d. from the same distribution as the training data, known as in-distribution (ID). However, when models are…

Machine Learning · Computer Science 2022-11-09 Yixin Liu , Kaize Ding , Huan Liu , Shirui Pan

Out-of-distribution (OOD) detection is critical to ensuring the reliability of deep learning applications and has attracted significant attention in recent years. A rich body of literature has emerged to develop efficient score functions…

Machine Learning · Computer Science 2025-07-22 Yuhang Liu , Yuefei Wu , Bin Shi , Bo Dong

Deep generative models have been demonstrated as problematic in the unsupervised out-of-distribution (OOD) detection task, where they tend to assign higher likelihoods to OOD samples. Previous studies on this issue are usually not…

Machine Learning · Computer Science 2024-01-04 Zezhen Zeng , Bin Liu

It has recently been shown that ReLU networks produce arbitrarily over-confident predictions far away from the training data. Thus, ReLU networks do not know when they don't know. However, this is a highly important property in safety…

Machine Learning · Computer Science 2020-02-24 Alexander Meinke , Matthias Hein

Detecting out-of-distribution (OOD) samples are crucial for machine learning models deployed in open-world environments. Classifier-based scores are a standard approach for OOD detection due to their fine-grained detection capability.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Jaewoo Park , Yoon Gyo Jung , Andrew Beng Jin Teoh

Out-of-Distribution (OOD) detection is critical to AI reliability and safety, yet in many practical settings, only a limited amount of training data is available. Bayesian Neural Networks (BNNs) are a promising class of model on which to…

Machine Learning · Computer Science 2026-02-12 Kevin Raina , Tanya Schmah

Out-of-distribution (OOD) detection, crucial for reliable pattern classification, discerns whether a sample originates outside the training distribution. This paper concentrates on the high-dimensional features output by the final…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Qiuyu Zhu , Yiwei He

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Reliable detection of out-of-distribution (OOD) inputs is increasingly understood to be a precondition for deployment of machine learning systems. This paper proposes and investigates the use of contrastive training to boost OOD detection…

Detecting out-of-distribution (OOD) samples is a critical task for reliable machine learning. However, it becomes particularly challenging when the models are trained on long-tailed datasets, as the models often struggle to distinguish…

Machine Learning · Computer Science 2024-08-21 Dong Geun Shin , Hye Won Chung