English
Related papers

Related papers: Understanding Failures in Out-of-Distribution Dete…

200 papers

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Machine Learning · Computer Science 2025-07-11 Yifan Ding , Arturas Aleksandraus , Amirhossein Ahmadian , Jonas Unger , Fredrik Lindsten , Gabriel Eilertsen

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Likelihood-based deep generative models (DGMs) have gained significant attention for their ability to approximate the distributions of high-dimensional data. However, these models lack a performance guarantee in assigning higher likelihood…

Machine Learning · Computer Science 2025-02-04 Behrooz Montazeran , Ullrich Köthe

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

Machine Learning · Computer Science 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be…

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning · Computer Science 2025-07-03 Yucen Lily Li , Daohan Lu , Polina Kirichenko , Shikai Qiu , Tim G. J. Rudner , C. Bayan Bruss , Andrew Gordon Wilson

Likelihood from a generative model is a natural statistic for detecting out-of-distribution (OoD) samples. However, generative models have been shown to assign higher likelihood to OoD samples compared to ones from the training…

Machine Learning · Computer Science 2019-10-22 Jiaming Song , Yang Song , Stefano Ermon

Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model…

Machine Learning · Computer Science 2024-02-19 Genki Osada , Tsubasa Takahashi , Takashi Nishide

Recent work has shown that deep generative models can assign higher likelihood to out-of-distribution data sets than to their training data (Nalisnick et al., 2019; Choi et al., 2019). We posit that this phenomenon is caused by a mismatch…

Machine Learning · Statistics 2019-10-17 Eric Nalisnick , Akihiro Matsukawa , Yee Whye Teh , Balaji Lakshminarayanan

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

Machine Learning · Computer Science 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra

Despite rapid advances in AI, safety remains the main bottleneck to deploying machine-learning systems. A critical safety component is out-of-distribution detection: given an input, decide whether it comes from the same distribution as the…

Machine Learning · Computer Science 2025-11-06 Joonas Järve , Karl Kaspar Haavel , Meelis Kull

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Likelihood-based deep generative models (DGMs) commonly exhibit a puzzling behaviour: when trained on a relatively complex dataset, they assign higher likelihood values to out-of-distribution (OOD) data from simpler sources. Adding to the…

Likelihood-based generative models are a promising resource to detect out-of-distribution (OOD) inputs which could compromise the robustness or reliability of a machine learning system. However, likelihoods derived from such models have…

Machine Learning · Computer Science 2020-01-20 Joan Serrà , David Álvarez , Vicenç Gómez , Olga Slizovskaia , José F. Núñez , Jordi Luque

When presented with Out-of-Distribution (OOD) examples, deep neural networks yield confident, incorrect predictions. Detecting OOD examples is challenging, and the potential risks are high. In this paper, we propose to detect OOD examples…

Machine Learning · Computer Science 2020-01-10 Chandramouli Shama Sastry , Sageev Oore

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

Machine Learning · Computer Science 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

Deep Neural Networks for classification behave unpredictably when confronted with inputs not stemming from the training distribution. This motivates out-of-distribution detection (OOD) mechanisms. The usual lack of prior information on…

Machine Learning · Computer Science 2022-03-02 Konstantin Kirchheim , Tim Gonschorek , Frank Ortmeier

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

Machine Learning · Computer Science 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yao Zhu , YueFeng Chen , Chuanlong Xie , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , bolun zheng , Yaowu Chen
‹ Prev 1 2 3 10 Next ›