English
Related papers

Related papers: Hierarchical VAEs Know What They Don't Know

200 papers

Out-of-Distribution detection between dataset pairs has been extensively explored with generative models. We show that likelihood-based Out-of-Distribution detection can be extended to diffusion models by leveraging the fact that they, like…

Machine Learning · Computer Science 2023-10-27 Joseph Goodier , Neill D. F. Campbell

Out-of-distribution (OOD) detection, crucial for reliable pattern classification, discerns whether a sample originates outside the training distribution. This paper concentrates on the high-dimensional features output by the final…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Qiuyu Zhu , Yiwei He

We present a theory for the construction of out-of-distribution (OOD) detection features for neural networks. We introduce random features for OOD through a novel information-theoretic loss functional consisting of two terms, the first…

Machine Learning · Computer Science 2025-06-18 Sudeepta Mondal , Zhuolin Jiang , Ganesh Sundaramoorthi

Out-of-distribution (OOD) detection is a critical issue for the stable and reliable operation of systems using a deep neural network (DNN). Although many OOD detection methods have been proposed, it remains unclear how the differences…

Machine Learning · Computer Science 2024-10-30 Kazuki Uematsu , Kosuke Haruki , Taiji Suzuki , Mitsuhiro Kimura , Takahiro Takimoto , Hideyuki Nakagawa

With the recently rapid development in deep learning, deep neural networks have been widely adopted in many real-life applications. However, deep neural networks are also known to have very little control over its uncertainty for unseen…

Machine Learning · Computer Science 2019-04-23 Wenhu Chen , Yilin Shen , Hongxia Jin , William Wang

Modern deep generative models can assign high likelihood to inputs drawn from outside the training distribution, posing threats to models in open-world deployments. While much research attention has been placed on defining new test-time…

Machine Learning · Computer Science 2022-08-22 Mu Cai , Yixuan Li

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

Deep learning provides a powerful tool for machine perception when the observations resemble the training data. However, real-world robotic systems must react intelligently to their observations even in unexpected circumstances. This…

Machine Learning · Computer Science 2018-12-31 Rowan McAllister , Gregory Kahn , Jeff Clune , Sergey Levine

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

Machine Learning · Computer Science 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

When deploying a trained machine learning model in the real world, it is inevitable to receive inputs from out-of-distribution (OOD) sources. For instance, in continual learning settings, it is common to encounter OOD samples due to the…

Machine Learning · Computer Science 2024-01-23 Chuanwen Feng , Wenlong Chen , Ao Ke , Yilong Ren , Xike Xie , S. Kevin Zhou

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

Machine Learning · Computer Science 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

Machine Learning · Computer Science 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

Most classification and segmentation datasets assume a closed-world scenario in which predictions are expressed as distribution over a predetermined set of visual classes. However, such assumption implies unavoidable and often unnoticeable…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Petra Bevandić , Ivan Krešo , Marin Oršić , Siniša Šegvić

Deep neural networks (DNNs), especially convolutional neural networks, have achieved superior performance on image classification tasks. However, such performance is only guaranteed if the input to a trained model is similar to the training…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Liang Liang , Linhai Ma , Linchen Qian , Jiasong Chen

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

The lack of well-calibrated confidence estimates makes neural networks inadequate in safety-critical domains such as autonomous driving or healthcare. In these settings, having the ability to abstain from making a prediction on…

Machine Learning · Computer Science 2022-07-27 Adam Dziedzic , Stephan Rabanser , Mohammad Yaghini , Armin Ale , Murat A. Erdogdu , Nicolas Papernot