English
Related papers

Related papers: Entropic Issues in Likelihood-Based OOD Detection

200 papers

As deep neural networks (DNNs) become increasingly common, concerns about their robustness do as well. A longstanding problem for deployed DNNs is their behavior in the face of unfamiliar inputs; specifically, these models tend to be…

Machine Learning · Computer Science 2025-01-23 Esha Datta , Johanna Hennig , Eva Domschot , Connor Mattes , Michael R. Smith

Out-of-Distribution (OOD) detection is a crucial problem for the safe deployment of machine learning models identifying samples that fall outside of the training distribution, i.e. in-distribution data (ID). Most OOD works focus on the…

Machine Learning · Computer Science 2023-10-04 Soroush Seifi , Daniel Olmeda Reino , Nikolay Chumerin , Rahaf Aljundi

Out-of-distribution (OOD) detection, which maps high-dimensional data into a scalar OOD score, is critical for the reliable deployment of machine learning models. A key challenge in recent research is how to effectively leverage and…

Machine Learning · Computer Science 2026-02-06 Claus Hofmann , Christian Huber , Bernhard Lehner , Daniel Klotz , Sepp Hochreiter , Werner Zellinger

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

Methods for out-of-distribution (OOD) detection that scale to 3D data are crucial components of any real-world clinical deep learning system. Classic denoising diffusion probabilistic models (DDPMs) have been recently proposed as a robust…

Uncertainty estimation is a key component in any deployed machine learning system. One way to evaluate uncertainty estimation is using "out-of-distribution" (OoD) detection, that is, distinguishing between the training data distribution and…

Machine Learning · Computer Science 2021-12-03 Haiwen Huang , Joost van Amersfoort , Yarin Gal

Open-world classification systems should discern out-of-distribution (OOD) data whose labels deviate from those of in-distribution (ID) cases, motivating recent studies in OOD detection. Advanced works, despite their promising progress, may…

Machine Learning · Computer Science 2023-12-27 Qizhou Wang , Zhen Fang , Yonggang Zhang , Feng Liu , Yixuan Li , Bo Han

Out-of-distribution (OOD) detection plays a crucial role in ensuring the safety and reliability of deep neural networks in various applications. While there has been a growing focus on OOD detection in visual data, the field of textual OOD…

Computation and Language · Computer Science 2024-04-10 Li-Ming Zhan , Bo Liu , Xiao-Ming Wu

\noindent Out-of-distribution (OOD) detection is essential for the safe deployment of machine learning models. Extensive work has focused on devising various scoring functions for detecting OOD samples, while only a few studies focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yifan Ding , Xixi Liu , Jonas Unger , Gabriel Eilertsen

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

Machine Learning · Computer Science 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra

Unsupervised out-of-distribution detection (OOD) seeks to identify out-of-domain data by learning only from unlabeled in-domain data. We present a novel approach for this task - Lift, Map, Detect (LMD) - that leverages recent advancement in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Zhenzhen Liu , Jin Peng Zhou , Yufan Wang , Kilian Q. Weinberger

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

The application of machine learning in safety-critical systems requires a reliable assessment of uncertainty. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if…

Machine Learning · Computer Science 2022-10-19 Alexander Meinke , Julian Bitterwolf , Matthias Hein

Out-of-distribution (OOD) detection is essential for determining when a supervised model encounters inputs that differ meaningfully from its training distribution. While widely studied in classification, OOD detection for regression and…

Machine Learning · Statistics 2025-12-16 Min Lu , Hemant Ishwaran

State-of-the-art Object Detection (OD) methods predominantly operate under a closed-world assumption, where test-time categories match those encountered during training. However, detecting and localizing unknown objects is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Daniel Montoya , Aymen Bouguerra , Alexandra Gomez-Villa , Fabio Arnez

Out-of-distribution (OOD) detection, which aims to distinguish unknown classes from known classes, has received increasing attention recently. A main challenge within is the unavailable of samples from the unknown classes in the training…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Mingle Xu , Jaehwan Lee , Sook Yoon , Dong Sun Park

Detecting out-of-distribution (OOD) examples is critical in many applications. We propose an unsupervised method to detect OOD samples using a $k$-NN density estimate with respect to a classification model's intermediate activations on…

Machine Learning · Computer Science 2021-02-11 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for…

Machine Learning · Computer Science 2024-07-19 Aryan Gulati , Xingjian Dong , Carlos Hurtado , Sarath Shekkizhar , Swabha Swayamdipta , Antonio Ortega

Out-of-distribution (OOD) detection is a critical issue for the stable and reliable operation of systems using a deep neural network (DNN). Although many OOD detection methods have been proposed, it remains unclear how the differences…

Machine Learning · Computer Science 2024-10-30 Kazuki Uematsu , Kosuke Haruki , Taiji Suzuki , Mitsuhiro Kimura , Takahiro Takimoto , Hideyuki Nakagawa

Deep neural networks (DNNs) for the semantic segmentation of images are usually trained to operate on a predefined closed set of object classes. This is in contrast to the "open world" setting where DNNs are envisioned to be deployed to.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Robin Chan , Matthias Rottmann , Hanno Gottschalk