English
Related papers

Related papers: Entropic Issues in Likelihood-Based OOD Detection

200 papers

Unsupervised out-of-distribution (U-OOD) detection is to identify OOD data samples with a detector trained solely on unlabeled in-distribution (ID) data. The likelihood function estimated by a deep generative model (DGM) could be a natural…

Machine Learning · Statistics 2024-09-09 Yewen Li , Chaojie Wang , Xiaobo Xia , Xu He , Ruyi An , Dong Li , Tongliang Liu , Bo An , Xinrun Wang

The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution moreover correlates with a model's epistemic uncertainty,…

Machine Learning · Computer Science 2021-02-24 Janis Postels , Hermann Blum , Yannick Strümpler , Cesar Cadena , Roland Siegwart , Luc Van Gool , Federico Tombari

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

Machine Learning · Computer Science 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

Machine learning algorithms typically assume independent and identically distributed samples in training and at test time. Much work has shown that high-performing ML classifiers can degrade significantly and provide overly-confident, wrong…

Computation and Language · Computer Science 2023-03-09 Jie Ren , Jiaming Luo , Yao Zhao , Kundan Krishna , Mohammad Saleh , Balaji Lakshminarayanan , Peter J. Liu

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

Machine Learning · Computer Science 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Out-of-distribution (OOD) detection plays a vital role in enhancing the reliability of machine learning (ML) models. The emergence of large language models (LLMs) has catalyzed a paradigm shift within the ML community, showcasing their…

Computation and Language · Computer Science 2024-04-17 Bo Liu , Liming Zhan , Zexin Lu , Yujie Feng , Lei Xue , Xiao-Ming Wu

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Implementing effective control mechanisms to ensure the proper functioning and security of deployed NLP models, from translation to chatbots, is essential. A key ingredient to ensure safe system behaviour is Out-Of-Distribution (OOD)…

Computation and Language · Computer Science 2024-03-04 Maxime Darrin , Pablo Piantanida , Pierre Colombo

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

Machine Learning · Statistics 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2024-04-09 Zhen Fang , Yixuan Li , Feng Liu , Bo Han , Jie Lu

Out-of-distribution (OOD) detection is essential for ensuring the reliability of deep learning models operating in open-world scenarios. Current OOD detectors mainly rely on statistical models to identify unusual patterns in the latent…

Machine Learning · Computer Science 2025-06-06 Konstantin Kirchheim , Frank Ortmeier

Advances in deep generative and density models have shown impressive capacity to model complex probability density functions in lower-dimensional space. Also, applying such models to high-dimensional image data to model the PDF has shown…

Machine Learning · Computer Science 2019-11-13 John Just , Sambuddha Ghosal

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

Machine Learning · Computer Science 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

The problem of out-of-distribution detection for graph classification is far from being solved. The existing models tend to be overconfident about OOD examples or completely ignore the detection task. In this work, we consider this problem…

Machine Learning · Computer Science 2022-06-23 Gleb Bazhenov , Sergei Ivanov , Maxim Panov , Alexey Zaytsev , Evgeny Burnaev

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

Machine Learning · Computer Science 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

Generative models can now produce photorealistic synthetic data which is virtually indistinguishable from the real data used to train it. This is a significant evolution over previous models which could produce reasonable facsimiles of the…

Machine Learning · Computer Science 2024-12-10 Debargha Ganguly , Warren Morningstar , Andrew Yu , Vipin Chaudhary

Out-of-distribution (OOD) detection is essential to prevent anomalous inputs from causing a model to fail during deployment. While improved OOD detection methods have emerged, they often rely on the final layer outputs and require a full…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Ziqian Lin , Sreya Dutta Roy , Yixuan Li

The rapid advancement of large language models (LLMs) such as ChatGPT, DeepSeek, and Claude has significantly increased the presence of AI-generated text in digital communication. This trend has heightened the need for reliable detection…

Computation and Language · Computer Science 2025-10-13 Cong Zeng , Shengkun Tang , Yuanzhou Chen , Zhiqiang Shen , Wenchao Yu , Xujiang Zhao , Haifeng Chen , Wei Cheng , Zhiqiang Xu

In addition to accurate scene understanding through precise semantic segmentation of LiDAR point clouds, detecting out-of-distribution (OOD) objects, instances not encountered during training, is essential to prevent the incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Hanieh Shojaei Miandashti , Claus Brenner