English
Related papers

Related papers: A Baseline for Detecting Out-of-Distribution Examp…

200 papers

Modern neural networks are very powerful predictive models, but they are often incapable of recognizing when their predictions may be wrong. Closely related to this is the task of out-of-distribution detection, where a network must…

Machine Learning · Statistics 2018-02-15 Terrance DeVries , Graham W. Taylor

Likelihood from a generative model is a natural statistic for detecting out-of-distribution (OoD) samples. However, generative models have been shown to assign higher likelihood to OoD samples compared to ones from the training…

Machine Learning · Computer Science 2019-10-22 Jiaming Song , Yang Song , Stefano Ermon

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2024-04-09 Zhen Fang , Yixuan Li , Feng Liu , Bo Han , Jie Lu

Existing vision-language model (VLM)-based methods for out-of-distribution (OOD) detection typically rely on similarity scores between input images and in-distribution (ID) text prototypes. However, the modality gap between image and text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yimu Wang , Evelien Riddell , Adrian Chow , Sean Sedwards , Krzysztof Czarnecki

Likelihood-based generative models are a promising resource to detect out-of-distribution (OOD) inputs which could compromise the robustness or reliability of a machine learning system. However, likelihoods derived from such models have…

Machine Learning · Computer Science 2020-01-20 Joan Serrà , David Álvarez , Vicenç Gómez , Olga Slizovskaia , José F. Núñez , Jordi Luque

Out-of-distribution (OOD) detection is crucial in many real-world applications. However, intelligent models are often trained solely on in-distribution (ID) data, leading to overconfidence when misclassifying OOD data as ID classes. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jiankang Chen , Tong Zhang , Wei-Shi Zheng , Ruixuan Wang

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model…

Machine Learning · Computer Science 2024-02-19 Genki Osada , Tsubasa Takahashi , Takashi Nishide

The ability to detect objects that are not prevalent in the training set is a critical capability in many 3D applications, including autonomous driving. Machine learning methods for object recognition often assume that all object categories…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zizhao Li , Xueyang Kang , Joseph West , Kourosh Khoshelham

Image captioning is a multimodal problem that has drawn extensive attention in both the natural language processing and computer vision community. In this paper, we present a novel image captioning architecture to better explore semantics…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Zhan Shi , Xu Zhou , Xipeng Qiu , Xiaodan Zhu

Deep Neural Networks are powerful models that attained remarkable results on a variety of tasks. These models are shown to be extremely efficient when training and test data are drawn from the same distribution. However, it is not clear how…

Machine Learning · Statistics 2019-01-11 Gabi Shalev , Yossi Adi , Joseph Keshet

Out-of-distribution (OOD) detection has attracted a large amount of attention from the machine learning research community in recent years due to its importance in deployed systems. Most of the previous studies focused on the detection of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Alon Zolfi , Guy Amit , Amit Baras , Satoru Koda , Ikuya Morikawa , Yuval Elovici , Asaf Shabtai

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

Machine Learning · Computer Science 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Advancements in synthesized speech have created a growing threat of impersonation, making it crucial to develop deepfake algorithm recognition. One significant aspect is out-of-distribution (OOD) detection, which has gained notable…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Renmingyue Du , Jixun Yao , Qiuqiang Kong , Yin Cao

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be…

Detecting out-of-distribution (OOD) samples is essential when deploying machine learning models in open-world scenarios. Zero-shot OOD detection, requiring no training on in-distribution (ID) data, has been possible with the advent of…

Machine Learning · Computer Science 2024-06-04 Chentao Cao , Zhun Zhong , Zhanke Zhou , Yang Liu , Tongliang Liu , Bo Han

Deep neural networks for image classification only learn to map in-distribution inputs to their corresponding ground truth labels in training without differentiating out-of-distribution samples from in-distribution ones. This results from…

Machine Learning · Computer Science 2023-08-29 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

We hypothesize that end-to-end neural image captioning systems work seemingly well because they exploit and learn `distributional similarity' in a multimodal feature space by mapping a test image to similar training images in this space and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Pranava Madhyastha , Josiah Wang , Lucia Specia

Recent advances in medical vision-language models (VLMs) demonstrate impressive performance in image classification tasks, driven by their strong zero-shot generalization capabilities. However, given the high variability and complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Lie Ju , Sijin Zhou , Yukun Zhou , Huimin Lu , Zhuoting Zhu , Pearse A. Keane , Zongyuan Ge

Out-of-distribution (OOD) detection is essential in autonomous driving, to determine when learning-based components encounter unexpected inputs. Traditional detectors typically use encoder models with fixed settings, thus lacking effective…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Zhenjiang Mao , Dong-You Jhong , Ao Wang , Ivan Ruchkin