English
Related papers

Related papers: Training Confidence-calibrated Classifiers for Det…

200 papers

Deep neural networks have demonstrated great generalization capabilities for tasks whose training and test sets are drawn from the same distribution. Nevertheless, out-of-distribution (OOD) detection remains a challenging task that has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Brian K. S. Isaac-Medina , Toby P. Breckon

Deploying machine learning in open environments presents the challenge of encountering diverse test inputs that differ significantly from the training data. These out-of-distribution samples may exhibit shifts in local or global features…

Machine Learning · Computer Science 2024-03-19 Jiawei Li , Sitong Li , Shanshan Wang , Yicheng Zeng , Falong Tan , Chuanlong Xie

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Machine Learning · Computer Science 2025-07-11 Yifan Ding , Arturas Aleksandraus , Amirhossein Ahmadian , Jonas Unger , Fredrik Lindsten , Gabriel Eilertsen

Modern neural networks are known to give overconfident prediction for out-of-distribution inputs when deployed in the open world. It is common practice to leverage a surrogate outlier dataset to regularize the model during training, and…

Machine Learning · Computer Science 2024-02-27 Wenyu Jiang , Hao Cheng , Mingcai Chen , Chongjun Wang , Hongxin Wei

The cross entropy loss is widely used due to its effectiveness and solid theoretical grounding. However, as training progresses, the loss tends to focus on hard to classify samples, which may prevent the network from obtaining gains in…

Machine Learning · Computer Science 2021-09-14 Barak Battash , Lior Wolf , Tamir Hazan

Deep neural networks often struggle to recognize when an input lies outside their training experience, leading to unreliable and overconfident predictions. Building dependable machine learning systems therefore requires methods that can…

Machine Learning · Computer Science 2025-12-02 Pirzada Suhail , Rehna Afroz , Amit Sethi

Recent years have witnessed significant progress in the development of machine learning models across a wide range of fields, fueled by increased computational resources, large-scale datasets, and the rise of deep learning architectures.…

Out-of-distribution detection is crucial to the safe deployment of machine learning systems. Currently, unsupervised out-of-distribution detection is dominated by generative-based approaches that make use of estimates of the likelihood or…

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

Machine Learning · Computer Science 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Out-of-distribution (OOD) detection is crucial when deploying deep neural networks in the real world to ensure the reliability and safety of their applications. One main challenge in OOD detection is that neural network models often produce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jinlun Ye , Zhuohao Sun , Yiqiao Qiu , Qiu Li , Zhijun Tan , Ruixuan Wang

Detection and rejection of adversarial examples in security sensitive and safety-critical systems using deep CNNs is essential. In this paper, we propose an approach to augment CNNs with out-distribution learning in order to reduce…

Cryptography and Security · Computer Science 2018-05-17 Mahdieh Abbasi , Arezoo Rajabi , Christian Gagné , Rakesh B. Bobba

Convolutional neural networks (CNNs) trained with cross-entropy loss have proven to be extremely successful in classifying images. In recent years, much work has been done to also improve the theoretical understanding of neural networks.…

Statistics Theory · Mathematics 2024-04-30 Michael Kohler , Sophie Langer

The lack of well-calibrated confidence estimates makes neural networks inadequate in safety-critical domains such as autonomous driving or healthcare. In these settings, having the ability to abstain from making a prediction on…

Machine Learning · Computer Science 2022-07-27 Adam Dziedzic , Stephan Rabanser , Mohammad Yaghini , Armin Ale , Murat A. Erdogdu , Nicolas Papernot

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

Out-of-distribution (OOD) detection lies at the heart of robust artificial intelligence (AI), aiming to identify samples from novel distributions beyond the training set. Recent approaches have exploited feature representations as…

Machine Learning · Computer Science 2025-08-06 Tarhib Al Azad , Faizul Rakib Sayem , Shahana Ibrahim

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger

Deep neural networks tend to make overconfident predictions and often require additional detectors for misclassifications, particularly for safety-critical applications. Existing detection methods usually only focus on adversarial attacks…

Machine Learning · Computer Science 2023-07-07 Julia Lust , Alexandru P. Condurache

We present a new loss function that addresses the out-of-distribution (OOD) calibration problem. While many objective functions have been proposed to effectively calibrate models in-distribution, our findings show that they do not always…

Machine Learning · Computer Science 2024-03-12 Dexter Neo , Stefan Winkler , Tsuhan Chen

To create state-of-the-art models for many downstream tasks, it has become common practice to fine-tune a pre-trained large vision model. However, it remains an open question of how to best determine which of the many possible model…

Machine Learning · Computer Science 2025-12-08 Simon Guiroy , Mats Richter , Sarath Chandar , Christopher Pal

In novelty detection, the goal is to decide if a new data point should be categorized as an inlier or an outlier, given a training dataset that primarily captures the inlier distribution. Recent approaches typically use deep encoder and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Muhammad Asad , Ihsan Ullah , Ganesh Sistu , Michael G. Madden