English
Related papers

Related papers: Detecting OODs as datapoints with High Uncertainty

200 papers

Discriminatively trained, deterministic neural networks are the de facto choice for classification problems. However, even though they achieve state-of-the-art results on in-domain test sets, they tend to be overconfident on…

Machine Learning · Computer Science 2024-03-28 Ahmad Rashid , Serena Hacker , Guojun Zhang , Agustinus Kristiadi , Pascal Poupart

Deep neural networks (DNNs) are notoriously hard to understand and difficult to defend. Extracting representative paths (including the neuron activation values and the connections between neurons) from DNNs using software engineering…

Machine Learning · Computer Science 2025-05-22 Fangzhen Zhao , Chenyi Zhang , Naipeng Dong , Ming Li , Jinxiao Shan

In order to deploy deep neural networks (DNNs) in high-stakes scenarios, it is imperative that DNNs provide inference robust to external perturbations - both intentional and unintentional. Although the resilience of DNNs to intentional and…

Cryptography and Security · Computer Science 2024-08-06 Sazzad Sayyed , Milin Zhang , Shahriar Rifat , Ananthram Swami , Michael De Lucia , Francesco Restuccia

With the recently rapid development in deep learning, deep neural networks have been widely adopted in many real-life applications. However, deep neural networks are also known to have very little control over its uncertainty for unseen…

Machine Learning · Computer Science 2019-04-23 Wenhu Chen , Yilin Shen , Hongxia Jin , William Wang

State of the art Deep Neural Networks (DNN) can now achieve above human level accuracy on image classification tasks. However their outstanding performances come along with a complex inference mechanism making them arduously interpretable…

Machine Learning · Computer Science 2019-11-07 Fei Wu , Thomas Michel , Alexandre Briot

Deep neural networks are known to be overconfident when applied to out-of-distribution (OOD) inputs which clearly do not belong to any class. This is a problem in safety-critical applications since a reliable assessment of the uncertainty…

Machine Learning · Computer Science 2021-03-11 Julian Bitterwolf , Alexander Meinke , Matthias Hein

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Deep neural networks (DNNs) often produce overconfident predictions on out-of-distribution (OOD) inputs, undermining their reliability in open-world environments. Singularities in semi-discrete optimal transport (OT) mark regions of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Keke Tang , Ziyong Du , Xiaofei Wang , Weilong Peng , Peican Zhu , Zhihong Tian

Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing…

Machine Learning · Computer Science 2025-01-16 Konstantin Garov , Kamalika Chaudhuri

Uncertainty estimation is a key component in any deployed machine learning system. One way to evaluate uncertainty estimation is using "out-of-distribution" (OoD) detection, that is, distinguishing between the training data distribution and…

Machine Learning · Computer Science 2021-12-03 Haiwen Huang , Joost van Amersfoort , Yarin Gal

Bayesian Neural Networks (BNNs) have become one of the promising approaches for uncertainty estimation due to the solid theorical foundations. However, the performance of BNNs is affected by the ability of catching uncertainty. Instead of…

Machine Learning · Computer Science 2024-04-15 Shiyu Shen , Bin Pan , Tianyang Shi , Tao Li , Zhenwei Shi

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can…

Machine Learning · Computer Science 2025-03-10 Juniper Tyree , Andreas Rupp , Petri S. Clusius , Michael H. Boy

Several areas have been improved with Deep Learning during the past years. Implementing Deep Neural Networks (DNN) for non-safety related applications have shown remarkable achievements over the past years; however, for using DNNs in safety…

Likelihood-based deep generative models (DGMs) have gained significant attention for their ability to approximate the distributions of high-dimensional data. However, these models lack a performance guarantee in assigning higher likelihood…

Machine Learning · Computer Science 2025-02-04 Behrooz Montazeran , Ullrich Köthe

For safety assurance of deep neural networks (DNNs), out-of-distribution (OoD) monitoring techniques are essential as they filter spurious input that is distant from the training dataset. This paper studies the problem of systematically…

Software Engineering · Computer Science 2022-05-17 Chih-Hong Cheng , Changshun Wu , Emmanouil Seferis , Saddek Bensalem

Uncertainty quantification methods are required in autonomous systems that include deep learning (DL) components to assess the confidence of their estimations. However, to successfully deploy DL components in safety-critical autonomous…

Robotics · Computer Science 2021-11-02 Fabio Arnez , Huascar Espinoza , Ansgar Radermacher , François Terrier

Out-of-distribution (OOD) detection is essential for building reliable AI systems, as models that produce outputs for invalid inputs cannot be trusted. Although deep learning (DL) is often assumed to outperform traditional machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Jihyeon Baek , Seunghoon Lee , Gitaek Kwon , Doohyun Park

Image segmentation relies heavily on neural networks which are known to be overconfident, especially when making predictions on out-of-distribution (OOD) images. This is a common scenario in the medical domain due to variations in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Kilian Zepf , Selma Wanna , Marco Miani , Juston Moore , Jes Frellsen , Søren Hauberg , Frederik Warburg , Aasa Feragen

The behavior of neural networks (NNs) on previously unseen types of data (out-of-distribution or OOD) is typically unpredictable. This can be dangerous if the network's output is used for decision-making in a safety-critical system. Hence,…

Machine Learning · Computer Science 2024-05-20 Muqsit Azeem , Marta Grobelna , Sudeep Kanav , Jan Kretinsky , Stefanie Mohr , Sabine Rieder

Deep neural networks (DNNs) are machine learning algorithms that have revolutionised computer vision due to their remarkable successes in tasks like object classification and segmentation. The success of DNNs as computer vision algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Felix A. Wichmann , Robert Geirhos