English
Related papers

Related papers: Calibrating Deep Neural Network Classifiers on Out…

200 papers

Detecting anomalous inputs, such as adversarial and out-of-distribution (OOD) inputs, is critical for classifiers (including deep neural networks or DNNs) deployed in real-world applications. While prior works have proposed various methods…

Machine Learning · Computer Science 2021-06-18 Jayaram Raghuram , Varun Chandrasekaran , Somesh Jha , Suman Banerjee

The growing use of deep learning in safety-critical applications, such as medical imaging, has raised concerns about limited labeled data, where this demand is amplified as model complexity increases, posing hurdles for domain experts to…

Machine Learning · Computer Science 2024-07-03 Lorenzo S. Querol , Hajime Nagahara , Hideaki Hayashi

Inference accuracy of deep neural networks (DNNs) is a crucial performance metric, but can vary greatly in practice subject to actual test datasets and is typically unknown due to the lack of ground truth labels. This has raised significant…

Machine Learning · Computer Science 2020-07-06 Zhihui Shao , Jianyi Yang , Shaolei Ren

We establish a new model-agnostic optimization framework for out-of-distribution generalization via multicalibration, a criterion that ensures a predictor is calibrated across a family of overlapping groups. Multicalibration is shown to be…

Machine Learning · Computer Science 2024-06-04 Jiayun Wu , Jiashuo Liu , Peng Cui , Zhiwei Steven Wu

Several areas have been improved with Deep Learning during the past years. Implementing Deep Neural Networks (DNN) for non-safety related applications have shown remarkable achievements over the past years; however, for using DNNs in safety…

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

Machine Learning · Computer Science 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

Detecting out-of-distribution (OOD) instances is crucial for the reliable deployment of machine learning models in real-world scenarios. OOD inputs are commonly expected to cause a more uncertain prediction in the primary task; however,…

Machine Learning · Computer Science 2024-05-22 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Cinà

Out-of-distribution (OOD) detection is critical for the safe deployment of deep neural networks. State-of-the-art post-hoc methods typically derive OOD scores from the output logits or penultimate feature vector obtained via global average…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Abid Hassan , Tuan Ngo , Saad Shafiq , Nenad Medvidovic

Out-of-distribution (OOD) detection is a critical task for deploying machine learning models in the open world. Distance-based methods have demonstrated promise, where testing samples are detected as OOD if they are relatively far away from…

Machine Learning · Computer Science 2022-12-09 Yiyou Sun , Yifei Ming , Xiaojin Zhu , Yixuan Li

Neural networks have achieved impressive performance for data in the distribution which is the same as the training set but can produce an overconfident incorrect result for the data these networks have never seen. Therefore, it is…

Machine Learning · Computer Science 2022-08-22 Jinhong Lin

Out-of-distribution (OOD) detection is a critical task to ensure the reliability and security of machine learning models deployed in real-world applications. Conventional methods for OOD detection that rely on single-modal information,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 K Huang , G Song , Hanwen Su , Jiyan Wang

As we move away from the data, the predictive uncertainty should increase, since a great variety of explanations are consistent with the little available information. We introduce Distance-Aware Prior (DAP) calibration, a method to correct…

Machine Learning · Statistics 2022-07-19 Gianluca Detommaso , Alberto Gasparin , Andrew Wilson , Cedric Archambeau

Detecting out-of-distribution (OOD) data is a critical challenge in machine learning due to model overconfidence, often without awareness of their epistemological limits. We hypothesize that ``neural collapse'', a phenomenon affecting…

Machine Learning · Statistics 2024-02-28 Mouïn Ben Ammar , Nacim Belkhir , Sebastian Popescu , Antoine Manzanera , Gianni Franchi

With model trustworthiness being crucial for sensitive real-world applications, practitioners are putting more and more focus on improving the uncertainty calibration of deep neural networks. Calibration errors are designed to quantify the…

Machine Learning · Computer Science 2024-03-14 Sebastian G. Gruber , Florian Buettner

Accurate estimation of aleatoric and epistemic uncertainty is crucial to build safe and reliable systems. Traditional approaches, such as dropout and ensemble methods, estimate uncertainty by sampling probability predictions from different…

Machine Learning · Computer Science 2020-10-23 Bertrand Charpentier , Daniel Zügner , Stephan Günnemann

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

Deep neural networks are susceptible to generating overconfident yet erroneous predictions when presented with data beyond known concepts. This challenge underscores the importance of detecting out-of-distribution (OOD) samples in the open…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Yiye Chen , Yunzhi Lin , Ruinian Xu , Patricio A. Vela

Class probabilities predicted by most multiclass classifiers are uncalibrated, often tending towards over-confidence. With neural networks, calibration can be improved by temperature scaling, a method to learn a single corrective…

Machine Learning · Computer Science 2019-10-29 Meelis Kull , Miquel Perello-Nieto , Markus Kängsepp , Telmo Silva Filho , Hao Song , Peter Flach

As deep neural networks (DNNs) become increasingly common, concerns about their robustness do as well. A longstanding problem for deployed DNNs is their behavior in the face of unfamiliar inputs; specifically, these models tend to be…

Machine Learning · Computer Science 2025-01-23 Esha Datta , Johanna Hennig , Eva Domschot , Connor Mattes , Michael R. Smith

Robustness to out-of-distribution (OOD) data is an important goal in building reliable machine learning systems. Especially in autonomous systems, wrong predictions for OOD inputs can cause safety critical situations. As a first step…

Machine Learning · Computer Science 2020-04-17 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien