English
Related papers

Related papers: Accurate Prediction and Uncertainty Estimation usi…

200 papers

When deployed for risk-sensitive tasks, deep neural networks must include an uncertainty estimation mechanism. Here we examine the relationship between deep architectures and their respective training regimes, with their corresponding…

Machine Learning · Computer Science 2023-02-24 Ido Galil , Mohammed Dabbah , Ran El-Yaniv

We propose a new optimization framework for aleatoric uncertainty estimation in regression problems. Existing methods can quantify the error in the target estimation, but they tend to underestimate it. To obtain the predictive uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Takumi Kawashima , Qing Yu , Akari Asai , Daiki Ikami , Kiyoharu Aizawa

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Uncertainty estimation in machine learning is paramount for enhancing the reliability and interpretability of predictive models, especially in high-stakes real-world scenarios. Despite the availability of numerous methods, they often pose a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Anton Baumann , Thomas Roßberg , Michael Schmitt

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

As neural networks become more popular, the need for accompanying uncertainty estimates increases. There are currently two main approaches to test the quality of these estimates. Most methods output a density. They can be compared by…

Machine Learning · Statistics 2024-06-05 Laurens Sluijterman , Eric Cator , Tom Heskes

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The…

Artificial Intelligence · Computer Science 2025-05-27 Nikita Durasov , Doruk Oner , Jonathan Donier , Hieu Le , Pascal Fua

Precise estimation of uncertainty in predictions for AI systems is a critical factor in ensuring trust and safety. Deep neural networks trained with a conventional method are prone to over-confident predictions. In contrast to Bayesian…

Machine Learning · Computer Science 2021-01-05 Theodoros Tsiligkaridis

Neural networks (NNs) lack measures of "reliability" estimation that would enable reasoning over their predictions. Despite the vital importance, especially in areas of human well-being and health, state-of-the-art uncertainty estimation…

Machine Learning · Computer Science 2021-02-12 Lorena Qendro , Jagmohan Chauhan , Alberto Gil C. P. Ramos , Cecilia Mascolo

We introduce a framework for robust uncertainty quantification in situations where labeled training data are corrupted, through noisy or missing labels. We build on conformal prediction, a statistical tool for generating prediction sets…

Machine Learning · Computer Science 2026-02-27 Shai Feldman , Stephen Bates , Yaniv Romano

Uncertainty estimation methods using deep learning approaches strive against separating how uncertain the state of the world manifests to us via measurement (objective end) from the way this gets scrambled with the model specification and…

Machine Learning · Statistics 2023-04-21 Edgardo Solano-Carrillo

Data following an interval structure are increasingly prevalent in many scientific applications. In medicine, clinical events are often monitored between two clinical visits, making the exact time of the event unknown and generating…

Methodology · Statistics 2025-04-01 Carlos García Meixide , Michael R. Kosorok , Marcos Matabuena

Current person image retrieval methods have achieved great improvements in accuracy metrics. However, they rarely describe the reliability of the prediction. In this paper, we propose an Uncertainty-Aware Learning (UAL) method to remedy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Zhaopeng Dou , Zhongdao Wang , Weihua Chen , Yali Li , Shengjin Wang

In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical…

Machine Learning · Computer Science 2023-01-12 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

Deep learning models have significantly improved prediction accuracy in various fields, gaining recognition across numerous disciplines. Yet, an aspect of deep learning that remains insufficiently addressed is the assessment of prediction…

Machine Learning · Statistics 2024-12-18 Asaf Ben Arie , Malka Gorfine

Improving the robustness of neural nets in regression tasks is key to their application in multiple domains. Deep learning-based approaches aim to achieve this goal either by improving their prediction of specific values (i.e., point…

Machine Learning · Computer Science 2021-06-22 Eli Simhayev , Gilad Katz , Lior Rokach

This short study presents an opportunistic approach to a (more) reliable validation method for prediction uncertainty average calibration. Considering that variance-based calibration metrics (ZMS, NLL, RCE...) are quite sensitive to the…

Machine Learning · Statistics 2024-08-27 Pascal Pernot

With rapid adoption of deep learning in critical applications, the question of when and how much to trust these models often arises, which drives the need to quantify the inherent uncertainties. While identifying all sources that account…

Machine Learning · Statistics 2019-11-22 Jayaraman J. Thiagarajan , Bindya Venkatesh , Prasanna Sattigeri , Peer-Timo Bremer

The inability of artificial neural networks to assess the uncertainty of their predictions is an impediment to their widespread use. We distinguish two types of learnable uncertainty: model uncertainty due to a lack of training data and…

Machine Learning · Computer Science 2022-06-14 Hans Weytjens , Jochen De Weerdt

Due to the comprehensive nature of this paper, it has been updated and split into two separate papers: "A Framework For Benchmarking Class-out-of-distribution Detection And Its Application To ImageNet" and "What Can We Learn From The…

Machine Learning · Computer Science 2023-02-24 Ido Galil , Mohammed Dabbah , Ran El-Yaniv