English
Related papers

Related papers: A framework for benchmarking uncertainty in deep r…

200 papers

Uncertainty quantification for complex deep learning models is increasingly important as these techniques see growing use in high-stakes, real-world settings. Currently, the quality of a model's uncertainty is evaluated using…

Machine Learning · Computer Science 2021-12-15 Benjamin Kompa , Jasper Snoek , Andrew Beam

Uncertainty quantification (UQ) in deep learning regression is of wide interest, as it supports critical applications including sequential decision making and risk-sensitive tasks. In heteroskedastic regression, where the uncertainty of the…

Machine Learning · Computer Science 2026-03-03 Mikkel Jordahn , Jonas Vestergaard Jensen , James Harrison , Michael Riis Andersen , Mikkel N. Schmidt

In this paper, we present a unified framework for decision making under uncertainty. Our framework is based on the composite of two risk measures, where the inner risk measure accounts for the risk of decision given the exact distribution…

Optimization and Control · Mathematics 2015-01-07 Pengyu Qian , Zizhuo Wang , Zaiwen Wen

Uncertainty quantification (UQ) is crucial in machine learning, yet most (axiomatic) studies of uncertainty measures focus on classification, leaving a gap in regression settings with limited formal justification and evaluations. In this…

Machine Learning · Computer Science 2025-05-19 Christopher Bülte , Yusuf Sale , Timo Löhr , Paul Hofman , Gitta Kutyniok , Eyke Hüllermeier

Assessing the predictive uncertainty of deep neural networks is crucial for safety-related applications of deep learning. Although Bayesian deep learning offers a principled framework for estimating model uncertainty, the common approaches…

Machine Learning · Computer Science 2024-03-06 Yookoon Park , David M. Blei

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

Machine Learning · Computer Science 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

ML models have errors when used for predictions. The errors are unknown but can be quantified by model uncertainty. When multiple ML models are trained using the same training points, their model uncertainties may be statistically…

Machine Learning · Statistics 2025-09-23 Xiaoping Du

Quantifying uncertainty in deep regression models is important both for understanding the confidence of the model and for safe decision-making in high-risk domains. Existing approaches that yield prediction intervals overlook distributional…

Machine Learning · Computer Science 2025-12-02 Adriel Sosa Marco , John Daniel Kirwan , Alexia Toumpa , Simos Gerasimou

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use…

Machine Learning · Computer Science 2018-07-03 Volodymyr Kuleshov , Nathan Fenner , Stefano Ermon

Effective quantification of uncertainty is an essential and still missing step towards a greater adoption of deep-learning approaches in different applications, including mission-critical ones. In particular, investigations on the…

Machine Learning · Computer Science 2023-04-14 Marco Forgione , Dario Piga

With the wide development of black-box machine learning algorithms, particularly deep neural network (DNN), the practical demand for the reliability assessment is rapidly rising. On the basis of the concept that `Bayesian deep learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Kenta Hama , Takashi Matsubara , Kuniaki Uehara , Jianfei Cai

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

The vast majority of stochastic simulation models are imperfect in that they fail to exactly emulate real system dynamics. The inexactness of the simulation model, or model discrepancy, can impact the predictive accuracy and usefulness of…

Methodology · Statistics 2017-07-21 Matthew Plumlee , Henry Lam

Quantifying uncertainty and updating reliability are essential for ensuring the safety and performance of engineering systems. This study develops a hierarchical Bayesian modeling (HBM) framework to quantify uncertainty and update…

Methodology · Statistics 2024-12-31 Xinyu Jia , Weinan Hou , Costas Papadimitriou

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

Machine Learning · Computer Science 2023-02-15 Brian Staber , Sébastien Da Veiga

This paper presents a groundbreaking self-improving interference management framework tailored for wireless communications, integrating deep learning with uncertainty quantification to enhance overall system performance. Our approach…

Machine Learning · Computer Science 2024-01-25 Hyun-Suk Lee , Do-Yup Kim , Kyungsik Min

Fair predictive algorithms hinge on both equality and trust, yet inherent uncertainty in real-world data challenges our ability to make consistent, fair, and calibrated decisions. While fairly managing predictive error has been extensively…

Machine Learning · Computer Science 2024-10-04 Lucas Rosenblatt , R. Teal Witter

Uncertainty quantification has been a core of the statistical machine learning, but its computational bottleneck has been a serious challenge for both Bayesians and frequentists. We propose a model-based framework in quantifying…

Machine Learning · Computer Science 2019-06-04 Minsuk Shin , Young Lee , Jun S. Liu

Precise estimation of predictive uncertainty in deep neural networks is a critical requirement for reliable decision-making in machine learning and statistical modeling, particularly in the context of medical AI. Conformal Prediction (CP)…

Machine Learning · Computer Science 2024-01-05 Hamed Karimi , Reza Samavi

Uncertainty estimation is critical for numerous applications of deep neural networks and draws growing attention from researchers. Here, we demonstrate an uncertainty quantification approach for deep neural networks used in inverse problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Luzhe Huang , Jianing Li , Xiaofu Ding , Yijie Zhang , Hanlong Chen , Aydogan Ozcan