English
Related papers

Related papers: Second-Order Uncertainty Quantification: Variance-…

200 papers

Uncertainty reduction is vital for improving system reliability and reducing risks. To identify the best target for uncertainty reduction, uncertainty importance measure is commonly used to prioritize the significance of input variable…

Applications · Statistics 2025-06-12 Shi-Shun Chen , Xiao-Yang Li

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks.…

Machine Learning · Computer Science 2023-05-24 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

We discuss the machine-learning inference and uncertainty quantification for the equation of state (EoS) of the neutron star (NS) matter directly using the NS probability distribution from the observations. We previously proposed a…

Nuclear Theory · Physics 2024-02-02 Yuki Fujimoto , Kenji Fukushima , Syo Kamata , Koichi Murase

Uncertainty quantification is vital for decision-making and risk assessment in machine learning. Mean-variance regression models, which predict both a mean and residual noise for each data point, provide a simple approach to uncertainty…

Machine Learning · Statistics 2025-12-01 Eliot Wong-Toi , Alex Boyd , Vincent Fortuin , Stephan Mandt

Accurately detecting multiple change-points is critical for various applications, but determining the optimal number of change-points remains a challenge. Existing approaches based on information criteria attempt to balance goodness-of-fit…

Methodology · Statistics 2023-12-19 Hui Chen , Yinxu Jia , Guanghui Wang , Changliang Zou

In a world where more decisions are made using artificial intelligence, it is of utmost importance to ensure these decisions are well-grounded. Neural networks are the modern building blocks for artificial intelligence. Modern neural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohamad Al Shaar , Nils Ekström , Gustav Gille , Reza Rezvan , Ivan Wely

In machine learning, uncertainty quantification helps assess the reliability of model predictions, which is important in high-stakes scenarios. Traditional approaches often emphasize predictive accuracy, but there is a growing focus on…

Machine Learning · Statistics 2025-09-30 Jake S. Rhodes , Scott D. Brown , J. Riley Wilkinson

In this paper the elicitation of probabilities from human experts is considered as a measurement process, which may be disturbed by random 'measurement noise'. Using Bayesian concepts a second order probability distribution is derived…

Artificial Intelligence · Computer Science 2013-04-05 Gerhard Paaß

The presence of label noise often misleads the training of deep neural networks. Departing from the recent literature which largely assumes the label noise rate is only determined by the true label class, the errors in human-annotated…

Machine Learning · Computer Science 2021-03-31 Zhaowei Zhu , Tongliang Liu , Yang Liu

We present a method to quantify uncertainty in the predictions made by simulations of mathematical models that can be applied to a broad class of stochastic, discrete, and differential equation models. Quantifying uncertainty is crucial for…

Machine Learning · Statistics 2015-03-05 Kyle S. Hickmann , James M. Hyman , Sara Y. Del Valle

Uncertainty Quantification aims to determine when the prediction from a Machine Learning model is likely to be wrong. Computer Vision research has explored methods for determining epistemic uncertainty (also known as model uncertainty),…

Machine Learning · Computer Science 2024-03-15 Prithviraj Manivannan , Ivo Pascal de Jong , Matias Valdenegro-Toro , Andreea Ioana Sburlea

Information-theory based variational principles have proven effective at providing scalable uncertainty quantification (i.e. robustness) bounds for quantities of interest in the presence of nonparametric model-form uncertainty. In this…

Probability · Mathematics 2020-06-11 Jeremiah Birrell , Luc Rey-Bellet

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Assessing uncertainty is an important step towards ensuring the safety and reliability of machine learning systems. Existing uncertainty estimation techniques may fail when their modeling assumptions are not met, e.g. when the data…

Machine Learning · Computer Science 2017-01-24 Volodymyr Kuleshov , Stefano Ermon

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

Supervised machine learning and predictive models have achieved an impressive standard today, enabling us to answer questions that were inconceivable a few years ago. Besides these successes, it becomes clear, that beyond pure prediction,…

Machine Learning · Statistics 2025-01-29 Cornelia Gruber , Patrick Oliver Schenk , Malte Schierholz , Frauke Kreuter , Göran Kauermann

Trustworthy ML systems should not only return accurate predictions, but also a reliable representation of their uncertainty. Bayesian methods are commonly used to quantify both aleatoric and epistemic uncertainty, but alternative…

Artificial Intelligence · Computer Science 2024-09-11 Mira Jürgens , Nis Meinert , Viktor Bengs , Eyke Hüllermeier , Willem Waegeman

Uncertainty Quantification (UQ) is essential in probabilistic machine learning models, particularly for assessing the reliability of predictions. In this paper, we present a systematic framework for estimating both epistemic and aleatoric…

Machine Learning · Statistics 2025-09-11 Marzieh Ajirak , Anand Ravishankar , Petar M. Djuric

Aleatoric uncertainty quantification seeks for distributional knowledge of random responses, which is important for reliability analysis and robustness improvement in machine learning applications. Previous research on aleatoric uncertainty…

Machine Learning · Computer Science 2022-06-10 Ziyi Huang , Henry Lam , Haofeng Zhang