English
Related papers

Related papers: From Risk to Uncertainty: Generating Predictive Un…

200 papers

The quantification of aleatoric and epistemic uncertainty in terms of conditional entropy and mutual information, respectively, has recently become quite common in machine learning. While the properties of these measures, which are rooted…

Machine Learning · Computer Science 2023-06-27 Lisa Wimmer , Yusuf Sale , Paul Hofman , Bern Bischl , Eyke Hüllermeier

Outer measures can be used for statistical inference in place of probability measures to bring flexibility in terms of model specification. The corresponding statistical procedures such as Bayesian inference, estimators or hypothesis…

Statistics Theory · Mathematics 2020-05-05 Jeremie Houssineau , Neil K. Chada , Emmanuel Delande

Constitutive model discovery refers to the task of identifying an appropriate model structure, usually from a predefined model library, while simultaneously inferring its material parameters. The data used for model discovery are measured…

Machine Learning · Computer Science 2026-01-27 David Anton , Henning Wessels , Ulrich Römer , Alexander Henkes , Jorge-Humberto Urrea-Quintero

We introduce a novel uncertainty estimation for classification tasks for Bayesian convolutional neural networks with variational inference. By normalizing the output of a Softplus function in the final layer, we estimate aleatoric and…

Machine Learning · Computer Science 2019-05-15 Kumar Shridhar , Felix Laumann , Marcus Liwicki

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

In this paper, an optimization problem with uncertain constraint coefficients is considered. Possibility theory is used to model the uncertainty. Namely, a joint possibility distribution in constraint coefficient realizations, called…

Optimization and Control · Mathematics 2023-09-07 Romain Guillaume , Adam Kasperski , Pawel Zielinski

In machine learning, uncertainty quantification helps assess the reliability of model predictions, which is important in high-stakes scenarios. Traditional approaches often emphasize predictive accuracy, but there is a growing focus on…

Machine Learning · Statistics 2025-09-30 Jake S. Rhodes , Scott D. Brown , J. Riley Wilkinson

Bayesian neural networks have successfully designed and optimized a robust neural network model in many application problems, including uncertainty quantification. However, with its recent success, information-theoretic understanding about…

Information Theory · Computer Science 2022-06-22 Jae Oh Woo

Probabilistic graphical models are a fundamental tool in probabilistic modeling, machine learning and artificial intelligence. They allow us to integrate in a natural way expert knowledge, physical modeling, heterogeneous and correlated…

Machine Learning · Statistics 2021-07-20 Panagiota Birmpa , Jinchao Feng , Markos A. Katsoulakis , Luc Rey-Bellet

Recent advancements in machine learning have emphasized the need for transparency in model predictions, particularly as interpretability diminishes when using increasingly complex architectures. In this paper, we propose leveraging…

Machine Learning · Computer Science 2025-07-18 Chenrui Zhu , Louenas Bounia , Vu Linh Nguyen , Sébastien Destercke , Arthur Hoarau

Epistemic Uncertainty is a measure of the lack of knowledge of a learner which diminishes with more evidence. While existing work focuses on using the variance of the Bayesian posterior due to parameter uncertainty as a measure of epistemic…

Recent research reveals that machine learning (ML) models are highly sensitive to minor changes in their training procedure, such as the inclusion or exclusion of a single data point, leading to conflicting predictions on individual data…

Machine Learning · Computer Science 2025-07-15 Falaah Arif Khan , Denys Herasymuk , Nazar Protsiv , Julia Stoyanovich

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to a specific operating point,…

Machine Learning · Computer Science 2021-06-03 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Accurate assessment of systematic uncertainties is an increasingly vital task in physics studies, where large, high-dimensional datasets, like those collected at the Large Hadron Collider, hold the key to new discoveries. Common approaches…

Methodology · Statistics 2025-10-02 Alexis Romero , Kyle Cranmer , Daniel Whiteson

In this paper we focus on the problem of assigning uncertainties to single-point predictions generated by a deterministic model that outputs a continuous variable. This problem applies to any state-of-the-art physics or engineering models…

Machine Learning · Statistics 2020-03-12 Enrico Camporeale , Algo Carè

We revisit empirical Bayes discrimination detection, focusing on uncertainty arising from both partial identification and sampling variability. While prior work has mostly focused on partial identification, we find that some empirical…

Econometrics · Economics 2025-08-19 Jiaying Gu , Nikolaos Ignatiadis , Azeem M. Shaikh

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to an ad-hoc operating point,…

Machine Learning · Computer Science 2023-10-06 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Discovery of an accurate causal Bayesian network structure from observational data can be useful in many areas of science. Often the discoveries are made under uncertainty, which can be expressed as probabilities. To guide the use of such…

Artificial Intelligence · Computer Science 2017-12-27 Fattaneh Jabbari , Mahdi Pakdaman Naeini , Gregory F. Cooper

We develop correlated random measures, random measures where the atom weights can exhibit a flexible pattern of dependence, and use them to develop powerful hierarchical Bayesian nonparametric models. Hierarchical Bayesian nonparametric…

Machine Learning · Statistics 2016-11-10 Rajesh Ranganath , David Blei

When a measurement of a physical quantity is reported, the total uncertainty is usually decomposed into statistical and systematic uncertainties. This decomposition is not only useful to understand the contributions to the total…

Data Analysis, Statistics and Probability · Physics 2024-03-18 Andrés Pinto , Zhibo Wu , Fabrice Balli , Nicolas Berger , Maarten Boonekamp , Émilien Chapon , Tatsuo Kawamoto , Bogdan Malaescu