English
Related papers

Related papers: An uncertainty-aware Bayesian framework for machin…

200 papers

Bayesian inference provides a rigorous framework to encapsulate our knowledge and uncertainty regarding various physical quantities in a well-defined and self-contained manner. Utilising modern tools, such Bayesian models can be constructed…

High Energy Physics - Lattice · Physics 2024-01-02 Julien Frison

Uncertainty quantification for image data is dominated by complex deep learning methods, yet the field lacks an interpretable, mathematically grounded baseline. We propose Bayesian scattering to fill this gap, serving as a first-step…

Machine Learning · Computer Science 2026-03-24 Bernardo Fichera , Zarko Ivkovic , Kjell Jorner , Philipp Hennig , Viacheslav Borovitskiy

Latent factor models are widely used to discover and adjust for hidden variation in modern applications. However, most methods do not fully account for uncertainty in the latent factors, which can lead to miscalibrated inferences such as…

Methodology · Statistics 2020-10-13 Jeffrey W. Miller , Scott L. Carter

Predictions made by deep learning models are prone to data perturbations, adversarial attacks, and out-of-distribution inputs. To build a trusted AI system, it is therefore critical to accurately quantify the prediction uncertainties. While…

Machine Learning · Computer Science 2023-04-12 Hanjing Wang , Dhiraj Joshi , Shiqiang Wang , Qiang Ji

In the presence of modeling errors, the mainstream Bayesian methods seldom give a realistic account of uncertainties as they commonly underestimate the inherent variability of parameters. This problem is not due to any misconception in the…

Applications · Statistics 2020-05-19 Omid Sedehi , Costas Papadimitriou , Lambros S. Katafygiotis

Inputs to machine learning models can have associated noise or uncertainties, but they are often ignored and not modelled. It is unknown if Bayesian Neural Networks and their approximations are able to consider uncertainty in their inputs.…

Machine Learning · Computer Science 2025-01-15 Matias Valdenegro-Toro , Marco Zullich

Motivation: Recent work has demonstrated the feasibility of using non-numerical, qualitative data to parameterize mathematical models. However, uncertainty quantification (UQ) of such parameterized models has remained challenging because of…

Methodology · Statistics 2019-09-04 Eshan D. Mitra , William S. Hlavacek

Outcomes of data-driven AI models cannot be assumed to be always correct. To estimate the uncertainty in these outcomes, the uncertainty wrapper framework has been proposed, which considers uncertainties related to model fit, input quality,…

Machine Learning · Computer Science 2022-01-11 Pascal Gerber , Lisa Jöckel , Michael Kläs

Uncertainty estimation in machine learning has traditionally focused on the prediction stage, aiming to quantify confidence in model outputs while treating learned representations as deterministic and reliable by default. In this work, we…

Machine Learning · Statistics 2026-02-20 Yiyao Yang

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use…

Machine Learning · Computer Science 2018-07-03 Volodymyr Kuleshov , Nathan Fenner , Stefano Ermon

Bayesian Neural Networks (BNNs) place priors over the parameters in a neural network. Inference in BNNs, however, is difficult; all inference methods for BNNs are approximate. In this work, we empirically compare the quality of predictive…

Machine Learning · Computer Science 2019-06-25 Jiayu Yao , Weiwei Pan , Soumya Ghosh , Finale Doshi-Velez

The Best Estimate plus Uncertainty (BEPU) approach for nuclear systems modeling and simulation requires that the prediction uncertainty must be quantified in order to prove that the investigated design stays within acceptance criteria. A…

Computation · Statistics 2023-03-24 Ziyu Xie , Farah Alsafadi , Xu Wu

Inverse problems and, in particular, inferring unknown or latent parameters from data are ubiquitous in engineering simulations. A predominant viewpoint in identifying unknown parameters is Bayesian inference where both prior information…

Computation · Statistics 2022-08-31 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

As machine learning systems get widely adopted for high-stake decisions, quantifying uncertainty over predictions becomes crucial. While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing…

Machine Learning · Computer Science 2019-06-14 Melanie F. Pradier , Weiwei Pan , Jiayu Yao , Soumya Ghosh , Finale Doshi-velez

Testing Machine Learning (ML) models and AI-Infused Applications (AIIAs), or systems that contain ML models, is highly challenging. In addition to the challenges of testing classical software, it is acceptable and expected that statistical…

Machine Learning · Computer Science 2022-10-28 George Kour , Marcel Zalmanovici , Orna Raz , Samuel Ackerman , Ateret Anaby-Tavor

This paper discusses regularized estimators in the multivariate statistical model as tools naturally arising within a Bayesian framework. First, a link is established between Bayesian estimation and inference under parameter rounding…

Methodology · Statistics 2025-09-15 Jan Kalina

One of the main challenges of deep learning tools is their inability to capture model uncertainty. While Bayesian deep learning can be used to tackle the problem, Bayesian neural networks often require more time and computational power to…

Machine Learning · Computer Science 2020-10-20 Jiaming Zeng , Adam Lesnikowski , Jose M. Alvarez

Despite the dominant role of deep models in machine learning, limitations persist, including overconfident predictions, susceptibility to adversarial attacks, and underestimation of variability in predictions. The Bayesian paradigm provides…

Machine Learning · Statistics 2025-06-18 Alisa Sheinkman , Sara Wade

Comparing competing mathematical models of complex natural processes is a shared goal among many branches of science. The Bayesian probabilistic framework offers a principled way to perform model comparison and extract useful metrics for…