English
Related papers

Related papers: Uncertainty Quantification for Misspecified Machin…

200 papers

Techniques for understanding the functioning of complex machine learning models are becoming increasingly popular, not only to improve the validation process, but also to extract new insights about the data via exploratory analysis. Though…

Machine Learning · Statistics 2018-11-02 Jayaraman J. Thiagarajan , Irene Kim , Rushil Anirudh , Peer-Timo Bremer

In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical…

Machine Learning · Computer Science 2023-01-12 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

Bayesian modelling allows for the quantification of predictive uncertainty which is crucial in safety-critical applications. Yet for many machine learning (ML) algorithms, it is difficult to construct or implement their Bayesian…

Machine Learning · Statistics 2024-10-22 Ziyu Wang , Chris Holmes

Gaussian process regression is used throughout statistics and machine learning for prediction and uncertainty quantification. A Gaussian process is specified by its mean and covariance functions. Many covariance functions, including…

Statistics Theory · Mathematics 2025-10-28 Toni Karvonen , François Bachoc

Advances in machine learning (ML) techniques have enabled the development of interatomic potentials that promise both the accuracy of first principles methods and the low-cost, linear scaling, and parallel efficiency of empirical…

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Counterfactual explanations are widely used to interpret machine learning predictions by identifying minimal changes to input features that would alter a model's decision. However, most existing counterfactual methods have not been tested…

Machine Learning · Computer Science 2026-02-03 Leonidas Christodoulou , Chang Sun

Our understanding of physical systems generally depends on our ability to match complex computational modelling with measured experimental outcomes. However, simulations with large parameter spaces suffer from inverse problem instabilities,…

Plasma Physics · Physics 2020-01-22 M. F. Kasim , T. P. Galligan , J. Topp-Mugglestone , G. Gregori , S. M. Vinko

Supervised machine learning and predictive models have achieved an impressive standard today, enabling us to answer questions that were inconceivable a few years ago. Besides these successes, it becomes clear, that beyond pure prediction,…

Machine Learning · Statistics 2025-01-29 Cornelia Gruber , Patrick Oliver Schenk , Malte Schierholz , Frauke Kreuter , Göran Kauermann

Bayesian optimization is a class of global optimization techniques. In Bayesian optimization, the underlying objective function is modeled as a realization of a Gaussian process. Although the Gaussian process assumption implies a random…

Statistics Theory · Mathematics 2023-05-08 Rui Tuo , Wenjia Wang

The usual figure of merit characterizing the performance of neural networks applied to problems in the quantum domain is their accuracy, being the probability of a correct answer on a previously unseen input. Here we append this parameter…

Quantum Physics · Physics 2022-12-29 Jan Wasilewski , Tomasz Paterek , Karol Horodecki

This paper studies the design of mechanisms that are robust to misspecification. We introduce a novel notion of robustness that connects a variety of disparate approaches and study its implications in a wide class of mechanism design…

Theoretical Economics · Economics 2021-08-31 Giuseppe Lopomo , Luca Rigotti , Chris Shannon

Bayesian neural networks and deep ensembles represent two modern paradigms of uncertainty quantification in deep learning. Yet these approaches struggle to scale mainly due to memory inefficiency issues, since they require parameter storage…

Machine Learning · Statistics 2021-11-24 Hippolyt Ritter , Martin Kukla , Cheng Zhang , Yingzhen Li

Recently there has been a great deal of interest surrounding the calibration of quantum sensors using machine learning techniques. In this work, we explore the use of regression to infer a machine-learned point estimate of an unknown…

Quantum Physics · Physics 2024-06-19 Samuel P. Nolan , Luca Pezzè , Augusto Smerzi

We introduce a framework for uncertainty estimation that both describes and extends many existing methods. We consider typical hyperparameters involved in classical training as random variables and marginalise them out to capture various…

Machine Learning · Computer Science 2021-07-07 Francesco Farina , Lawrence Phillips , Nicola J Richmond

Uncertainty quantification for complex deep learning models is increasingly important as these techniques see growing use in high-stakes, real-world settings. Currently, the quality of a model's uncertainty is evaluated using…

Machine Learning · Computer Science 2021-12-15 Benjamin Kompa , Jasper Snoek , Andrew Beam

An understanding of how input parameter uncertainty in the numerical simulation of physical models leads to simulation output uncertainty is a challenging task. Common methods for quantifying output uncertainty, such as performing a grid or…

Materials Science · Physics 2023-09-25 Samuel G. McCallum , James E. Lerpiniére , Kjeld O. Jensen , Alison B. Walker

A central question in machine learning is how reliable the predictions of a trained model are. Reliability includes the identification of instances for which a model is likely not to be trusted based on an analysis of the learning system…

Quantum Physics · Physics 2026-01-21 Marie Kempkes , Jakob Spiegelberg , Evert van Nieuwenburg , Vedran Dunjko

Machine learning models are often evaluated using point estimates of performance metrics such as accuracy, F1 score, or mean squared error. Such summaries fail to capture the inherent variability induced by stochastic elements of the…

Machine Learning · Computer Science 2026-05-13 Christoph Lehmann , Yahor Paromau

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning,…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Xu Wu , Lesego E. Moloko , Pavel M. Bokov , Gregory K. Delipei , Joshua Kaizer , Kostadin N. Ivanov