English
Related papers

Related papers: Quantifying the unknown: issues in simulation vali…

200 papers

Dynamical triangulations of four-dimensional Euclidean quantum gravity give rise to an interesting, numerically accessible model of quantum gravity. We give a simple introduction to the model and discuss two particularly important issues.…

High Energy Physics - Lattice · Physics 2008-11-26 B. Bruegmann , E. Marinari

Numerical simulation is an important non-perturbative tool to study quantum field theories defined in non-commutative spaces. In this contribution, a selection of results from Monte Carlo calculations for non-commutative models is…

High Energy Physics - Theory · Physics 2016-11-21 Marco Panero

Modern autonomous systems with machine learning components often use uncertainty quantification to help produce assurances about system operation. However, there is a lack of consensus in the community on what uncertainty is and how to…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Sampada Deglurkar , Haotian Shen , Anish Muthali , Marco Pavone , Dragos Margineantu , Peter Karkus , Boris Ivanovic , Claire J. Tomlin

Simulations using machine learning (ML) models and mechanistic models are often run to inform decision-making processes. Uncertainty estimates of simulation results are critical to the decision-making process because simulation results of…

Machine Learning · Computer Science 2023-08-08 Babajide Kolade

Uncertainty quantification is crucial to assess prediction quality of a machine learning model. In the case of Extreme Learning Machines (ELM), most methods proposed in the literature make strong assumptions on the data, ignore the…

Machine Learning · Statistics 2020-11-04 Fabian Guignard , Federico Amato , Mikhail Kanevski

Quantifying model uncertainty is critical for understanding prediction reliability, yet distinguishing between aleatoric and epistemic uncertainty remains challenging. We extend recent work from classification to regression to provide a…

Reliable uncertainty quantification is a first step towards building explainable, transparent, and accountable artificial intelligent systems. Recent progress in Bayesian deep learning has made such quantification realizable. In this paper,…

Computation and Language · Computer Science 2018-11-20 Yijun Xiao , William Yang Wang

As large language models (LLMs) continue to evolve, understanding and quantifying the uncertainty in their predictions is critical for enhancing application credibility. However, the existing literature relevant to LLM uncertainty…

Computation and Language · Computer Science 2024-10-22 Hsiu-Yuan Huang , Yutong Yang , Zhaoxi Zhang , Sanwoo Lee , Yunfang Wu

Machine learning models have emerged as a very effective strategy to sidestep time-consuming electronic-structure calculations, enabling accurate simulations of greater size, time scale and complexity. Given the interpolative nature of…

Maximum-likelihood estimation is applied to identification of an unknown quantum mechanical process represented by a ``black box''. In contrast to linear reconstruction schemes the proposed approach always yields physically sensible…

Quantum Physics · Physics 2007-05-23 Jaromir Fiurasek , Zdenek Hradil

Measurement uncertainty and experimental error are important concepts taught in undergraduate physics laboratories. Although student ideas about error and uncertainty in introductory classical mechanics lab experiments have been studied…

Physics Education · Physics 2021-09-20 Emily M. Stump , Courtney L. White , Gina Passante , N. G. Holmes

We explore uncertainty quantification in large language models (LLMs), with the goal to identify when uncertainty in responses given a query is large. We simultaneously consider both epistemic and aleatoric uncertainties, where the former…

Machine Learning · Computer Science 2024-07-18 Yasin Abbasi Yadkori , Ilja Kuzborskij , András György , Csaba Szepesvári

This paper considers uncertainty quantification for an elliptic nonlocal equation. In particular, it is assumed that the parameters which define the kernel in the nonlocal operator are uncertain and a priori distributed according to a…

Computation · Statistics 2016-03-22 Ajay Jasra , Kody Law , Yan Zhou

Quantifying uncertainties for machine learning (ML) models is a foundational challenge in modern data analysis. This challenge is compounded by at least two key aspects of the field: (a) inconsistent terminology surrounding uncertainty and…

Machine Learning · Computer Science 2025-06-04 Shubhendu Trivedi , Brian D. Nord

Model uncertainties and simulation uncertainties occur in mathematical modeling of multiscale complex systems, since some mechanisms or scales are not represented (i.e., "unresolved") due to lack in our understanding of these mechanisms or…

Dynamical Systems · Mathematics 2008-11-25 Jinqiao Duan

High statistical precision is critical for Monte Carlo (MC) samples in high energy physics and is degraded by negatively weighted events. This paper investigates a procedure to learn the relationship between the negative and positive weight…

High Energy Physics - Experiment · Physics 2026-01-15 Christopher Palmer , Braden Kronheim

Supporting model interpretability for complex phenomena where annotators can legitimately disagree, such as emotion recognition, is a challenging machine learning task. In this work, we show that explicitly quantifying the uncertainty in…

Machine Learning · Computer Science 2019-10-08 Asma Ghandeharioun , Brian Eoff , Brendan Jou , Rosalind W. Picard

While generative models have become increasingly prevalent across various domains, fundamental concerns regarding their reliability persist. A crucial yet understudied aspect of these models is the uncertainty quantification surrounding…

Machine Learning · Computer Science 2025-11-17 Giorgio Morales , Frederic Jurie , Jalal Fadili

The practice of uncertainty quantification (UQ) validation, notably in machine learning for the physico-chemical sciences, rests on several graphical methods (scattering plots, calibration curves, reliability diagrams and confidence curves)…

Chemical Physics · Physics 2023-03-31 Pascal Pernot

We address the problem of uncertainty quantification and propose measures of total, aleatoric, and epistemic uncertainty based on a known decomposition of (strictly) proper scoring rules, a specific type of loss function, into a divergence…

Machine Learning · Computer Science 2025-05-29 Paul Hofman , Yusuf Sale , Eyke Hüllermeier