English
Related papers

Related papers: Revisiting Uncertainty Quantification Evaluation i…

200 papers

There are essentially three kinds of approaches to Uncertainty Quantification (UQ): (A) robust optimization, (B) Bayesian, (C) decision theory. Although (A) is robust, it is unfavorable with respect to accuracy and data assimilation. (B)…

Uncertainty quantification (UQ) is a vital step in using mathematical models and simulations to take decisions. The field of cardiac simulation has begun to explore and adopt UQ methods to characterise uncertainty in model inputs and how…

Reasoning language models have set state-of-the-art (SOTA) records on many challenging benchmarks, enabled by multi-step reasoning induced using reinforcement learning. However, like previous language models, reasoning models are prone to…

Artificial Intelligence · Computer Science 2025-07-21 Zhiting Mei , Christina Zhang , Tenny Yin , Justin Lidard , Ola Shorinwa , Anirudha Majumdar

Uncertainty quantification (UQ) is a critical aspect of artificial intelligence (AI) systems, particularly in high-risk domains such as healthcare, autonomous systems, and financial technology, where decision-making processes must account…

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning,…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Xu Wu , Lesego E. Moloko , Pavel M. Bokov , Gregory K. Delipei , Joshua Kaizer , Kostadin N. Ivanov

Uncertainty quantification (UQ) has become critical for evaluating the reliability of artificial intelligence systems, especially in medical image segmentation. This study addresses the interpretability of instance-wise uncertainty values…

The role of uncertainty quantification (UQ) in deep learning has become crucial with growing use of predictive models in high-risk applications. Though a large class of methods exists for measuring deep uncertainties, in practice, the…

Machine Learning · Statistics 2019-11-01 Bindya Venkatesh , Jayaraman J. Thiagarajan

Multifidelity uncertainty quantification (MF UQ) sampling approaches have been shown to significantly reduce the variance of statistical estimators while preserving the bias of the highest-fidelity model, provided that the low-fidelity…

Data Analysis, Statistics and Probability · Physics 2023-08-16 Xiaoshu Zeng , Gianluca Geraci , Michael S. Eldred , John D. Jakeman , Alex A. Gorodetsky , Roger Ghanem

This review is designed to introduce mathematicians and computational scientists to quantum computing (QC) through the lens of uncertainty quantification (UQ) by presenting a mathematically rigorous and accessible narrative for…

Quantum Physics · Physics 2026-03-30 Ryan Bennink , Olena Burkovska , Konstantin Pieper , Jorge Ramirez , Elaine Wong

This work demonstrates the ability to produce readily interpretable statistical metrics for model fit, fixed effects covariance coefficients, and prediction confidence. Importantly, this work compares 4 suitable and commonly applied…

Machine Learning · Statistics 2022-11-30 Alex Treacher , Kevin Nguyen , Dylan Owens , Daniel Heitjan , Albert Montillo

While past works have shown how uncertainty quantification can be applied to large language model (LLM) outputs, the question of whether resulting uncertainty guarantees still hold within sub-groupings of data remains open. In our work,…

Computation and Language · Computer Science 2025-06-13 Terrance Liu , Zhiwei Steven Wu

Uncertainty quantification has emerged as an effective approach to closed-book hallucination detection for LLMs, but existing methods are largely designed for short-form outputs and do not generalize well to long-form generation. We…

Computation and Language · Computer Science 2026-02-20 Dylan Bouchard , Mohit Singh Chauhan , Viren Bajaj , David Skarbrevik

Trustworthy deployment of ML models requires a proper measure of uncertainty, especially in safety-critical applications. We focus on uncertainty quantification (UQ) for classification problems via two avenues -- prediction sets using…

Machine Learning · Statistics 2021-07-08 Aleksandr Podkopaev , Aaditya Ramdas

To facilitate healthcare delivery, language models (LMs) have significant potential for clinical prediction tasks using electronic health records (EHRs). However, in these high-stakes applications, unreliable decisions can result in high…

Computation and Language · Computer Science 2024-11-07 Zizhang Chen , Peizhao Li , Xiaomeng Dong , Pengyu Hong

Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflicts with real-world facts, and their persuasive style can…

Computation and Language · Computer Science 2024-09-19 Arslan Chaudhry , Sridhar Thiagarajan , Dilan Gorur

As large language models (LLMs) are increasingly used for factual question-answering, it becomes more important for LLMs to have the capability to communicate the likelihood that their answer is correct. For these verbalized expressions of…

Computation and Language · Computer Science 2025-12-15 Sophia Hager , David Mueller , Kevin Duh , Nicholas Andrews

The advent of fabrication techniques such as additive manufacturing has focused attention on the considerable variability of material response due to defects and other microstructural aspects. This variability motivates the development of…

Data Analysis, Statistics and Probability · Physics 2019-06-26 Francesco Rizzi , Mohammad Khalil , Reese E. Jones , Jeremy A. Templeton , Jakob T. Ostien , Brad L. Boyce

Uncertainty quantification approaches have been more critical in large language models (LLMs), particularly high-risk applications requiring reliable outputs. However, traditional methods for uncertainty quantification, such as…

Artificial Intelligence · Computer Science 2024-07-01 Ferhat Ozgur Catak , Murat Kuzlu

Multimodal large language models (MLLMs) have recently achieved state-of-the-art performance on tasks ranging from visual question answering to video understanding. However, existing studies have concentrated mainly on visual-textual…

Machine Learning · Computer Science 2025-09-04 Yunkai Dang , Mengxi Gao , Yibo Yan , Xin Zou , Yanggan Gu , Jungang Li , Jingyu Wang , Peijie Jiang , Aiwei Liu , Jia Liu , Xuming Hu

The advent of fabrication techniques like additive manufacturing has focused attention on the considerable variability of material response due to defects and other micro-structural aspects. This variability motivates the development of an…

Applied Physics · Physics 2018-02-06 F. Rizzi , R. E. Jones , J. A. Templeton , J. T. Ostien , B. L. Boyce