English
Related papers

Related papers: How Certain are Uncertainty Estimates? Three Novel…

200 papers

This review is designed to introduce mathematicians and computational scientists to quantum computing (QC) through the lens of uncertainty quantification (UQ) by presenting a mathematically rigorous and accessible narrative for…

Quantum Physics · Physics 2026-03-30 Ryan Bennink , Olena Burkovska , Konstantin Pieper , Jorge Ramirez , Elaine Wong

The practice of uncertainty quantification (UQ) validation, notably in machine learning for the physico-chemical sciences, rests on several graphical methods (scattering plots, calibration curves, reliability diagrams and confidence curves)…

Chemical Physics · Physics 2023-03-31 Pascal Pernot

Scientific Machine Learning is a new class of approaches that integrate physical knowledge and mechanistic models with data-driven techniques for uncovering governing equations of complex processes. Among the available approaches, Universal…

Machine Learning · Statistics 2024-06-14 Nina Schmid , David Fernandes del Pozo , Willem Waegeman , Jan Hasenauer

We propose a rigorous framework for Uncertainty Quantification (UQ) in which the UQ objectives and the assumptions/information set are brought to the forefront. This framework, which we call \emph{Optimal Uncertainty Quantification} (OUQ),…

Probability · Mathematics 2016-05-20 Houman Owhadi , Clint Scovel , Timothy John Sullivan , Mike McKerns , Michael Ortiz

As Large Language Models (LLMs) are increasingly deployed in real-world applications, reliable uncertainty quantification (UQ) becomes critical for safe and effective use. Most existing UQ approaches for language models aim to produce a…

Computation and Language · Computer Science 2026-04-14 Maiya Goloburda , Roman Vashurin , Fedor Chernogorsky , Nurkhan Laiyk , Daniil Orel , Preslav Nakov , Maxim Panov

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural…

High Energy Physics - Experiment · Physics 2023-11-02 Dae Heun Koh , Aashwin Mishra , Kazuhiro Terao

This paper explores uncertainty quantification (UQ) as an indicator of the trustworthiness of automated deep-learning (DL) tools in the context of white matter lesion (WML) segmentation from magnetic resonance imaging (MRI) scans of…

This paper provides a tutorial about uncertainty quantification (UQ) for those who have no background but are interested in learning more in this area. It exploits many very simple examples, which are understandable to undergraduates, to…

Dynamical Systems · Mathematics 2025-10-07 Nan Chen , Stephen Wiggins , Marios Andreou

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN),…

Machine Learning · Computer Science 2020-12-08 João Caldeira , Brian Nord

Large language models(LLMs) are increasingly expanding their real-world applications across domains, e.g., question answering, autonomous driving, and automatic software development. Despite this achievement, LLMs, as data-driven systems,…

Artificial Intelligence · Computer Science 2025-12-09 Xianzong Wu , Xiaohong Li , Lili Quan , Qiang Hu

Uncertainty quantification (UQ) in computational chemistry (CC) is still in its infancy. Very few CC methods are designed to provide a confidence level on their predictions, and most users still rely improperly on the mean absolute error as…

Chemical Physics · Physics 2022-03-21 Pascal Pernot

Uncertainty quantification (UQ) is a critical aspect of artificial intelligence (AI) systems, particularly in high-risk domains such as healthcare, autonomous systems, and financial technology, where decision-making processes must account…

Deep learning is gaining increasing popularity for spatiotemporal forecasting. However, prior works have mostly focused on point estimates without quantifying the uncertainty of the predictions. In high stakes domains, being able to…

Artificial Intelligence · Computer Science 2021-06-15 Dongxia Wu , Liyao Gao , Xinyue Xiong , Matteo Chinazzi , Alessandro Vespignani , Yi-An Ma , Rose Yu

Uncertainty quantification (UQ) methods for Large Language Models (LLMs) encompass a variety of approaches, with two major types being particularly prominent: information-based, which focus on model confidence expressed as token…

Computation and Language · Computer Science 2025-12-10 Roman Vashurin , Maiya Goloburda , Albina Ilina , Aleksandr Rubashevskii , Preslav Nakov , Artem Shelmanov , Maxim Panov

In this paper, we describe an open source Python toolkit named Uncertainty Quantification 360 (UQ360) for the uncertainty quantification of AI models. The goal of this toolkit is twofold: first, to provide a broad range of capabilities to…

Uncertainty quantification (UQ) is an essential tool for applying deep neural networks (DNNs) to real world tasks, as it attaches a degree of confidence to DNN outputs. However, despite its benefits, UQ is often left out of the standard DNN…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Nils Lehmann , Jakob Gawlikowski , Adam J. Stewart , Vytautas Jancauskas , Stefan Depeweg , Eric Nalisnick , Nina Maria Gottschling

The changesets (or patches) that fix open source software vulnerabilities form critical datasets for various machine learning security-enhancing applications, such as automated vulnerability patching and silent fix detection. These patch…

Software Engineering · Computer Science 2025-09-23 Hui Chen , Yunhua Zhao , Kostadin Damevski

Large Language Models (LLMs) excel in text generation, reasoning, and decision-making, enabling their adoption in high-stakes domains such as healthcare, law, and transportation. However, their reliability is a major concern, as they often…

Computation and Language · Computer Science 2025-06-05 Xiaoou Liu , Tiejin Chen , Longchao Da , Chacha Chen , Zhen Lin , Hua Wei

AI deployed in the real-world should be capable of autonomously adapting to novelties encountered after deployment. Yet, in the field of continual learning, the reliance on novelty and labeling oracles is commonplace albeit unrealistic.…

Machine Learning · Computer Science 2024-12-24 Amanda S. Rios , Ibrahima J. Ndiour , Parual Datta , Jaroslaw Sydir , Omesh Tickoo , Nilesh Ahuja

Techniques from artificial intelligence and machine learning are increasingly employed in nuclear theory, however, the uncertainties that arise from the complex parameter manifold encoded by the neural networks are often overlooked.…

Nuclear Theory · Physics 2025-10-29 Mengyao Huang , Kyle A. Wendt , Nicolas F. Schunck , Erika M. Holmbeck