English
Related papers

Related papers: On the Need to Align Intent and Implementation in …

200 papers

As Large Language Models (LLMs) are increasingly deployed in real-world applications, reliable uncertainty quantification (UQ) becomes critical for safe and effective use. Most existing UQ approaches for language models aim to produce a…

Computation and Language · Computer Science 2026-04-14 Maiya Goloburda , Roman Vashurin , Fedor Chernogorsky , Nurkhan Laiyk , Daniil Orel , Preslav Nakov , Maxim Panov

Reliable uncertainty quantification is essential for the use of machine learning in physics, where scientific discoveries depend on validated probabilistic statements. We provide a structured overview of uncertainty quantification in ML for…

Machine Learning · Statistics 2026-05-12 Manuel Haußmann , Ramon Winterhalder , Maria Ubiali

Estimating uncertainty is at the core of performing scientific measurements in HEP: a measurement is not useful without an estimate of its uncertainty. The goal of uncertainty quantification (UQ) is inextricably linked to the question, "how…

High Energy Physics - Experiment · Physics 2022-11-02 Thomas Y. Chen , Biprateep Dey , Aishik Ghosh , Michael Kagan , Brian Nord , Nesar Ramachandra

As machine learning (ML) models are increasingly deployed in high-stakes domains, trustworthy uncertainty quantification (UQ) is critical for ensuring the safety and reliability of these models. Traditional UQ methods rely on specifying a…

Machine Learning · Statistics 2025-05-14 Abhineet Agarwal , Michael Xiao , Rebecca Barter , Omer Ronen , Boyu Fan , Bin Yu

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…

Graphical models have demonstrated their exceptional capabilities across numerous applications. However, their performance, confidence, and trustworthiness are often limited by the inherent randomness in data generation and the lack of…

Machine Learning · Computer Science 2026-04-15 Chao Chen , Chenghua Guo , Rui Xu , Jiujiu Chen , Xiangwen Liao , Xi Zhang , Sihong Xie , Hui Xiong , Philip Yu

As large language models (LLMs) continue to evolve, understanding and quantifying the uncertainty in their predictions is critical for enhancing application credibility. However, the existing literature relevant to LLM uncertainty…

Computation and Language · Computer Science 2024-10-22 Hsiu-Yuan Huang , Yutong Yang , Zhaoxi Zhang , Sanwoo Lee , Yunfang Wu

Accurate uncertainty quantification (UQ) in Large Language Models (LLMs) is critical for trustworthy deployment. While real-world language is inherently ambiguous, reflecting aleatoric uncertainty, existing UQ methods are typically…

Machine Learning · Computer Science 2026-01-30 Tim Tomov , Dominik Fuchsgruber , Tom Wollschläger , Stephan Günnemann

This review is designed to introduce mathematicians and computational scientists to quantum computing (QC) through the lens of uncertainty quantification (UQ) by presenting a mathematically rigorous and accessible narrative for…

Quantum Physics · Physics 2026-03-30 Ryan Bennink , Olena Burkovska , Konstantin Pieper , Jorge Ramirez , Elaine Wong

This study investigates uncertainty quantification in large language models (LLMs) for medical applications, emphasizing both technical innovations and philosophical implications. As LLMs become integral to clinical decision-making,…

Artificial Intelligence · Computer Science 2025-04-08 Zahra Atf , Seyed Amir Ahmad Safavi-Naini , Peter R. Lewis , Aref Mahjoubfar , Nariman Naderi , Thomas R. Savage , Ali Soroush

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks due to large training datasets and powerful transformer architecture. However, the reliability of responses from LLMs remains a question.…

Computation and Language · Computer Science 2025-02-26 Tiejin Chen , Xiaoou Liu , Longchao Da , Jia Chen , Vagelis Papalexakis , Hua Wei

The practice of uncertainty quantification (UQ) validation, notably in machine learning for the physico-chemical sciences, rests on several graphical methods (scattering plots, calibration curves, reliability diagrams and confidence curves)…

Chemical Physics · Physics 2023-03-31 Pascal Pernot

Large Language Models (LLMs) have been transformative across many domains. However, hallucination, i.e., confidently outputting incorrect information, remains one of the leading challenges for LLMs. This raises the question of how to…

Computation and Language · Computer Science 2026-03-19 Toghrul Abbasli , Kentaroh Toyoda , Yuan Wang , Leon Witt , Muhammad Asif Ali , Yukai Miao , Dan Li , Qingsong Wei

Despite the massive advancements in large language models (LLMs), they still suffer from producing plausible but incorrect responses. To improve the reliability of LLMs, recent research has focused on uncertainty quantification to predict…

Artificial Intelligence · Computer Science 2025-04-01 Yongjin Yang , Haneul Yoo , Hwaran Lee

The goals of this chapter are twofold. First, we wish to introduce molecular dynamics (MD) and uncertainty quantification (UQ) in a common setting in order to demonstrate how the latter can increase confidence in the former. In some cases,…

Computational Physics · Physics 2018-01-09 Paul N. Patrone , Andrew Dienstfrey

The rapid proliferation of large language models (LLMs) has stimulated researchers to seek effective and efficient approaches to deal with LLM hallucinations and low-quality outputs. Uncertainty quantification (UQ) is a key element of…

The rapid advancement of large language models (LLMs) has transformed the landscape of natural language processing, enabling breakthroughs across a wide range of areas including question answering, machine translation, and text…

Computation and Language · Computer Science 2025-10-15 Sungmin Kang , Yavuz Faruk Bakman , Duygu Nur Yaldiz , Baturalp Buyukates , Salman Avestimehr

Despite the increasing demand for safer machine learning practices, the use of Uncertainty Quantification (UQ) methods in production remains limited. This limitation is exacerbated by the challenge of validating UQ methods in absence of UQ…

Machine Learning · Computer Science 2025-03-03 Arthur Pignet , Chiara Regniez , John Klein

This paper explores uncertainty quantification (UQ) as an indicator of the trustworthiness of automated deep-learning (DL) tools in the context of white matter lesion (WML) segmentation from magnetic resonance imaging (MRI) scans of…

Uncertainty quantification (UQ) has become critical for evaluating the reliability of artificial intelligence systems, especially in medical image segmentation. This study addresses the interpretability of instance-wise uncertainty values…