English
Related papers

Related papers: SeSE: Black-Box Uncertainty Quantification for Lar…

200 papers

Uncertainty quantification (UQ) is important for reliability assessment and enhancement of machine learning models. In deep learning, uncertainties arise not only from data, but also from the training procedure that often injects…

Machine Learning · Statistics 2023-11-13 Ziyi Huang , Henry Lam , Haofeng Zhang

Large Language Models (LLMs) have shown remarkable progress in multiple-choice question answering (MCQA), but their inherent unreliability, such as hallucination and overconfidence, limits their application in high-risk domains. To address…

Computation and Language · Computer Science 2025-08-08 Guang Yang , Xinyang Liu

Uncertainty quantification (UQ) for large language models (LLMs) is a key building block for safety guardrails of daily LLM applications. Yet, even as LLM agents are increasingly deployed in highly complex tasks, most UQ research still…

Artificial Intelligence · Computer Science 2026-04-21 Changdae Oh , Seongheon Park , To Eun Kim , Jiatong Li , Wendi Li , Samuel Yeh , Xuefeng Du , Hamed Hassani , Paul Bogdan , Dawn Song , Sharon Li

Uncertainty decomposition refers to the task of decomposing the total uncertainty of a predictive model into aleatoric (data) uncertainty, resulting from inherent randomness in the data-generating process, and epistemic (model) uncertainty,…

Computation and Language · Computer Science 2024-06-12 Bairu Hou , Yujian Liu , Kaizhi Qian , Jacob Andreas , Shiyu Chang , Yang Zhang

If Uncertainty Quantification (UQ) is crucial to achieve trustworthy Machine Learning (ML), most UQ methods suffer from disparate and inconsistent evaluation protocols. We claim this inconsistency results from the unclear requirements the…

Machine Learning · Computer Science 2022-07-28 Victor Bouvier , Simona Maggio , Alexandre Abraham , Léo Dreyfus-Schmidt

Quantifying uncertainty of machine learning model predictions is essential for reliable decision-making, especially in safety-critical applications. Recently, uncertainty quantification (UQ) theory has advanced significantly, building on a…

Machine Learning · Computer Science 2025-10-01 Alexander Fishkov , Kajetan Schweighofer , Mykyta Ielanskyi , Nikita Kotelevskii , Mohsen Guizani , Maxim Panov

As large language models are increasingly deployed for clinical text, ensuring they can reliably signal their own uncertainty becomes critical. Most existing uncertainty quantification (UQ) methods are designed for open-domain generation…

Computation and Language · Computer Science 2026-05-28 Bushi Xiao , Sarvesh Soni , Daisy Zhe Wang

Large Language Models (LLMs) have become increasingly pervasive, finding applications across many industries and disciplines. Ensuring the trustworthiness of LLM outputs is paramount, where Uncertainty Estimation (UE) plays a key role. In…

Computation and Language · Computer Science 2025-11-06 Kevin Wang , Subre Abdoul Moktar , Jia Li , Kangshuo Li , Feng Chen

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with…

Machine Learning · Computer Science 2023-02-08 Apostolos F Psaros , Xuhui Meng , Zongren Zou , Ling Guo , George Em Karniadakis

Uncertainty quantification (UQ) is an essential tool for applying deep neural networks (DNNs) to real world tasks, as it attaches a degree of confidence to DNN outputs. However, despite its benefits, UQ is often left out of the standard DNN…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Nils Lehmann , Jakob Gawlikowski , Adam J. Stewart , Vytautas Jancauskas , Stefan Depeweg , Eric Nalisnick , Nina Maria Gottschling

The introduction of the Segment Anything Model (SAM) has paved the way for numerous semantic segmentation applications. For several tasks, quantifying the uncertainty of SAM is of particular interest. However, the ambiguous nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Timo Kaiser , Thomas Norrenbrock , Bodo Rosenhahn

This paper explores uncertainty quantification (UQ) as an indicator of the trustworthiness of automated deep-learning (DL) tools in the context of white matter lesion (WML) segmentation from magnetic resonance imaging (MRI) scans of…

Large Language Models (LLMs) have demonstrated remarkable proficiency in various natural language generation (NLG) tasks. Previous studies suggest that LLMs' generation process involves uncertainty. However, existing approaches to…

Computation and Language · Computer Science 2024-09-06 Yu-Hsiang Wang , Andrew Bai , Che-Ping Tsai , Cho-Jui Hsieh

Uncertainty quantification (UQ) is essential for safe deployment of generative AI models such as large language models (LLMs), especially in high stakes applications. Conformal prediction (CP) offers a principled uncertainty quantification…

Machine Learning · Computer Science 2025-06-09 Sima Noorani , Shayan Kiyani , George Pappas , Hamed Hassani

This study investigates uncertainty quantification in large language models (LLMs) for medical applications, emphasizing both technical innovations and philosophical implications. As LLMs become integral to clinical decision-making,…

Artificial Intelligence · Computer Science 2025-04-08 Zahra Atf , Seyed Amir Ahmad Safavi-Naini , Peter R. Lewis , Aref Mahjoubfar , Nariman Naderi , Thomas R. Savage , Ali Soroush

%Large vision-language models (LVLMs) have shown substantial advances in multimodal understanding and generation. However, when presented with incompetent or adversarial inputs, they frequently produce unreliable or even harmful content,…

Machine Learning · Computer Science 2026-02-27 Tao Huang , Rui Wang , Xiaofei Liu , Yi Qin , Li Duan , Liping Jing

Large Language Diffusion Models (LLDMs) are emerging as an alternative to autoregressive models, offering faster inference through higher parallelism. Similar to autoregressive LLMs, they remain prone to hallucinations, making reliable…

Computation and Language · Computer Science 2026-05-15 Artem Vazhentsev , Vladislav Smirnov , David Li , Maxim Panov , Timothy Baldwin , Artem Shelmanov

Uncertainty quantification (UQ) is crucial in computational fluid dynamics to assess the reliability and robustness of simulations, given the uncertainties in input parameters. OpenLB is an open-source lattice Boltzmann method library…

Large language models (LLMs) have demonstrated remarkable performance across diverse tasks by encoding vast amounts of factual knowledge. However, they are still prone to hallucinations, generating incorrect or misleading information, often…

Computation and Language · Computer Science 2025-11-13 Xiaomin Li , Zhou Yu , Ziji Zhang , Yingying Zhuang , Swair Shah , Narayanan Sadagopan , Anurag Beniwal

In many high-risk machine learning applications it is essential for a model to indicate when it is uncertain about a prediction. While large language models (LLMs) can reach and even surpass human-level accuracy on a variety of benchmarks,…

Computation and Language · Computer Science 2024-06-06 Evan Becker , Stefano Soatto