English
Related papers

Related papers: Uncertainty Quantification for LLMs through Minimu…

200 papers

Concept Bottleneck Models (CBMs) provide inherent interpretability by first mapping input samples to high-level semantic concepts, followed by a combination of these concepts for the final classification. However, the annotation of…

Machine Learning · Computer Science 2026-03-02 Yangyi Li , Mengdi Huai

As Large Language Models (LLMs) are integrated into safety-critical applications involving sequential decision-making in the real world, it is essential to know when to trust LLM decisions. Existing LLM Uncertainty Quantification (UQ)…

Computation and Language · Computer Science 2025-06-24 Jinhao Duan , James Diffenderfer , Sandeep Madireddy , Tianlong Chen , Bhavya Kailkhura , Kaidi Xu

Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflicts with real-world facts, and their persuasive style can…

Computation and Language · Computer Science 2024-09-19 Arslan Chaudhry , Sridhar Thiagarajan , Dilan Gorur

The adaptation and use of Machine Learning (ML) in our daily lives has led to concerns in lack of transparency, privacy, reliability, among others. As a result, we are seeing research in niche areas such as interpretability, causality, bias…

Machine Learning · Computer Science 2024-06-04 Fahimeh Fakour , Ali Mosleh , Ramin Ramezani

This paper investigates the capabilities of Large Language Models (LLMs) in the context of understanding their knowledge and uncertainty over questions. Specifically, we focus on addressing known-unknown questions, characterized by high…

Computation and Language · Computer Science 2024-07-03 Alfonso Amayuelas , Kyle Wong , Liangming Pan , Wenhu Chen , William Wang

Quantifying uncertainties for machine learning models is a critical step to reduce human verification effort by detecting predictions with low confidence. This paper proposes a method for uncertainty quantification (UQ) of table structure…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Kehinde Ajayi , Leizhen Zhang , Yi He , Jian Wu

Uncertainty Quantification (UQ) is a key discipline for computational modeling of complex systems, enhancing reliability of engineering simulations. In crashworthiness, having an accurate assessment of the behavior of the model uncertainty…

Methodology · Statistics 2021-09-17 Marc Rocas , Alberto García-González , Sergio Zlotnik , Xabier Larráyoz , Pedro Díez

Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based…

Computation and Language · Computer Science 2026-02-03 Pragatheeswaran Vipulanandan , Kamal Premaratne , Dilip Sarkar

Large Language Models (LLMs) are increasingly explored as knowledge bases (KBs), yet current evaluation methods focus too narrowly on knowledge retention, overlooking other crucial criteria for reliable performance. In this work, we rethink…

Computation and Language · Computer Science 2024-12-17 Danna Zheng , Mirella Lapata , Jeff Z. Pan

Although large language models (LLMs) are highly interactive and extendable, current approaches to ensure reliability in deployments remain mostly limited to rejecting outputs with high uncertainty in order to avoid misinformation. This…

Machine Learning · Computer Science 2025-06-10 T. Duy Nguyen-Hien , Desi R. Ivanova , Yee Whye Teh , Wee Sun Lee

Text summarization, a key natural language generation (NLG) task, is vital in various domains. However, the high cost of inaccurate summaries in risk-critical applications, particularly those involving human-in-the-loop decision-making,…

Computation and Language · Computer Science 2024-10-10 Jianfeng He , Runing Yang , Linlin Yu , Changbin Li , Ruoxi Jia , Feng Chen , Ming Jin , Chang-Tien Lu

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret…

Machine Learning · Computer Science 2024-11-14 Rebecca Nevin , Aleksandra Ćiprijanović , Brian D. Nord

Despite their importance for assessing reliability of predictions, uncertainty quantification (UQ) measures for machine learning models have only recently begun to be rigorously characterized. One prominent issue is the curse of…

Machine Learning · Statistics 2023-07-27 Liam Hodgkinson , Chris van der Heide , Fred Roosta , Michael W. Mahoney

The advent of fabrication techniques like additive manufacturing has focused attention on the considerable variability of material response due to defects and other micro-structural aspects. This variability motivates the development of an…

Applied Physics · Physics 2018-02-06 F. Rizzi , R. E. Jones , J. A. Templeton , J. T. Ostien , B. L. Boyce

This paper outlines a methodology for Bayesian multimodel uncertainty quantification (UQ) and propagation and presents an investigation into the effect of prior probabilities on the resulting uncertainties. The UQ methodology is adapted…

Computation · Statistics 2018-07-04 Jiaxin Zhang , Michael D. Shields

The rapid development of LLMs has sparked extensive research into their factual knowledge. Current works find that LLMs fall short on questions around low-frequency entities. However, such proofs are unreliable since the questions can…

Computation and Language · Computer Science 2025-05-27 Qing Zong , Zhaowei Wang , Tianshi Zheng , Xiyu Ren , Yangqiu Song

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

Machine Learning · Statistics 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta

Machine learning methods are increasingly widely used in high-risk settings such as healthcare, transportation, and finance. In these settings, it is important that a model produces calibrated uncertainty to reflect its own confidence and…

Artificial Intelligence · Computer Science 2022-09-09 Sophia Sun

Quantifying uncertainty in large language models (LLMs) is important for safety-critical applications because it helps spot incorrect answers, known as hallucinations. One major trend of uncertainty quantification methods is based on…

Computation and Language · Computer Science 2025-10-07 Lucie Kunitomo-Jacquin , Edison Marrese-Taylor , Ken Fukuda

Inverse Uncertainty Quantification (UQ), or Bayesian calibration, is the process to quantify the uncertainties of random input parameters based on experimental data. The introduction of model discrepancy term is significant because…

Applications · Statistics 2019-07-24 Xu Wu , Koroush Shirvan , Tomasz Kozlowski