English
Related papers

Related papers: Efficient semantic uncertainty quantification in l…

200 papers

Large Language Diffusion Models (LLDMs) are emerging as an alternative to autoregressive models, offering faster inference through higher parallelism. Similar to autoregressive LLMs, they remain prone to hallucinations, making reliable…

Computation and Language · Computer Science 2026-05-15 Artem Vazhentsev , Vladislav Smirnov , David Li , Maxim Panov , Timothy Baldwin , Artem Shelmanov

Uncertainty decomposition refers to the task of decomposing the total uncertainty of a predictive model into aleatoric (data) uncertainty, resulting from inherent randomness in the data-generating process, and epistemic (model) uncertainty,…

Computation and Language · Computer Science 2024-06-12 Bairu Hou , Yujian Liu , Kaizhi Qian , Jacob Andreas , Shiyu Chang , Yang Zhang

As large language models (LLMs) are increasingly integrated into high-stakes decision-making, the ability to reliably quantify uncertainty has become a critical requirement for safety and trust. However, current uncertainty quantification…

Artificial Intelligence · Computer Science 2026-05-28 Seongjun Lee , Suwan Yoon , Changhee Lee

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks due to large training datasets and powerful transformer architecture. However, the reliability of responses from LLMs remains a question.…

Computation and Language · Computer Science 2025-02-26 Tiejin Chen , Xiaoou Liu , Longchao Da , Jia Chen , Vagelis Papalexakis , Hua Wei

This paper provides an in-depth examination of the concept of semantic diffusion as a complementary instrument to large language models (LLMs) for design applications. Conventional LLMs and diffusion models fail to induce a convergent,…

Human-Computer Interaction · Computer Science 2025-05-15 Alexander P. Ryjov , Alina A. Egorova

Prompt optimization algorithms for Large Language Models (LLMs) excel in multi-step reasoning but still lack effective uncertainty estimation. This paper introduces a benchmark dataset to evaluate uncertainty metrics, focusing on Answer,…

Machine Learning · Computer Science 2024-12-30 Pei-Fu Guo , Yun-Da Tsai , Shou-De Lin

As large language models (LLMs) continue to evolve, understanding and quantifying the uncertainty in their predictions is critical for enhancing application credibility. However, the existing literature relevant to LLM uncertainty…

Computation and Language · Computer Science 2024-10-22 Hsiu-Yuan Huang , Yutong Yang , Zhaoxi Zhang , Sanwoo Lee , Yunfang Wu

Accurate uncertainty quantification remains a key challenge for standard LLMs, prompting the adoption of Bayesian and ensemble-based methods. However, such methods typically necessitate computationally expensive sampling, involving multiple…

Machine Learning · Computer Science 2025-07-25 Lakshmana Sri Harsha Nemani , P. K. Srijith , Tomasz Kuśmierczyk

Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflicts with real-world facts, and their persuasive style can…

Computation and Language · Computer Science 2024-09-19 Arslan Chaudhry , Sridhar Thiagarajan , Dilan Gorur

Large Language Models (LLMs) are commonly used in Question Answering (QA) settings, increasingly in the natural sciences if not science at large. Reliable Uncertainty Quantification (UQ) is critical for the trustworthy uptake of generated…

Computation and Language · Computer Science 2026-02-03 Philip Müller , Nicholas Popovič , Michael Färber , Peter Steinbach

In this paper, we present a dynamic semantic clustering approach inspired by the Chinese Restaurant Process, aimed at addressing uncertainty in the inference of Large Language Models (LLMs). We quantify uncertainty of an LLM on a given…

Uncertainty quantification approaches have been more critical in large language models (LLMs), particularly high-risk applications requiring reliable outputs. However, traditional methods for uncertainty quantification, such as…

Artificial Intelligence · Computer Science 2024-07-01 Ferhat Ozgur Catak , Murat Kuzlu

Despite the impressive capability of large language models (LLMs), knowing when to trust their generations remains an open challenge. The recent literature on uncertainty quantification of natural language generation (NLG) utilises a…

Computation and Language · Computer Science 2024-06-06 Shuang Ao , Stefan Rueger , Advaith Siddharthan

Although large language models (LLMs) are highly interactive and extendable, current approaches to ensure reliability in deployments remain mostly limited to rejecting outputs with high uncertainty in order to avoid misinformation. This…

Machine Learning · Computer Science 2025-06-10 T. Duy Nguyen-Hien , Desi R. Ivanova , Yee Whye Teh , Wee Sun Lee

Despite demonstrating impressive capabilities, Large Language Models (LLMs) still often struggle to accurately express the factual knowledge they possess, especially in cases where the LLMs' knowledge boundaries are ambiguous. To improve…

Computation and Language · Computer Science 2025-05-26 Boyang Xue , Fei Mi , Qi Zhu , Hongru Wang , Rui Wang , Sheng Wang , Erxin Yu , Xuming Hu , Kam-Fai Wong

Supervised masking approaches in the time-frequency domain aim to employ deep neural networks to estimate a multiplicative mask to extract clean speech. This leads to a single estimate for each input without any guarantees or measures of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-16 Huajian Fang , Dennis Becker , Stefan Wermter , Timo Gerkmann

Large Language Models (LLMs) have demonstrated remarkable capability in a variety of NLP tasks. However, LLMs are also prone to generate nonfactual content. Uncertainty Quantification (UQ) is pivotal in enhancing our understanding of a…

Computation and Language · Computer Science 2024-10-07 Caiqi Zhang , Fangyu Liu , Marco Basaldella , Nigel Collier

Large language models (LLMs) have delivered significant breakthroughs across diverse domains but can still produce unreliable or misleading outputs, posing critical challenges for real-world applications. While many recent studies focus on…

Computation and Language · Computer Science 2025-09-08 Yang Nan , Pengfei He , Ravi Tandon , Han Xu

Uncertainty quantification enables users to assess the reliability of responses generated by large language models (LLMs). We present a novel Question Rephrasing technique to evaluate the input uncertainty of LLMs, which refers to the…

Computation and Language · Computer Science 2024-08-08 Zizhang Chen , Pengyu Hong , Sandeep Madireddy

Large-language models (LLMs) and chatbot agents are known to provide wrong outputs at times, and it was recently found that this can never be fully prevented. Hence, uncertainty quantification plays a crucial role, aiming to quantify the…

Machine Learning · Computer Science 2025-05-29 Michael Kirchhof , Gjergji Kasneci , Enkelejda Kasneci