English
Related papers

Related papers: LogitScope: A Framework for Analyzing LLM Uncertai…

200 papers

We explore uncertainty quantification in large language models (LLMs), with the goal to identify when uncertainty in responses given a query is large. We simultaneously consider both epistemic and aleatoric uncertainties, where the former…

Machine Learning · Computer Science 2024-07-18 Yasin Abbasi Yadkori , Ilja Kuzborskij , András György , Csaba Szepesvári

Large language models (LLMs) specializing in natural language generation (NLG) have recently started exhibiting promising capabilities across a variety of domains. However, gauging the trustworthiness of responses generated by LLMs remains…

Computation and Language · Computer Science 2024-05-21 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

This paper surveys evaluation techniques to enhance the trustworthiness and understanding of Large Language Models (LLMs). As reliance on LLMs grows, ensuring their reliability, fairness, and transparency is crucial. We explore algorithmic…

Computation and Language · Computer Science 2024-06-05 Nik Bear Brown

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

Large Language Models (LLMs) that can express interpretable and calibrated uncertainty are crucial in high-stakes domains. While methods to compute uncertainty post-hoc exist, they are often sampling-based and therefore computationally…

Machine Learning · Computer Science 2026-03-09 Azza Jenane , Nassim Walha , Lukas Kuhn , Florian Buettner

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty…

Computation and Language · Computer Science 2025-05-30 Zhiqiu Xia , Jinxuan Xu , Yuqian Zhang , Hang Liu

We introduce BSDetector, a method for detecting bad and speculative answers from a pretrained Large Language Model by estimating a numeric confidence score for any output it generated. Our uncertainty quantification technique works for any…

Computation and Language · Computer Science 2023-10-05 Jiuhai Chen , Jonas Mueller

The generation of texts using Large Language Models (LLMs) is inherently uncertain, with sources of uncertainty being not only the generation of texts, but also the prompt used and the downstream interpretation. Within this work, we provide…

Machine Learning · Computer Science 2026-03-30 Steffen Herbold , Florian Lemmerich

Despite recent progress in systematic evaluation frameworks, benchmarking the uncertainty of large language models (LLMs) remains a highly challenging task. Existing methods for benchmarking the uncertainty of LLMs face three key…

Computation and Language · Computer Science 2025-06-05 Xunzhi Wang , Zhuowei Zhang , Gaonan Chen , Qiongyu Li , Bitong Luo , Zhixin Han , Haotian Wang , Zhiyu li , Hang Gao , Mengting Hu

Large Language Models (LLMs) are known to produce very high-quality tests and responses to our queries. But how much can we trust this generated text? In this paper, we study the problem of uncertainty quantification in LLMs. We propose a…

Computation and Language · Computer Science 2025-04-28 Muhammad Mubashar , Shireen Kudukkil Manchingal , Fabio Cuzzolin

Understanding the internal representations of large language models (LLMs) can help explain models' behavior and verify their alignment with human values. Given the capabilities of LLMs in generating human-understandable text, we propose…

Computation and Language · Computer Science 2024-06-10 Asma Ghandeharioun , Avi Caciularu , Adam Pearce , Lucas Dixon , Mor Geva

Can large language models (LLMs) express their uncertainty in situations where they lack sufficient parametric knowledge to generate reasonable responses? This work aims to systematically investigate LLMs' behaviors in such situations,…

Computation and Language · Computer Science 2024-02-19 Genglin Liu , Xingyao Wang , Lifan Yuan , Yangyi Chen , Hao Peng

Large language models (LLMs) are stochastic, and not all models give deterministic answers, even when setting temperature to zero with a fixed random seed. However, few benchmark studies attempt to quantify uncertainty, partly due to the…

Computation and Language · Computer Science 2025-06-30 Robert E. Blackwell , Jon Barry , Anthony G. Cohn

Prompt optimization algorithms for Large Language Models (LLMs) excel in multi-step reasoning but still lack effective uncertainty estimation. This paper introduces a benchmark dataset to evaluate uncertainty metrics, focusing on Answer,…

Machine Learning · Computer Science 2024-12-30 Pei-Fu Guo , Yun-Da Tsai , Shou-De Lin

Third-party Large Language Model (LLM) API gateways are rapidly emerging as unified access points to models offered by multiple vendors. However, the internal routing, caching, and billing policies of these gateways are largely undisclosed,…

Cryptography and Security · Computer Science 2026-04-24 Guanjie Lin , Yinxin Wan , Shichao Pei , Ting Xu , Kuai Xu , Guoliang Xue

Empowering large language models to accurately express confidence in their answers is essential for trustworthy decision-making. Previous confidence elicitation methods, which primarily rely on white-box access to internal model information…

Computation and Language · Computer Science 2024-03-19 Miao Xiong , Zhiyuan Hu , Xinyang Lu , Yifei Li , Jie Fu , Junxian He , Bryan Hooi

Large Language Models (LLMs) have demonstrated remarkable proficiency in various natural language generation (NLG) tasks. Previous studies suggest that LLMs' generation process involves uncertainty. However, existing approaches to…

Computation and Language · Computer Science 2024-09-06 Yu-Hsiang Wang , Andrew Bai , Che-Ping Tsai , Cho-Jui Hsieh

Large language models (LLMs) are increasingly deployed in settings where the available context is incomplete or degraded. We argue that an LLM generating answers under incomplete context can be viewed as an implicit imputer, and evaluated…

Machine Learning · Statistics 2026-05-14 Stef van Buuren

Large language models (LLMs) produce outputs with varying levels of uncertainty, and, just as often, varying levels of correctness; making their practical reliability far from guaranteed. To quantify this uncertainty, we systematically…

Computation and Language · Computer Science 2025-10-24 Christian Hobelsberger , Theresa Winner , Andreas Nawroth , Oliver Mitevski , Anna-Carolina Haensch

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla