English
Related papers

Related papers: On Verbalized Confidence Scores for LLMs

200 papers

LLMs often adopt an assertive language style also when making false claims. Such ``overconfident hallucinations'' mislead users and erode trust. Achieving the ability to express in language the actual degree of uncertainty around a claim is…

Computation and Language · Computer Science 2025-04-24 Ziwei Ji , Lei Yu , Yeskendir Koishekenov , Yejin Bang , Anthony Hartshorn , Alan Schelten , Cheng Zhang , Pascale Fung , Nicola Cancedda

Large language models are often not just wrong, but \emph{confidently wrong}: when they produce factually incorrect answers, they tend to verbalize overly high confidence rather than signal uncertainty. Such verbalized overconfidence can…

Computation and Language · Computer Science 2026-04-03 Tianyi Zhao , Yinhan He , Wendy Zheng , Yujie Zhang , Chen Chen

Large language models (LLMs) often present answers with high apparent confidence despite lacking an explicit mechanism for reasoning about certainty or truth. While existing benchmarks primarily evaluate single-turn accuracy, truthfulness…

Computation and Language · Computer Science 2026-03-05 Mohammadreza Saadat , Steve Nemzer

Large Language Models (LLMs) have shown impressive performance in mathematical reasoning tasks when guided by Chain-of-Thought (CoT) prompting. However, they tend to produce highly confident yet incorrect outputs, which poses significant…

Machine Learning · Computer Science 2025-06-11 Zhenjiang Mao , Artem Bisliouk , Rohith Reddy Nama , Ivan Ruchkin

Large language models (LLMs) have shown promising performance across various tasks. However, their autoregressive decoding process poses significant challenges for efficient deployment on existing AI hardware. Quantization alleviates memory…

Machine Learning · Computer Science 2025-12-01 Guanxi Lu , Hao Mark Chen , Zhiqiang Que , Wayne Luk , Hongxiang Fan

Uncertainty quantification has emerged as an effective approach to closed-book hallucination detection for LLMs, but existing methods are largely designed for short-form outputs and do not generalize well to long-form generation. We…

Computation and Language · Computer Science 2026-02-20 Dylan Bouchard , Mohit Singh Chauhan , Viren Bajaj , David Skarbrevik

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

Computation and Language · Computer Science 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao

Large Language Models (LLMs) have demonstrated exceptional capabilities, yet selecting the most reliable response from multiple LLMs remains a challenge, particularly in resource-constrained settings. Existing approaches often depend on…

Computation and Language · Computer Science 2025-10-06 Aakriti Agrawal , Rohith Aralikatti , Anirudh Satheesh , Souradip Chakraborty , Amrit Singh Bedi , Furong Huang

Large language models (LLMs) are rapidly being integrated into computational social science research, yet their blackboxed training and designed stochastic elements in inference pose unique challenges for scientific inquiry. This article…

Computers and Society · Computer Science 2025-12-08 Bolun Zhang , Linzhuo Li , Yunqi Chen , Qinlin Zhao , Zihan Zhu , Xiaoyuan Yi , Xing Xie

We study the source of uncertainty in DeepSeek R1-32B by analyzing its self-reported verbal confidence on question answering (QA) tasks. In the default answer-then-confidence setting, the model is regularly over-confident, whereas semantic…

Computation and Language · Computer Science 2025-11-06 Jakub Podolak , Rajeev Verma

Confidence in LLMs is a useful indicator of model uncertainty and answer reliability. Existing work mainly focused on single-turn scenarios, while research on confidence in complex multi-turn interactions is limited. In this paper, we…

Computation and Language · Computer Science 2025-10-29 Litu Ou , Kuan Li , Huifeng Yin , Liwen Zhang , Zhongwang Zhang , Xixi Wu , Rui Ye , Zile Qiao , Pengjun Xie , Jingren Zhou , Yong Jiang

Large Language Models (LLMs) can produce surprisingly sophisticated estimates of their own uncertainty. However, it remains unclear to what extent this expressed confidence is tied to the reasoning, knowledge, or decision making of the…

Machine Learning · Computer Science 2026-01-13 Jiawei Wang , Yanfei Zhou , Siddartha Devic , Deqing Fu

While large language models (LLMs) improve performance by explicit reasoning, their responses are often overconfident, even though they include linguistic expressions demonstrating uncertainty. In this work, we identify what linguistic…

Computation and Language · Computer Science 2026-04-08 Shintaro Ozaki , Wataru Hashimoto , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

Large language models (LLMs) often generate fluent but factually incorrect outputs, known as hallucinations, which undermine their reliability in real-world applications. While uncertainty estimation has emerged as a promising strategy for…

Machine Learning · Computer Science 2025-05-13 Pei-Fu Guo , Yun-Da Tsai , Shou-De Lin

The Large language models (LLMs) have showcased superior capabilities in sophisticated tasks across various domains, stemming from basic question-answer (QA), they are nowadays used as decision assistants or explainers for unfamiliar…

Computation and Language · Computer Science 2024-07-09 Longchao Da , Tiejin Chen , Lu Cheng , Hua Wei

It is increasingly important to evaluate how text generation systems based on large language models (LLMs) behave, such as their tendency to produce harmful output or their sensitivity to adversarial inputs. Such evaluations often rely on a…

Computation and Language · Computer Science 2025-11-17 Rachel Longjohn , Shang Wu , Saatvik Kher , Catarina Belém , Padhraic Smyth

We introduce a novel approach for calibrating uncertainty quantification (UQ) tailored for multi-modal large language models (LLMs). Existing state-of-the-art UQ methods rely on consistency among multiple responses generated by the LLM on…

Large Language Models (LLMs) have been widely employed in programming language analysis to enhance human productivity. Yet, their reliability can be compromised by various code distribution shifts, leading to inconsistent outputs. While…

Software Engineering · Computer Science 2024-02-12 Yufei Li , Simin Chen , Yanghong Guo , Wei Yang , Yue Dong , Cong Liu

Large Language Models (LLMs) increasingly show reasoning rationales alongside their answers, turning "reasoning" into a user-interface element. While step-by-step rationales are typically associated with model performance, how they…

Human-Computer Interaction · Computer Science 2026-03-10 Xin Sun , Shu Wei , Jos A Bosch , Isao Echizen , Saku Sugawara , Abdallah El Ali

Large Language Models (LLMs) are increasingly used in clinical settings, where sensitivity to linguistic uncertainty can influence diagnostic interpretation and decision-making. Yet little is known about where such epistemic cues are…

Computation and Language · Computer Science 2025-12-01 Srivarshinee Sridhar , Raghav Kaushik Ravi , Kripabandhu Ghosh