English
Related papers

Related papers: Calibrating Verbalized Confidence with Self-Genera…

200 papers

Self-consistency decoding enhances LLMs' performance on reasoning tasks by sampling diverse reasoning paths and selecting the most frequent answer. However, it is computationally expensive, as sampling many of these (lengthy) paths is…

Computation and Language · Computer Science 2025-09-30 Amir Taubenfeld , Tom Sheffer , Eran Ofek , Amir Feder , Ariel Goldstein , Zorik Gekhman , Gal Yona

As Large Language Models (LLMs) are increasingly deployed in decision-critical domains, it becomes essential to ensure that their confidence estimates faithfully correspond to their actual correctness. Existing calibration methods have…

Computation and Language · Computer Science 2025-08-21 Ke Fang , Tianyi Zhao , Lu Cheng

Large language models (LLMs) are increasingly used in social science as scalable measurement tools for converting unstructured text into variables that can enter standard empirical designs. Measurement validity demands more than high…

Artificial Intelligence · Computer Science 2026-05-13 Jinyuan Wang , Ningyuan Deng , Yi Yang

The tendency of Large Language Models (LLMs) to generate hallucinations raises concerns regarding their reliability. Therefore, confidence estimations indicating the extent of trustworthiness of the generations become essential. However,…

Computation and Language · Computer Science 2024-10-21 Boyang Xue , Hongru Wang , Rui Wang , Sheng Wang , Zezhong Wang , Yiming Du , Bin Liang , Kam-Fai Wong

Large Language Models (LLMs) are increasingly used as powerful tools for several high-stakes natural language processing (NLP) applications. Recent prompting works claim to elicit intermediate reasoning steps and key tokens that serve as…

Computation and Language · Computer Science 2023-11-08 Sree Harsha Tanneru , Chirag Agarwal , Himabindu Lakkaraju

The advent of pre-trained language models (PLMs) has enabled significant performance gains in the field of natural language processing. However, recent studies have found PLMs to suffer from miscalibration, indicating a lack of accuracy in…

Computation and Language · Computer Science 2024-12-23 Geetanjali Bihani , Julia Rayz

Large language models (LLMs) are widely deployed as general-purpose problem solvers, making accurate confidence estimation critical for reliable use. Prior work on LLM calibration largely focuses on response-level confidence, which…

Computation and Language · Computer Science 2026-02-17 Sin-Han Yang , Cheng-Kuang Wu , Chieh-Yen Lin , Yun-Nung Chen , Hung-yi Lee , Shao-Hua Sun

Knowing the reliability of a model's response is essential in practical applications. Given the strong generation capabilities of large language models (LLMs), research has focused on generating verbalized confidence. This approach is…

Computation and Language · Computer Science 2026-04-02 Ante Wang , Weizhi Ma , Yang Liu

Post-training of large language models is essential for adapting pre-trained language models (PLMs) to align with human preferences and downstream tasks. While PLMs typically exhibit well-calibrated confidence, post-trained language models…

Machine Learning · Computer Science 2025-11-26 Beier Luo , Shuoyuan Wang , Sharon Li , Hongxin Wei

Large language models (LLMs) have shown high agreement with human raters across a variety of tasks, demonstrating potential to ease the challenges of human data collection. In computational social science (CSS), researchers are increasingly…

Computation and Language · Computer Science 2025-02-11 Kristina Gligorić , Tijana Zrnic , Cinoo Lee , Emmanuel J. Candès , Dan Jurafsky

While confidence estimation is a promising direction for mitigating hallucinations in Large Language Models (LLMs), current research overwhelmingly focuses on single-turn settings. The dynamics of model confidence in multi-turn…

Computation and Language · Computer Science 2026-05-15 Caiqi Zhang , Ruihan Yang , Xiaochen Zhu , Chengzu Li , Tiancheng Hu , Yijiang River Dong , Deqing Yang , Nigel Collier

Hallucinations are outputs by Large Language Models (LLMs) that are factually incorrect yet appear plausible [1]. This paper investigates how such hallucinations influence users' trust in LLMs and users' interaction with LLMs. To explore…

Artificial Intelligence · Computer Science 2025-12-11 Adrian Ryser , Florian Allwein , Tim Schlippe

Pre-trained language models (PLMs) may fail in giving reliable estimates of their predictive uncertainty. We take a close look into this problem, aiming to answer two questions: (1) Do PLMs learn to become calibrated in the training…

Computation and Language · Computer Science 2023-05-09 Yangyi Chen , Lifan Yuan , Ganqu Cui , Zhiyuan Liu , Heng Ji

Large language models (LLMs) often exhibit deficient reasoning or generate hallucinations. To address these, studies prefixed with "Self-" such as Self-Consistency, Self-Improve, and Self-Refine have been initiated. They share a…

Computation and Language · Computer Science 2024-09-19 Xun Liang , Shichao Song , Zifan Zheng , Hanyu Wang , Qingchen Yu , Xunkai Li , Rong-Hua Li , Yi Wang , Zhonghao Wang , Feiyu Xiong , Zhiyu Li

Large language models (LLMs) are increasingly used in decision-making contexts, but when they present answers without signaling low confidence, users may unknowingly act on erroneous outputs. Prior work shows that LLMs maintain internal…

Computation and Language · Computer Science 2025-10-23 Mark Steyvers , Catarina Belem , Padhraic Smyth

The advent of large language models (LLMs) has dramatically advanced the state-of-the-art in numerous natural language generation tasks. For LLMs to be applied reliably, it is essential to have an accurate measure of their confidence.…

Computation and Language · Computer Science 2024-06-05 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Large language models (LLMs) excel at numerical estimation but struggle to correctly quantify uncertainty. We study how well LLMs construct confidence intervals around their own answers and find that they are systematically overconfident.…

Methodology · Statistics 2025-11-03 Elliot L. Epstein , John Winnicki , Thanawat Sornwanee , Rajat Dwaraknath

This paper proposes the use of "multicalibration" to yield interpretable and reliable confidence scores for outputs generated by large language models (LLMs). Multicalibration asks for calibration not just marginally, but simultaneously…

Machine Learning · Statistics 2024-04-09 Gianluca Detommaso , Martin Bertran , Riccardo Fogliato , Aaron Roth

Intrinsic self-correct was a method that instructed large language models (LLMs) to verify and correct their responses without external feedback. Unfortunately, the study concluded that the LLMs could not self-correct reasoning yet. We find…

Computation and Language · Computer Science 2024-10-04 Zhenyu Wu , Qingkai Zeng , Zhihan Zhang , Zhaoxuan Tan , Chao Shen , Meng Jiang

Large Language Models (LLMs) in multi-turn conversations often suffer from a ``lost-in-conversation'' phenomenon, where they struggle to recover from early incorrect assumptions, particularly when users provide ambiguous initial…

Computation and Language · Computer Science 2026-01-23 Zhebo Wang , Xiaohu Mu , Zijie Zhou , Mohan Li , Wenpeng Xing , Dezhang Kong , Meng Han