中文
相关论文

相关论文: Confidence Estimation for LLMs in Multi-turn Inter…

200 篇论文

Large Language Models (LLMs) excel at single-turn tasks such as instruction following and summarization, yet real-world deployments require sustained multi-turn interactions where user goals and conversational context persist and evolve. A…

计算与语言 · 计算机科学 2025-11-25 Vardhan Dongre , Ryan A. Rossi , Viet Dac Lai , David Seunghyun Yoon , Dilek Hakkani-Tür , Trung Bui

Large language models (LLMs) have been widely applied in various fields due to their excellent capability for memorizing knowledge and chain of thought (CoT). When these language models are applied in the field of psychological counseling,…

计算与语言 · 计算机科学 2023-11-02 Yirong Chen , Xiaofen Xing , Jingkai Lin , Huimin Zheng , Zhenyu Wang , Qi Liu , Xiangmin Xu

Large Language Models (LLMs) show remarkable proficiency in natural language tasks, yet their frequent overconfidence-misalignment between predicted confidence and true correctness-poses significant risks in critical decision-making…

计算与语言 · 计算机科学 2025-12-15 Prateek Chhikara

Large language models, LLMs, are increasingly deployed in multiturn settings where earlier responses shape later ones, making reliability dependent on whether a conversation remains consistent over time. When this consistency degrades…

计算与语言 · 计算机科学 2026-04-20 Wael Hafez , Amir Nazeri

To enhance Large Language Models' (LLMs) reliability, calibration is essential -- the model's assessed confidence scores should align with the actual likelihood of its responses being correct. However, current confidence elicitation methods…

计算与语言 · 计算机科学 2024-10-29 Yukun Huang , Yixin Liu , Raghuveer Thirukovalluru , Arman Cohan , Bhuwan Dhingra

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

计算与语言 · 计算机科学 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Large Language Models (LLMs) are increasingly used in settings where reliable self-assessment is critical. Assessing model reliability has evolved from using probabilistic correctness estimates to, more recently, eliciting verbalized…

计算与语言 · 计算机科学 2026-05-11 Sree Bhattacharyya , Samarth Khanna , Leona Chen , Lucas Craig , Tharun Dilliraj , James Z. Wang

Hallucinations are outputs by Large Language Models (LLMs) that are factually incorrect yet appear plausible [1]. This paper investigates how such hallucinations influence users' trust in LLMs and users' interaction with LLMs. To explore…

人工智能 · 计算机科学 2025-12-11 Adrian Ryser , Florian Allwein , Tim Schlippe

Repair, an important resource for resolving trouble in human-human conversation, remains underexplored in human-LLM interaction. In this study, we investigate how LLMs engage in the interactive process of repair in multi-turn dialogues…

计算与语言 · 计算机科学 2026-04-23 Clara Lachenmaier , Hannah Bultmann , Sina Zarrieß

Verbal confidence -- prompting LLMs to state their confidence as a number or category -- is widely used to extract uncertainty estimates from black-box models. However, how LLMs internally generate such scores remains unknown. We address…

计算与语言 · 计算机科学 2026-05-20 Dharshan Kumaran , Arthur Conmy , Federico Barbero , Simon Osindero , Viorica Patraucean , Petar Veličković

Language Models (LMs) have shown promising performance in natural language generation. However, as LMs often generate incorrect or hallucinated responses, it is crucial to correctly quantify their uncertainty in responding to given inputs.…

计算与语言 · 计算机科学 2024-09-17 Xinmeng Huang , Shuo Li , Mengxin Yu , Matteo Sesia , Hamed Hassani , Insup Lee , Osbert Bastani , Edgar Dobriban

As Large Language Models (LLMs) are increasingly deployed in decision-critical domains, it becomes essential to ensure that their confidence estimates faithfully correspond to their actual correctness. Existing calibration methods have…

计算与语言 · 计算机科学 2025-08-21 Ke Fang , Tianyi Zhao , Lu Cheng

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

计算与语言 · 计算机科学 2025-11-20 Moses Kiprono

Large Language Models (LLMs) have exhibited remarkable performance across various downstream tasks, but they may generate inaccurate or false information with a confident tone. One of the possible solutions is to empower the LLM confidence…

计算与语言 · 计算机科学 2024-04-17 Haixia Han , Tingyun Li , Shisong Chen , Jie Shi , Chengyu Du , Yanghua Xiao , Jiaqing Liang , Xin Lin

Large language models are often not just wrong, but \emph{confidently wrong}: when they produce factually incorrect answers, they tend to verbalize overly high confidence rather than signal uncertainty. Such verbalized overconfidence can…

计算与语言 · 计算机科学 2026-04-03 Tianyi Zhao , Yinhan He , Wendy Zheng , Yujie Zhang , Chen Chen

Large Language Models (LLMs) still face challenges when dealing with complex reasoning tasks, often resulting in hallucinations, which limit the practical application of LLMs. To alleviate this issue, this paper proposes a new method that…

人工智能 · 计算机科学 2024-11-26 Zhihua Duan , Jialin Wang

Persona-driven large language models (LLMs) require consistent behavioral tendencies across interactions to simulate human-like personality traits, such as persistence or reliability. However, current LLMs often lack stable internal…

计算与语言 · 计算机科学 2026-03-27 Yifan Luo , Kangping Xu , Yanzhen Lu , Yang Yuan , Andrew Chi-Chih Yao

Large language models (LLMs) have been widely used for mental health support. However, current safety evaluations in this field are mostly limited to detecting whether LLMs output prohibited words in single-turn conversations, neglecting…

计算与语言 · 计算机科学 2026-01-22 Youyou Cheng , Zhuangwei Kang , Kerry Jiang , Chenyu Sun , Qiyang Pan

As large language models (LLMs) continue to evolve, understanding and quantifying the uncertainty in their predictions is critical for enhancing application credibility. However, the existing literature relevant to LLM uncertainty…

计算与语言 · 计算机科学 2024-10-22 Hsiu-Yuan Huang , Yutong Yang , Zhaoxi Zhang , Sanwoo Lee , Yunfang Wu

As artificial intelligence (AI) systems, particularly large language models (LLMs), become increasingly integrated into decision-making processes, the ability to trust their outputs is crucial. To earn human trust, LLMs must be well…