中文
相关论文

相关论文: Aligning Large Language Models for Faithful Integr…

200 篇论文

Instruction-tuned Large Language Models (LLMs) excel at many tasks and will even explain their reasoning, so-called self-explanations. However, convincing and wrong self-explanations can lead to unsupported confidence in LLMs, thus…

计算与语言 · 计算机科学 2024-05-20 Andreas Madsen , Sarath Chandar , Siva Reddy

Large Language Models (LLMs) can produce surprisingly sophisticated estimates of their own uncertainty. However, it remains unclear to what extent this expressed confidence is tied to the reasoning, knowledge, or decision making of the…

机器学习 · 计算机科学 2026-01-13 Jiawei Wang , Yanfei Zhou , Siddartha Devic , Deqing Fu

Recent progress in large language models (LLMs) has enabled them to communicate their confidence in natural language, improving transparency and reliability. However, this expressiveness is often accompanied by systematic overconfidence,…

计算与语言 · 计算机科学 2026-05-04 Ki Jung Seo , Sehun Lim , Taeuk Kim

Previous works on Large Language Models (LLMs) have mainly focused on evaluating their helpfulness or harmlessness. However, honesty, another crucial alignment criterion, has received relatively less attention. Dishonest behaviors in LLMs,…

计算与语言 · 计算机科学 2024-07-10 Steffi Chern , Zhulin Hu , Yuqing Yang , Ethan Chern , Yuan Guo , Jiahe Jin , Binjie Wang , Pengfei Liu

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, but often exhibit overconfidence and generate plausible yet incorrect answers. This overconfidence, especially in models undergone…

计算与语言 · 计算机科学 2025-12-24 Zeguan Xiao , Diyang Dou , Boya Xiong , Yun Chen , Guanhua Chen

Large Language Models (LLMs) have shown significant advances in text generation but often lack the reliability needed for autonomous deployment in high-stakes domains like healthcare, law, and finance. Existing approaches rely on external…

人工智能 · 计算机科学 2024-11-12 Ninad Naik

Large Language Models (LLMs) can generate plausible free text self-explanations to justify their answers. However, these natural language explanations may not accurately reflect the model's actual reasoning process, pinpointing a lack of…

计算与语言 · 计算机科学 2026-01-30 Milan Bhan , Jean-Noel Vittaut , Nicolas Chesneau , Sarath Chandar , Marie-Jeanne Lesot

Large Language Models (LLMs) have shown impressive capabilities in various applications, but they still face various inconsistency issues. Existing works primarily focus on the inconsistency issues within a single LLM, while we…

计算与语言 · 计算机科学 2024-11-15 Kai Xiong , Xiao Ding , Yixin Cao , Ting Liu , Bing Qin

Large Language Models (LLMs) exhibit remarkable fluency and competence across various natural language tasks. However, recent research has highlighted their sensitivity to variations in input prompts. To deploy LLMs in a safe and reliable…

计算与语言 · 计算机科学 2025-04-30 Harsh Raj , Vipul Gupta , Domenic Rosati , Subhabrata Majumdar

Recent years have witnessed remarkable progress made in large language models (LLMs). Such advancements, while garnering significant attention, have concurrently elicited various concerns. The potential of these models is undeniably vast;…

计算与语言 · 计算机科学 2023-09-27 Tianhao Shen , Renren Jin , Yufei Huang , Chuang Liu , Weilong Dong , Zishan Guo , Xinwei Wu , Yan Liu , Deyi Xiong

The fairness and trustworthiness of Large Language Models (LLMs) are receiving increasing attention. Implicit hate speech, which employs indirect language to convey hateful intentions, occupies a significant portion of practice. However,…

计算与语言 · 计算机科学 2024-07-24 Min Zhang , Jianfeng He , Taoran Ji , Chang-Tien Lu

Language model outputs are not always reliable, thus prompting research into how to adapt model responses based on uncertainty. Common approaches include: \emph{abstention}, where models refrain from generating responses when uncertain; and…

计算与语言 · 计算机科学 2025-08-13 Zhengping Jiang , Anqi Liu , Benjamin Van Durme

While large language models (LLMs) are proficient at question-answering (QA), it is not always clear how (or even if) an answer follows from their latent "beliefs". This lack of interpretability is a growing impediment to widespread use of…

计算与语言 · 计算机科学 2023-10-31 Nora Kassner , Oyvind Tafjord , Ashish Sabharwal , Kyle Richardson , Hinrich Schuetze , Peter Clark

Large Language Model (LLM) can enhance its credibility and verifiability by generating text with citations. However, existing research on citation generation is predominantly limited to sentence-level statements, neglecting the significance…

计算与语言 · 计算机科学 2026-02-03 Yilong Xu , Jinhua Gao , Xiaoming Yu , Baolong Bi , Huawei Shen , Xueqi Cheng

Large language models (LLMs) augmented with retrieval systems have demonstrated significant potential in handling knowledge-intensive tasks. However, these models often struggle with unfaithfulness issues, generating outputs that either…

计算与语言 · 计算机科学 2025-07-09 Qinggang Zhang , Zhishang Xiang , Yilin Xiao , Le Wang , Junhui Li , Xinrun Wang , Jinsong Su

Large Language Models (LLMs) are expected to be predictable and trustworthy to support reliable decision-making systems. Yet current LLMs often show inconsistencies in their judgments. In this work, we examine logical preference consistency…

计算与语言 · 计算机科学 2025-02-11 Yinhong Liu , Zhijiang Guo , Tianya Liang , Ehsan Shareghi , Ivan Vulić , Nigel Collier

As language models (LMs) become integral to fields like healthcare, law, and journalism, their ability to differentiate between fact, belief, and knowledge is essential for reliable decision-making. Failure to grasp these distinctions can…

计算与语言 · 计算机科学 2024-10-29 Mirac Suzgun , Tayfun Gur , Federico Bianchi , Daniel E. Ho , Thomas Icard , Dan Jurafsky , James Zou

Confidence calibration is essential for making large language models (LLMs) reliable, yet existing training-free methods have been primarily studied under single-answer question answering. In this paper, we show that these methods break…

计算与语言 · 计算机科学 2026-02-10 Yuhan Wang , Shiyu Ni , Zhikai Ding , Zihang Zhan , Yuanzi Li , Keping Bi

Recent benchmarks have probed factual consistency and rhetorical robustness in Large Language Models (LLMs). However, a knowledge gap exists regarding how directional framing of factually true statements influences model agreement, a common…

计算与语言 · 计算机科学 2025-06-16 Jaeho Lee , Atharv Chowdhary

The conformity effect describes the tendency of individuals to align their responses with the majority. Studying this bias in large language models (LLMs) is crucial, as LLMs are increasingly used in various information-seeking and…

计算与语言 · 计算机科学 2025-05-27 Xiaochen Zhu , Caiqi Zhang , Tom Stafford , Nigel Collier , Andreas Vlachos