中文
相关论文

相关论文: Are Large Language Models More Honest in Their Pro…

200 篇论文

Large Language Models have been demonstrating broadly satisfactory generative abilities for users, which seems to be due to the intensive use of human feedback that refines responses. Nevertheless, suggestibility inherited via human…

计算与语言 · 计算机科学 2025-06-26 Leonardo Ranaldi , Giulia Pucci

The propensity of Large Language Models (LLMs) to generate hallucinations and non-factual content undermines their reliability in high-stakes domains, where rigorous control over Type I errors (the conditional probability of incorrectly…

计算与语言 · 计算机科学 2024-11-08 Fan Nie , Xiaotian Hou , Shuhang Lin , James Zou , Huaxiu Yao , Linjun Zhang

Large language models (LLMs) exhibit impressive performance across diverse tasks but often struggle to accurately gauge their knowledge boundaries, leading to confident yet incorrect responses. This paper explores leveraging LLMs' internal…

计算与语言 · 计算机科学 2025-06-26 Shiyu Ni , Keping Bi , Jiafeng Guo , Lulu Yu , Baolong Bi , Xueqi Cheng

Recently, Large Language Models (LLMs) have drawn significant attention due to their outstanding reasoning capabilities and extensive knowledge repository, positioning them as superior in handling various natural language processing tasks…

计算与语言 · 计算机科学 2023-11-30 Han Cao , Lingwei Wei , Mengyang Chen , Wei Zhou , Songlin Hu

Hallucination is a major challenge for large language models (LLMs), preventing their further application in some fields. The skeptical thinking of humankind could be useful for LLMs to self-cognition, self-reflection and alleviate their…

计算与语言 · 计算机科学 2025-04-29 Yetao Wu , Yihong Wang , Teng Chen , Ningyuan Xi , Qingqing Gu , Hongyang Lei , Luo Ji

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

计算与语言 · 计算机科学 2024-08-07 Philipp Mondorf , Barbara Plank

While understanding the knowledge boundaries of LLMs is crucial to prevent hallucination, research on the knowledge boundaries of LLMs has predominantly focused on English. In this work, we present the first study to analyze how LLMs…

计算与语言 · 计算机科学 2025-06-25 Chenghao Xiao , Hou Pong Chan , Hao Zhang , Mahani Aljunied , Lidong Bing , Noura Al Moubayed , Yu Rong

Large Language Models (LLMs) can produce surprisingly sophisticated estimates of their own uncertainty. However, it remains unclear to what extent this expressed confidence is tied to the reasoning, knowledge, or decision making of the…

机器学习 · 计算机科学 2026-01-13 Jiawei Wang , Yanfei Zhou , Siddartha Devic , Deqing Fu

Large Language Models (LLMs) are increasingly used for accessing information on the web. Their truthfulness and factuality are thus of great interest. To help users make the right decisions about the information they get, LLMs should not…

计算与语言 · 计算机科学 2024-04-03 Chenglei Si , Navita Goyal , Sherry Tongshuang Wu , Chen Zhao , Shi Feng , Hal Daumé , Jordan Boyd-Graber

As large language models (LLMs) increasingly interact with each other, most notably in multi-agent setups, we may expect (and hope) that `trust' relationships develop between them, mirroring trust relationships between human colleagues,…

多智能体系统 · 计算机科学 2025-08-25 Maarten Buyl , Yousra Fettach , Guillaume Bied , Tijl De Bie

LLMs often adopt an assertive language style also when making false claims. Such ``overconfident hallucinations'' mislead users and erode trust. Achieving the ability to express in language the actual degree of uncertainty around a claim is…

Empowering large language models to accurately express confidence in their answers is essential for trustworthy decision-making. Previous confidence elicitation methods, which primarily rely on white-box access to internal model information…

计算与语言 · 计算机科学 2024-03-19 Miao Xiong , Zhiyuan Hu , Xinyang Lu , Yifei Li , Jie Fu , Junxian He , Bryan Hooi

Large pre-trained language models have demonstrated their proficiency in storing factual knowledge within their parameters and achieving remarkable results when fine-tuned for downstream natural language processing tasks. Nonetheless, their…

计算与语言 · 计算机科学 2023-09-29 Konstantinos Andriopoulos , Johan Pouwelse

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

计算与语言 · 计算机科学 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

Large language models (LLMs) achieve remarkable fluency across linguistic and reasoning tasks but remain systematically prone to hallucination. Prevailing accounts attribute hallucinations to data gaps, limited context, or optimization…

计算机与社会 · 计算机科学 2025-09-23 Richard Ackermann , Simeon Emanuilov

The prevalence of unwarranted beliefs, spanning pseudoscience, logical fallacies, and conspiracy theories, presents substantial societal hurdles and the risk of disseminating misinformation. Utilizing established psychometric assessments,…

人工智能 · 计算机科学 2024-05-03 Sowmya S Sundaram , Balaji Alwar

Large Language Models (LLMs) have shown great potential in Natural Language Processing (NLP) tasks. However, recent literature reveals that LLMs generate nonfactual responses intermittently, which impedes the LLMs' reliability for further…

计算与语言 · 计算机科学 2024-03-22 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Chong Meng , Shuaiqiang Wang , Zhicong Cheng , Zhaochun Ren , Dawei Yin

Large language models (LLMs) demonstrate remarkable breadth of knowledge, yet their ability to reason about computational processes remains poorly understood. Closing this gap matters for practitioners who rely on LLMs to guide algorithm…

计算与语言 · 计算机科学 2026-04-07 Sohan Venkatesh , Ashish Mahendran Kurapath , Tejas Melkote

Large language models (LLMs) exhibit increasingly sophisticated linguistic capabilities, yet the extent to which these behaviors reflect human-like cognition versus advanced pattern recognition remains an open question. In this study, we…

计算与语言 · 计算机科学 2025-12-01 Karin de Langis , Jong Inn Park , Andreas Schramm , Bin Hu , Khanh Chi Le , Michael Mensink , Ahn Thu Tong , Dongyeop Kang

Large language models (LLMs) are increasingly deployed in agentic and multi-turn workflows where they are tasked to perform actions of significant consequence. In order to deploy them reliably and manage risky outcomes in these settings, it…

机器学习 · 计算机科学 2026-02-10 Arka Pal , Teo Kitanovski , Arthur Liang , Akilesh Potti , Micah Goldblum