中文
相关论文

相关论文: Probing LLM Hallucination from Within: Perturbatio…

200 篇论文

Although large Language Models (LLMs) have achieved remarkable success, their practical application is often hindered by the generation of non-factual content, which is called "hallucination". Ensuring the reliability of LLMs' outputs is a…

计算与语言 · 计算机科学 2025-09-16 Yue Ding , Xiaofang Zhu , Tianze Xia , Junfei Wu , Xinlong Chen , Qiang Liu , Liang Wang

Large language models (LLMs) offer transformative potential for clinical decision support in spine surgery but pose significant risks through hallucinations, which are factually inconsistent or contextually misaligned outputs that may…

机器学习 · 计算机科学 2025-11-21 Dong Chen , Yanzhe Wei , Zonglin He , Guan-Ming Kuang , Canhua Ye , Meiru An , Huili Peng , Yong Hu , Huiren Tao , Kenneth MC Cheung

Large Reasoning Models (LRMs) extend large language models with explicit, multi-step reasoning traces to enhance transparency and performance on complex tasks. However, these reasoning traces can be redundant or logically inconsistent,…

计算与语言 · 计算机科学 2025-11-18 Changyue Wang , Weihang Su , Qingyao Ai , Yiqun Liu

Recent studies have identified one aggravating factor of LLM hallucinations as the knowledge inconsistency between pre-training and fine-tuning, where unfamiliar fine-tuning data mislead the LLM to fabricate plausible but wrong outputs. In…

计算与语言 · 计算机科学 2024-10-28 Yujian Liu , Shiyu Chang , Tommi Jaakkola , Yang Zhang

Large Visual Language Models (LVLMs) struggle with hallucinations in visual instruction following task(s), limiting their trustworthiness and real-world applicability. We propose Pelican -- a novel framework designed to detect and mitigate…

计算与语言 · 计算机科学 2024-10-30 Pritish Sahu , Karan Sikka , Ajay Divakaran

In text generation, hallucinations refer to the generation of seemingly coherent text that contradicts established knowledge. One compelling hypothesis is that hallucinations occur when a language model is given a generation task outside…

计算与语言 · 计算机科学 2024-08-21 Ameya Godbole , Nicholas Monath , Seungyeon Kim , Ankit Singh Rawat , Andrew McCallum , Manzil Zaheer

Hallucinations pose critical risks for large language model (LLM)-based agents, often manifesting as hallucinative actions resulting from fabricated or misinterpreted information within the cognitive context. While recent studies have…

人工智能 · 计算机科学 2025-07-29 Weichen Zhang , Yiyou Sun , Pohao Huang , Jiayue Pu , Heyue Lin , Dawn Song

Uncertainty estimation is a necessary component when implementing AI in high-risk settings, such as autonomous cars, medicine, or insurances. Large Language Models (LLMs) have seen a surge in popularity in recent years, but they are subject…

机器学习 · 计算机科学 2024-12-09 Gabriel Y. Arteaga , Thomas B. Schön , Nicolas Pielawski

Hallucinations in Large Language Models (LLMs) pose a major barrier to their reliable use in critical decision-making. Although existing hallucination detection methods have improved accuracy, they still struggle with disentangling semantic…

计算与语言 · 计算机科学 2026-04-02 Junjie Hu , Gang Tu , ShengYu Cheng , Jinxin Li , Jinting Wang , Rui Chen , Zhilong Zhou , Dongbo Shan

Language models, particularly generative models, are susceptible to hallucinations, generating outputs that contradict factual knowledge or the source text. This study explores methods for detecting hallucinations in three SemEval-2024 Task…

The advancement of Large Vision-Language Models (LVLMs) has increasingly highlighted the critical issue of their tendency to hallucinate non-existing objects in the images. To address this issue, previous works focused on using specially…

机器学习 · 计算机科学 2025-06-13 Linxi Zhao , Yihe Deng , Weitong Zhang , Quanquan Gu

Large language models (LLMs) are prone to hallucinations, i.e., nonsensical, unfaithful, and undesirable text. Users tend to overrely on LLMs and corresponding hallucinations which can lead to misinterpretations and errors. To tackle the…

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

计算与语言 · 计算机科学 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

Despite the success of Large Language Models (LLMs) across various fields, their potential to generate untruthful, biased and harmful responses poses significant risks, particularly in critical applications. This highlights the urgent need…

人工智能 · 计算机科学 2025-05-27 Mengdi Zhang , Kai Kiat Goh , Peixin Zhang , Jun Sun , Rose Lin Xin , Hongyu Zhang

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

计算与语言 · 计算机科学 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…

Despite substantial advances, large language models (LLMs) continue to exhibit hallucinations, generating plausible yet incorrect responses. In this paper, we highlight a critical yet previously underexplored class of hallucinations driven…

计算与语言 · 计算机科学 2025-11-24 Shaowen Wang , Yiqi Dong , Ruinian Chang , Tansheng Zhu , Yuebo Sun , Kaifeng Lyu , Jian Li

Hallucinations in large language models (LLMs), plausible but factually inaccurate text, are often viewed as undesirable. However, recent work suggests that such outputs may hold creative potential. In this paper, we investigate whether…

计算与语言 · 计算机科学 2025-08-25 Shuzhou Yuan , Zhan Qu , Ashish Yashwanth Kangen , Michael Färber

Large language models (LLMs) are known to "hallucinate" by generating false or misleading outputs. Hallucinations pose various harms, from erosion of trust to widespread misinformation. Existing hallucination evaluation, however, focuses…

机器学习 · 计算机科学 2026-02-03 Prakhar Ganesh , Reza Shokri , Golnoosh Farnadi

Large language models (LLMs) have demonstrated remarkable performance on various natural language processing tasks. However, they are prone to generating fluent yet untruthful responses, known as "hallucinations". Hallucinations can lead to…

计算与语言 · 计算机科学 2024-06-18 Minda Hu , Bowei He , Yufei Wang , Liangyou Li , Chen Ma , Irwin King