中文
相关论文

相关论文: Relational Linearity is a Predictor of Hallucinati…

200 篇论文

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

计算与语言 · 计算机科学 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

计算与语言 · 计算机科学 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Despite significant strides in factual reliability, errors -- often termed hallucinations -- remain a major concern for generative AI, especially as LLMs are increasingly expected to be helpful in more complex or nuanced setups. Yet even in…

计算与语言 · 计算机科学 2026-05-05 Gal Yona , Mor Geva , Yossi Matias

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

计算与语言 · 计算机科学 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

The issue of hallucinations is a prevalent concern in existing Large Vision-Language Models (LVLMs). Previous efforts have primarily focused on investigating object hallucinations, which can be easily alleviated by introducing object…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Mingrui Wu , Jiayi Ji , Oucheng Huang , Jiale Li , Yuhang Wu , Xiaoshuai Sun , Rongrong Ji

Recent work suggests that LLMs "know what they don't know", positing that hallucinated and factually correct outputs arise from distinct internal processes and can therefore be distinguished using internal signals. However, hallucinations…

计算与语言 · 计算机科学 2026-04-20 Chi Seng Cheang , Hou Pong Chan , Wenxuan Zhang , Yang Deng

Large language models (LLMs) exhibit pronounced conservative bias in relation extraction tasks, frequently defaulting to No_Relation label when an appropriate option is unavailable. While this behavior helps prevent incorrect relation…

计算与语言 · 计算机科学 2025-06-11 Toyin Aguda , Erik Wilson , Allan Anzagira , Simerjot Kaur , Charese Smiley

Large language models (LLMs) have shown remarkable performance on a variety of NLP tasks, and are being rapidly adopted in a wide range of use cases. It is therefore of vital importance to holistically evaluate the factuality of their…

计算与语言 · 计算机科学 2024-04-26 Jiaqing Yuan , Lin Pan , Chung-Wei Hang , Jiang Guo , Jiarong Jiang , Bonan Min , Patrick Ng , Zhiguo Wang

Despite their impressive capabilities, large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information, a phenomenon commonly known as ``hallucination''. In this work, we propose a…

计算与语言 · 计算机科学 2024-03-12 Yue Zhang , Leyang Cui , Wei Bi , Shuming Shi

The prevalent use of large language models (LLMs) in various domains has drawn attention to the issue of "hallucination," which refers to instances where LLMs generate factually inaccurate or ungrounded information. Existing techniques for…

计算与语言 · 计算机科学 2023-10-10 Junyu Luo , Cao Xiao , Fenglong Ma

Recently evolved large reasoning models (LRMs) show powerful performance in solving complex tasks with long chain-of-thought (CoT) reasoning capability. As these LRMs are mostly developed by post-training on formal reasoning tasks, whether…

计算与语言 · 计算机科学 2025-05-30 Zijun Yao , Yantao Liu , Yanxu Chen , Jianhui Chen , Junfeng Fang , Lei Hou , Juanzi Li , Tat-Seng Chua

Recently, there has been an explosion of large language models created through fine-tuning with data from larger models. These small models able to produce outputs that appear qualitatively similar to significantly larger models. However,…

计算与语言 · 计算机科学 2024-11-05 Phil Wee , Riyadh Baghdadi

With the widespread adoption of large language models (LLMs), hallucinations, which are non-factual fabrications in model outputs, have become serious concerns. Reasoning capabilities have received attention as a self-verification process…

计算与语言 · 计算机科学 2026-01-06 Junichiro Niimi

Large language models (LLMs) can generate fluent responses, but sometimes hallucinate facts. In this paper, we investigate whether LLMs can detect their own hallucinations. We formulate hallucination detection as a classification task of a…

计算与语言 · 计算机科学 2025-11-17 Sora Kadotani , Kosuke Nishida , Kyosuke Nishida

Large-scale multilingual machine translation systems have demonstrated remarkable ability to translate directly between numerous languages, making them increasingly appealing for real-world applications. However, when deployed in the wild,…

This paper presents a systematic defense of large language model (LLM) hallucinations or 'confabulations' as a potential resource instead of a categorically negative pitfall. The standard view is that confabulations are inherently…

计算与语言 · 计算机科学 2024-06-27 Peiqi Sui , Eamon Duede , Sophie Wu , Richard Jean So

Large Language Models (LLMs) are prone to hallucinations, e.g., factually incorrect information, in their responses. These hallucinations present challenges for LLM-based applications that demand high factual accuracy. Existing…

计算与语言 · 计算机科学 2025-03-13 Borui Yang , Md Afif Al Mamun , Jie M. Zhang , Gias Uddin

Vision-language models (VLMs) achieve strong multimodal performance but remain prone to relation hallucination, which requires accurate reasoning over inter-object interactions. We study the impact of visual perturbations, specifically…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Philip Wootaek Shin , Ajay Narayanan Sridhar , Sivani Devarapalli , Rui Zhang , Jack Sampson , Vijaykrishnan Narayanan

The hallucination issue is recognized as a fundamental deficiency of large language models (LLMs), especially when applied to fields such as finance, education, and law. Despite the growing concerns, there has been a lack of empirical…

计算与语言 · 计算机科学 2023-11-28 Haoqiang Kang , Xiao-Yang Liu

Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based…

计算与语言 · 计算机科学 2026-02-03 Pragatheeswaran Vipulanandan , Kamal Premaratne , Dilip Sarkar