中文
相关论文

相关论文: Beyond Facts: Evaluating Intent Hallucination in L…

200 篇论文

A frequently observed problem with LLMs is their tendency to generate output that is nonsensical, illogical, or factually incorrect, often referred to broadly as hallucination. Building on the recently proposed HalluciGen task for…

计算与语言 · 计算机科学 2025-04-30 Evangelia Gogoulou , Shorouq Zahra , Liane Guillou , Luise Dürlich , Joakim Nivre

This review examines the means with which faithfulness has been evaluated across open-ended summarization, question-answering and machine translation tasks. We find that the use of LLMs as a faithfulness evaluator is commonly the metric…

计算与语言 · 计算机科学 2025-09-18 Ben Malin , Tatiana Kalganova , Nikoloas Boulgouris

Recently evolved large reasoning models (LRMs) show powerful performance in solving complex tasks with long chain-of-thought (CoT) reasoning capability. As these LRMs are mostly developed by post-training on formal reasoning tasks, whether…

计算与语言 · 计算机科学 2025-05-30 Zijun Yao , Yantao Liu , Yanxu Chen , Jianhui Chen , Junfeng Fang , Lei Hou , Juanzi Li , Tat-Seng Chua

Hallucinations pose critical risks for large language model (LLM)-based agents, often manifesting as hallucinative actions resulting from fabricated or misinterpreted information within the cognitive context. While recent studies have…

人工智能 · 计算机科学 2025-07-29 Weichen Zhang , Yiyou Sun , Pohao Huang , Jiayue Pu , Heyue Lin , Dawn Song

The utility of Large Language Models (LLMs) in analytical tasks is rooted in their vast pre-trained knowledge, which allows them to interpret ambiguous inputs and infer missing information. However, this same capability introduces a…

人工智能 · 计算机科学 2026-04-21 Humam Kourani , Anton Antonov , Alessandro Berti , Wil M. P. van der Aalst

Large language models (LLMs) have revolutionized natural language processing, yet their tendency to hallucinate poses serious challenges for reliable deployment. Despite numerous hallucination detection methods, their evaluations often rely…

计算与语言 · 计算机科学 2025-08-15 Denis Janiak , Jakub Binkowski , Albert Sawczyn , Bogdan Gabrys , Ravid Shwartz-Ziv , Tomasz Kajdanowicz

With the rapid development of large language models (LLMs), LLM-as-a-judge has emerged as a widely adopted approach for text quality evaluation, including hallucination evaluation. While previous studies have focused exclusively on…

计算与语言 · 计算机科学 2025-03-04 Siya Qi , Rui Cao , Yulan He , Zheng Yuan

The reliability of Large Language Models (LLMs) in high-stakes domains such as healthcare, law, and scientific discovery is often compromised by hallucinations. These failures typically stem from two sources: data-driven hallucinations and…

机器学习 · 计算机科学 2026-03-03 Xinyue Zeng , Junhong Lin , Yujun Yan , Feng Guo , Liang Shi , Jun Wu , Dawei Zhou

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

计算与语言 · 计算机科学 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

Despite rapid advances, Large Vision-Language Models (LVLMs) still suffer from hallucinations, i.e., generating content inconsistent with input or established world knowledge, which correspond to faithfulness and factuality hallucinations,…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Bei Yan , Zhiyuan Chen , Yuecong Min , Jie Zhang , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Despite their impressive ability to generate high-quality and fluent text, generative large language models (LLMs) also produce hallucinations: statements that are misaligned with established world knowledge or provided input context.…

计算与语言 · 计算机科学 2025-01-15 Abhilasha Ravichander , Shrusti Ghela , David Wadden , Yejin Choi

Large language model (LLM) systems suffer from the models' unstable ability to generate valid and factual content, resulting in hallucination generation. Current hallucination detection methods heavily rely on out-of-model information…

计算与语言 · 计算机科学 2025-02-20 Peiran Wang , Yang Liu , Yunfei Lu , Jue Hong , Ye Wu

Large language models (LLMs) have gained broad applications across various domains but still struggle with hallucinations. Currently, hallucinations occur frequently in the generation of factual content and pose a great challenge to…

计算与语言 · 计算机科学 2025-12-01 Zouying Cao , Yifei Yang , XiaoJing Li , Hai Zhao

Hallucinations in large language models (LLMs) present a growing challenge across real-world applications, from healthcare to law, where factual reliability is essential. Despite advances in alignment and instruction tuning, LLMs can still…

计算与语言 · 计算机科学 2025-05-02 Makoto Sato

Large Language Models (LLMs) have advanced machine translation but remain vulnerable to hallucinations. Unfortunately, existing MT benchmarks are not capable of exposing failures in multilingual LLMs. To disclose hallucination in…

计算与语言 · 计算机科学 2025-10-29 Xinwei Wu , Heng Liu , Jiang Zhou , Xiaohu Zhao , Linlong Xu , Longyue Wang , Weihua Luo , Kaifu Zhang

Retrieval-augmented generation (RAG) aims to reduce hallucinations by grounding responses in external context, yet large language models (LLMs) still frequently introduce unsupported information or contradictions even when provided with…

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

计算与语言 · 计算机科学 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

计算与语言 · 计算机科学 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

LLM hallucination, i.e. generating factually incorrect yet seemingly convincing answers, is currently a major threat to the trustworthiness and reliability of LLMs. The first step towards solving this complicated problem is to measure it.…

计算与语言 · 计算机科学 2024-06-10 Jiaheng Wei , Yuanshun Yao , Jean-Francois Ton , Hongyi Guo , Andrew Estornell , Yang Liu