English
Related papers

Related papers: Hallucinated but Factual! Inspecting the Factualit…

200 papers

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

Computation and Language · Computer Science 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

Hallucination is often regarded as a major impediment for using large language models (LLMs), especially for knowledge-intensive tasks. Even when the training corpus consists solely of true statements, language models still generate…

Computation and Language · Computer Science 2024-07-12 Yuji Zhang , Sha Li , Jiateng Liu , Pengfei Yu , Yi R. Fung , Jing Li , Manling Li , Heng Ji

Scoring the factuality of a generated summary involves measuring the degree to which a target text contains factual information using the input document as support. Given the similarities in the problem formulation, previous work has shown…

Computation and Language · Computer Science 2022-12-01 John Glover , Federico Fancellu , Vasudevan Jagannathan , Matthew R. Gormley , Thomas Schaaf

We show that LLMs hallucinate because their output is not constrained to be synonymous with claims for which they have evidence: a condition that we call evidential closure. Information about the truth or falsity of sentences is not…

Computation and Language · Computer Science 2023-10-25 Adam Bouyamourn

Despite their impressive generative capabilities, LLMs are hindered by fact-conflicting hallucinations in real-world applications. The accurate identification of hallucinations in texts generated by LLMs, especially in complex inferential…

Computation and Language · Computer Science 2024-05-28 Xiang Chen , Duanzheng Song , Honghao Gui , Chenxi Wang , Ningyu Zhang , Yong Jiang , Fei Huang , Chengfei Lv , Dan Zhang , Huajun Chen

We introduce a general framework for abstractive summarization with factual consistency and distinct modeling of the narrative flow in an output summary. Our work addresses current limitations of models for abstractive summarization that…

Computation and Language · Computer Science 2021-04-12 Saadia Gabriel , Antoine Bosselut , Jeff Da , Ari Holtzman , Jan Buys , Kyle Lo , Asli Celikyilmaz , Yejin Choi

While humans increasingly rely on large language models (LLMs), they are susceptible to generating inaccurate or false information, also known as "hallucinations". Technical advancements have been made in algorithms that detect hallucinated…

Human-Computer Interaction · Computer Science 2024-06-03 Hyo Jin Do , Rachel Ostrand , Justin D. Weisz , Casey Dugan , Prasanna Sattigeri , Dennis Wei , Keerthiram Murugesan , Werner Geyer

LLMs are often claimed to be capable of Natural Language Inference (NLI), which is widely regarded as a cornerstone of more complex forms of reasoning. However, recent works show that LLMs still suffer from hallucinations in NLI due to…

Computation and Language · Computer Science 2025-03-17 Liang Cheng , Tianyi Li , Zhaowei Wang , Tianyang Liu , Mark Steedman

Despite substantial advances, large language models (LLMs) continue to exhibit hallucinations, generating plausible yet incorrect responses. In this paper, we highlight a critical yet previously underexplored class of hallucinations driven…

Computation and Language · Computer Science 2025-11-24 Shaowen Wang , Yiqi Dong , Ruinian Chang , Tansheng Zhu , Yuebo Sun , Kaifeng Lyu , Jian Li

This work studies improving large language model (LLM) generations at inference time by mitigating fact-conflicting hallucinations. Particularly, we propose a self-endorsement framework that leverages the fine-grained fact-level comparisons…

Computation and Language · Computer Science 2024-02-27 Ante Wang , Linfeng Song , Baolin Peng , Ye Tian , Lifeng Jin , Haitao Mi , Jinsong Su , Dong Yu

Large language models are known to hallucinate when faced with unfamiliar queries, but the underlying mechanism that govern how models hallucinate are not yet fully understood. In this work, we find that unfamiliar examples in the models'…

Machine Learning · Computer Science 2024-05-30 Katie Kang , Eric Wallace , Claire Tomlin , Aviral Kumar , Sergey Levine

Hallucination detection methods for large language models increasingly operate on chain-of-thought reasoning traces, yet it remains unclear whether they evaluate the reasoning itself or merely exploit surface correlates of the final answer.…

Computation and Language · Computer Science 2026-05-12 Geigh Zollicoffer , Minh Vu , Hongli Zhan , Raymond Li , Manish Bhattarai

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Plan-guided summarization attempts to reduce hallucinations in small language models (SLMs) by grounding generated summaries to the source text, typically by targeting fine-grained details such as dates or named entities. In this work, we…

Computation and Language · Computer Science 2025-08-25 Matt Grenander , Siddharth Varia , Paula Czarnowska , Yogarshi Vyas , Kishaloy Halder , Bonan Min

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

Computation and Language · Computer Science 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

Computation and Language · Computer Science 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

We show that language models hallucinate not because they fail to detect uncertainty, but because of a failure to integrate it into output generation. Across architectures, uncertain inputs are reliably identified, occupying…

Artificial Intelligence · Computer Science 2026-03-17 Valeria Ruscio , Keiran Thompson

Large language models (LLMs) are known to "hallucinate" by generating false or misleading outputs. Hallucinations pose various harms, from erosion of trust to widespread misinformation. Existing hallucination evaluation, however, focuses…

Machine Learning · Computer Science 2026-02-03 Prakhar Ganesh , Reza Shokri , Golnoosh Farnadi

The tendency for hallucination in current large language models (LLMs) negatively impacts dialogue systems. Such hallucinations produce factually incorrect responses that may mislead users and undermine system trust. Existing refinement…

Computation and Language · Computer Science 2026-02-18 Xiangyan Chen , Yujian Gan , Matthew Purver

Despite their remarkable capabilities, Large Language Models (LLMs) are prone to generate responses that contradict verifiable facts, i.e., unfaithful hallucination content. Existing efforts generally focus on optimizing model parameters or…

Computation and Language · Computer Science 2025-01-28 Dingkang Yang , Dongling Xiao , Jinjie Wei , Mingcheng Li , Zhaoyu Chen , Ke Li , Lihua Zhang