English
Related papers

Related papers: Hallucination as Trajectory Commitment: Causal Evi…

200 papers

Hallucinations in foundation models arise from autoregressive training objectives that prioritize token-likelihood optimization over epistemic accuracy, fostering overconfidence and poorly calibrated uncertainty. We define medical…

Despite their impressive ability to generate high-quality and fluent text, generative large language models (LLMs) also produce hallucinations: statements that are misaligned with established world knowledge or provided input context.…

Computation and Language · Computer Science 2025-01-15 Abhilasha Ravichander , Shrusti Ghela , David Wadden , Yejin Choi

We introduce a proxy-analyzer framework for detecting hallucinations in large language models. Instead of looking inside the generating model, our system reads already-generated text through a small locally hosted open-weight model and…

Computation and Language · Computer Science 2026-05-11 Akshita Singh , Prabesh Paudel , Siddhartha Roy

Large language models (LLMs) achieve remarkable fluency across linguistic and reasoning tasks but remain systematically prone to hallucination. Prevailing accounts attribute hallucinations to data gaps, limited context, or optimization…

Computers and Society · Computer Science 2025-09-23 Richard Ackermann , Simeon Emanuilov

Large Language Models (LLMs) have become powerful, but hallucinations remain a vital obstacle to their trustworthy use. Previous works improved the capability of hallucination detection by measuring uncertainty. But they can not explain the…

Computation and Language · Computer Science 2026-02-03 Yiming Huang , Junyan Zhang , Zihao Wang , Biquan Bie , Yunzhong Qiu , Xuming Hu , Yi R. Fung , Xinlei He

LLM deployment in critical domains is currently impeded by persistent hallucinations--generating plausible but factually incorrect assertions. While scaling laws drove significant improvements in general capabilities, theoretical frameworks…

Machine Learning · Computer Science 2026-01-29 Jiayun Wu , Jiashuo Liu , Zhiyuan Zeng , Tianyang Zhan , Tianle Cai , Wenhao Huang

One of the most critical challenges in Large Language Models is their tendency to hallucinate, i.e., produce factually incorrect responses. Existing approaches show promising results in terms of hallucination correction, but still suffer…

Computation and Language · Computer Science 2026-05-08 Erik Nielsen , Elia Cunegatti , Marcus Vukojevic , Giovanni Iacca

Large Language Models (LLMs), including GPT-3.5, LLaMA, and PaLM, seem to be knowledgeable and able to adapt to many tasks. However, we still cannot completely trust their answers, since LLMs suffer from \textbf{hallucination}\textemdash…

Computation and Language · Computer Science 2024-08-06 Jia-Yu Yao , Kun-Peng Ning , Zhen-Hui Liu , Mu-Nan Ning , Yu-Yang Liu , Li Yuan

Relation extraction (RE) enables the construction of structured knowledge for many downstream applications. While large language models (LLMs) have shown great promise in this task, they often struggle to reliably determine whether a…

Computation and Language · Computer Science 2026-02-03 Yupei Yang , Fan Feng , Lin Yang , Wanxi Deng , Lin Qu , Biwei Huang , Shikui Tu , Lei Xu

Hallucinations in large language models (LLMs) are outputs that are syntactically coherent but factually incorrect or contextually inconsistent. They are persistent obstacles in high-stakes industrial settings such as engineering design,…

Software Engineering · Computer Science 2026-04-07 Brian Freeman , Adam Kicklighter , Matt Erdman , Zach Gordon

We test whether a geometric hallucination taxonomy -- classifying failures as center-drift (Type~1), wrong-well convergence (Type~2), or coverage gaps (Type~3) -- can distinguish hallucination types through controlled induction in GPT-2.…

Computation and Language · Computer Science 2026-03-03 Matic Korun

Vision Language models (VLMs) often hallucinate non-existent objects. Detecting hallucination is analogous to detecting deception: a single final statement is insufficient, one must examine the underlying reasoning process. Yet existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Abin Shoby , Ta Duc Huy , Tuan Dung Nguyen , Minh Khoi Ho , Qi Chen , Anton van den Hengel , Phi Le Nguyen , Johan W. Verjans , Vu Minh Hieu Phan

Large language models (LLMs) hallucinate with confidence: their outputs can be fluent, authoritative, and simply wrong. In medical, legal, and scientific applications this failure causes direct harm, and detecting it from internal model…

Computation and Language · Computer Science 2026-05-19 Khizar Hussain , Murat Kantarcioglu

To address hallucination issues in large language models (LLMs), this paper proposes a method for mitigating prompt-induced hallucinations. Building on a knowledge distillation chain-style model, we introduce a code module to guide…

Computation and Language · Computer Science 2026-01-07 Jinbo Hao , Kai Yang , Qingzhen Su , Yang Chen , Yifan Li , Chao Jiang

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based…

Computation and Language · Computer Science 2026-02-03 Pragatheeswaran Vipulanandan , Kamal Premaratne , Dilip Sarkar

A geometric hallucination taxonomy distinguishes three failure types -- center-drift (Type~1), wrong-well convergence (Type~2), and coverage gaps (Type~3) -- by their signatures in embedding cluster space. Prior work found Types~1 and~2…

Computation and Language · Computer Science 2026-03-10 Matic Korun

As generative AI systems become competent and democratized in science, business, and government, deeper insight into their failure modes now poses an acute need. The occasional volatility in their behavior, such as the propensity of…

Machine Learning · Computer Science 2025-11-24 Praneet Suresh , Jack Stanley , Sonia Joseph , Luca Scimeca , Danilo Bzdok

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

Computation and Language · Computer Science 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

Hallucination correction is not a one-direction problem. We show that intermediate layers are neither uniformly more truthful than final layers nor uniformly less trustworthy. Yet hallucination reduction is usually instantiated through one…

Artificial Intelligence · Computer Science 2026-05-19 Tej Sanibh Ranade