English
Related papers

Related papers: HalluSAE: Detecting Hallucinations in Large Langua…

200 papers

This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zechen Bai , Pichao Wang , Tianjun Xiao , Tong He , Zongbo Han , Zheng Zhang , Mike Zheng Shou

Large Language Models (LLMs) frequently generate plausible but non-factual content, a phenomenon known as hallucination. While existing detection methods typically rely on computationally expensive sampling-based consistency checks or…

Machine Learning · Computer Science 2026-05-07 Dan Wilson , Mohamed Akrout

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

Computation and Language · Computer Science 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

Large language models (LLMs) have achieved remarkable success in various natural language processing tasks, yet they remain prone to generating factually incorrect outputs known as hallucinations. While recent approaches have shown promise…

Computation and Language · Computer Science 2026-03-25 Qiyao Sun , Xingming Li , Xixiang He , Ao Cheng , Xuanyu Ji , Hailun Lu , Runke Huang , Qingyong Hu

Recent advancements in massively multilingual machine translation systems have significantly enhanced translation accuracy; however, even the best performing systems still generate hallucinations, severely impacting user trust. Detecting…

Computation and Language · Computer Science 2024-10-22 Kenza Benkirane , Laura Gongas , Shahar Pelles , Naomi Fuchs , Joshua Darmon , Pontus Stenetorp , David Ifeoluwa Adelani , Eduardo Sánchez

Generative Vision-Language Models (VLMs) perform well on multimodal reasoning, but how visual inputs are transformed to text remains poorly understood. Existing interpretability work on VLMs uses Sparse Autoencoders (SAEs), which decompose…

Machine Learning · Computer Science 2026-05-25 Dimitrios Damianos , Leon Voukoutis , Georgios Skyrianos , Vassilis Katsouros , Georgios Paraskevopoulos

In the dynamic landscape of artificial intelligence, the exploration of hallucinations within vision-language (VL) models emerges as a critical frontier. This work delves into the intricacies of hallucinatory phenomena exhibited by widely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Maria Lymperaiou , Giorgos Filandrianos , Angeliki Dimitriou , Athanasios Voulodimos , Giorgos Stamou

Large language models (LLMs) demonstrate exceptional performance on tasks requiring complex linguistic abilities, such as reference disambiguation and metaphor recognition/generation. Although LLMs possess impressive capabilities, their…

Computation and Language · Computer Science 2025-09-16 Yi Jing , Zijun Yao , Hongzhu Guo , Lingxu Ran , Xiaozhi Wang , Lei Hou , Juanzi Li

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

Computation and Language · Computer Science 2025-09-19 Martin Preiß

We address hallucination detection in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) by framing the problem through the lens of dynamical systems stability theory. Rather than treating hallucination as a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bozhi Luan , Gen Li , Yalan Qin , Jifeng Guo , Yun Zhou , Faguo Wu , Hongwei Zheng , Wenjun Wu , Zhaoxin Fan

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

Machine Learning · Computer Science 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Recent advances in large language models (LLMs) have demonstrated remarkable capabilities in code generation tasks. However, when applied to hardware description languages (HDL), these models exhibit significant limitations due to data…

Computation and Language · Computer Science 2025-03-24 Heng Ping , Shixuan Li , Peiyu Zhang , Anzhe Cheng , Shukai Duan , Nikos Kanakaris , Xiongye Xiao , Wei Yang , Shahin Nazarian , Andrei Irimia , Paul Bogdan

Object hallucination in Large Vision-Language Models (LVLMs) significantly impedes their real-world applicability. As the primary component for accurately interpreting visual information, the choice of visual encoder is pivotal. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Weihang Wang , Xinhao Li , Ziyue Wang , Yan Pang , Jielei Zhang , Peiyi Li , Qiang Zhang , Longwen Gao

Diffusion large language models (D-LLMs) have emerged as a promising alternative to auto-regressive models due to their iterative refinement capabilities. However, hallucinations remain a critical issue that hinders their reliability. To…

Computation and Language · Computer Science 2026-03-18 Yanyu Qian , Yue Tan , Yixin Liu , Wang Yu , Shirui Pan

Large Language Models (LLMs) have demonstrated remarkable capabilities across a variety of tasks in different domains. However, they sometimes generate responses that are logically coherent but factually incorrect or misleading, which is…

Computation and Language · Computer Science 2025-05-23 Fujie Zhang , Peiqi Yu , Biao Yi , Baolei Zhang , Tong Li , Zheli Liu

Large language models (LLMs) hallucinate: they produce fluent outputs that are factually incorrect. We present a geometric dynamical systems framework in which hallucinations arise from task-dependent basin structure in latent space. Using…

Computation and Language · Computer Science 2026-04-07 Kalyan Cherukuri , Lav R. Varshney

Large Language Models (LLMs) are powerful tools for text generation, translation, and summarization, but they often suffer from hallucinations-instances where they fail to maintain the fidelity and coherence of contextual information during…

Computation and Language · Computer Science 2024-10-29 Jiemin Wu , Songning Lai , Ruiqiang Xiao , Tianlang Xue , Jiayu Yang , Yutao Yue

When asked to summarize articles or answer questions given a passage, large language models (LLMs) can hallucinate details and respond with unsubstantiated answers that are inaccurate with respect to the input context. This paper describes…

Computation and Language · Computer Science 2024-10-04 Yung-Sung Chuang , Linlu Qiu , Cheng-Yu Hsieh , Ranjay Krishna , Yoon Kim , James Glass

Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs producing responses that are coherent yet factually inaccurate. This issue undermines the effectiveness of LLMs in practical applications, necessitating research…

Computation and Language · Computer Science 2024-06-11 Weihang Su , Changyue Wang , Qingyao Ai , Yiran HU , Zhijing Wu , Yujia Zhou , Yiqun Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, yet they remain susceptible to hallucinations -- generating content that is factually incorrect, unfaithful to provided…

Computation and Language · Computer Science 2026-05-25 Ahmed Cherif