English
Related papers

Related papers: Hallucination Begins Where Saliency Drops

200 papers

Hallucinations remain a persistent challenge for vision-language models (VLMs), which often describe nonexistent objects or fabricate facts. Existing detection methods typically operate after text generation, making intervention both costly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Sai Akhil Kogilathota , Sripadha Vallabha E G , Luzhe Sun , Jiawei Zhou

Large Vision-Language Models (LVLMs) have recently achieved remarkable success. However, LVLMs are still plagued by the hallucination problem, which limits the practicality in many scenarios. Hallucination refers to the information of…

Machine Learning · Computer Science 2023-10-11 Junyang Wang , Yiyang Zhou , Guohai Xu , Pengcheng Shi , Chenlin Zhao , Haiyang Xu , Qinghao Ye , Ming Yan , Ji Zhang , Jihua Zhu , Jitao Sang , Haoyu Tang

Large Language Models (LLMs) are increasingly deployed in safety-critical domains, yet remain susceptible to hallucinations. While prior works have proposed confidence representation methods for hallucination detection, most of these…

Machine Learning · Computer Science 2025-11-17 Elyes Hajji , Aymen Bouguerra , Fabio Arnez

Large language models (LLMs) have demonstrated remarkable capabilities, but they still frequently produce hallucinations. These hallucinations are difficult to detect in reasoning-intensive tasks, where the content appears coherent but…

Computation and Language · Computer Science 2026-05-13 Rui Min , Tianyu Pang , Chao Du , Minhao Cheng , Yi R. Fung

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

Computation and Language · Computer Science 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification…

Computation and Language · Computer Science 2026-04-10 Chenggong Zhang , Haopeng Wang , Hexi Meng

While Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse tasks, their practical deployment is severely hindered by hallucination issues, which become particularly acute during Reinforcement Learning…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Miao Pan , Wangjie Gan , Jintao Chen , Wenqi Zhang , Bing Sun , Jianwei Yin , Xuhong Zhang

Vision language models (VLM) demonstrate sophisticated multimodal reasoning yet are prone to hallucination when confronted with knowledge conflicts, impeding their deployment in information-sensitive contexts. While existing research…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Peter Carragher , Nikitha Rao , Abhinand Jha , R Raghav , Kathleen M. Carley

Large Vision Language Models (LVLMs) demonstrate strong capabilities in visual understanding and description, yet often suffer from hallucinations, attributing incorrect or misleading features to images. We observe that LVLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Sangmin Woo , Donguk Kim , Jaehyuk Jang , Yubin Choi , Changick Kim

Large language models (LLMs) are promising tools for supporting security management tasks, such as incident response planning. However, their unreliability and tendency to hallucinate remain significant challenges. In this paper, we address…

Artificial Intelligence · Computer Science 2026-02-06 Kim Hammar , Tansu Alpcan , Emil Lupu

Due to the unidirectional masking mechanism, Decoder-Only models propagate information from left to right. LVLMs (Large Vision-Language Models) follow the same architecture, with visual information gradually integrated into semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jianfei Zhao , Feng Zhang , Xin Sun , Chong Feng

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

Computation and Language · Computer Science 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

Rapid progress in large vision-language models (LVLMs) has achieved unprecedented performance in vision-language tasks. However, due to the strong prior of large language models (LLMs) and misaligned attention across modalities, LVLMs often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Ziqiang Shi , Rujie Liu , Shanshan Yu , Satoshi Munakata , Koichi Shirahata

Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities in multimodal tasks, but visual object hallucination remains a persistent issue. It refers to scenarios where models generate inaccurate visual object-related…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Liqiang Jing , Guiming Hardy Chen , Ehsan Aghazadeh , Xin Eric Wang , Xinya Du

In many reasoning tasks, large language models (LLMs) rely on structured external knowledge, such as graphs and tables, which is typically linearized into sequential token representations. However, even when sufficient knowledge is…

Computation and Language · Computer Science 2026-05-27 Shanghao Li , Jinda Han , Yibo Wang , Yuanjie Zhu , Zihe Song , Langzhou He , Kenan Kamel A Alghythee , Philip S. Yu

This paper primarily focuses on the hallucinations caused due to AI language models(LLMs).LLMs have shown extraordinary Language understanding and generation capabilities .Still it has major a disadvantage hallucinations which give outputs…

Computation and Language · Computer Science 2026-04-07 Sailesh kiran kurra , Shiek Ruksana , Vishal Borusu

Inference time scaling drives extended reasoning to enhance the performance of Vision-Language Models (VLMs), thus forming powerful Vision-Language Reasoning Models (VLRMs). However, long reasoning dilutes visual tokens, causing visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Xu Chu , Xinrong Chen , Guanyu Wang , Zhijie Tan , Kui Huang , Wenyu Lv , Tong Mo , Weiping Li

Vision-Language Models (VLMs) are increasingly used in safety-critical applications that require reliable visual grounding. However, these models often hallucinate details that are not present in the image to satisfy user prompts. While…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Weihao Hong , Zhiyuan Jiang , Bingyu Shen , Xinlei Guan , Yangyi Feng , Meng Xu , Boyang Li

Like a body at rest that stays at rest, we find that visual attention in multimodal large language models (MLLMs) exhibits pronounced inertia, remaining largely static once settled during early decoding steps and failing to support the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Boyang Gong , Yu Zheng , Fanye Kong , Jie Zhou , Jiwen Lu

Although large Language Models (LLMs) have achieved remarkable success, their practical application is often hindered by the generation of non-factual content, which is called "hallucination". Ensuring the reliability of LLMs' outputs is a…

Computation and Language · Computer Science 2025-09-16 Yue Ding , Xiaofang Zhu , Tianze Xia , Junfei Wu , Xinlong Chen , Qiang Liu , Liang Wang