English
Related papers

Related papers: Mitigating Hallucinations in Large Vision-Language…

200 papers

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Hallucinations in Large Vision-Language Models (LVLMs) pose significant security and reliability risks in real-world applications. Inspired by the observation that humans are more error-prone when uncertain or hesitant, we investigate how…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Zhaoxu Li , Chenqi Kong , Peijun Bao , Song Xia , Yi Tu , Yi Yu , Xinghao Jiang , Xudong Jiang

Hallucination poses a challenge to the deployment of large vision-language models (LVLMs) in applications. Unlike in large language models (LLMs), hallucination in LVLMs often arises from misalignments between visual inputs and textual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Sheng Liu , Haotian Ye , Lei Xing , James Zou

Large vision-language models (LVLMs) are now central to healthcare applications such as medical visual question answering and imaging report generation. Yet, these models remain vulnerable to hallucination outputs that appear plausible but…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zahra Mahdavi , Zahra Khodakaramimaghsoud , Hooman Khaloo , Sina Bakhshandeh Taleshani , Erfan Hashemi , Javad Mirzapour Kaleybar , Omid Nejati Manzari

Despite the impressive capabilities of Large Vision-Language Models (LVLMs), they remain susceptible to hallucinations-generating content that is inconsistent with the input image. Existing training-free hallucination mitigation methods…

Machine Learning · Computer Science 2025-05-20 Kai Tang , Jinhao You , Xiuqi Ge , Hanze Li , Yichen Guo , Xiande Huang

Large Vision-Language Models (LVLMs) exhibit powerful generative capabilities but frequently produce hallucinations that compromise output reliability. Fine-tuning on annotated data devoid of hallucinations offers the most direct solution,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Xingyu Zhu , Junfeng Fang , Shuo Wang , Beier Zhu , Zhicai Wang , Yonghui Yang , Xiangnan He

Recently, Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multi-modal context comprehension. However, they still suffer from hallucination problems referring to generating inconsistent outputs with the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Xiaoye Qu , Jiashuo Sun , Wei Wei , Yu Cheng

Large vision-language models (LVLMs) have achieved impressive results in various vision-language tasks. However, despite showing promising performance, LVLMs suffer from hallucinations caused by language bias, leading to diminished focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Haozhe Zhao , Shuzheng Si , Liang Chen , Yichi Zhang , Maosong Sun , Mingjia Zhang , Baobao Chang

Despite the remarkable performance of generative large language models (LLMs) on abstractive summarization, they face two significant challenges: their considerable size and tendency to hallucinate. Hallucinations are concerning because…

Computation and Language · Computer Science 2024-10-28 George Chrysostomou , Zhixue Zhao , Miles Williams , Nikolaos Aletras

Large Vision-Language Models (LVLMs) are increasingly adept at generating contextually detailed and coherent responses from visual inputs. However, their application in multimodal decision-making and open-ended generation is hindered by a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Xintong Wang , Jingheng Pan , Liang Ding , Chris Biemann

Recent studies have examined attention dynamics in large vision-language models (LVLMs) to detect hallucinations. However, existing approaches remain limited in reliably distinguishing hallucinated from factually grounded outputs, as they…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xiaofeng Zhang , Yuanchao Zhu , Chaochen Gu , Xiaosong Yuan , Qiyan Zhao , Jiawei Cao , Feilong Tang , Sinan Fan , Yaomin Shen , Chen Shen , Hao Tang

Large Vision-Language Models (VLMs) rely on effective multimodal alignment between pre-trained vision encoders and Large Language Models (LLMs) to integrate visual and textual information. This paper presents a comprehensive analysis of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shweta Mahajan , Hoang Le , Hyojin Park , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

Despite significant advancements in Vision-Language Models (VLMs), the performance of existing VLMs remains hindered by object hallucination, a critical challenge to achieving accurate visual understanding. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Woohyeon Park , Woojin Kim , Jaeik Kim , Jaeyoung Do

Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities in multimodal tasks, but visual object hallucination remains a persistent issue. It refers to scenarios where models generate inaccurate visual object-related…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Liqiang Jing , Guiming Hardy Chen , Ehsan Aghazadeh , Xin Eric Wang , Xinya Du

Large Vision-Language Models (LVLMs) have achieved impressive progress in multimodal reasoning, yet they remain prone to object hallucinations, generating descriptions of objects that are not present in the input image. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sohyeon Kim , Sang Yeon Yoon , Kyeongbo Kong

Although Large Visual Language Models (LVLMs) have demonstrated exceptional abilities in understanding multimodal data, they invariably suffer from hallucinations, leading to a disconnect between the generated text and the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xinyu Lyu , Beitao Chen , Lianli Gao , Jingkuan Song , Heng Tao Shen

Multimodal Large Language Models (MLLMs) frequently exhibit hallucination phenomena, but the underlying reasons remain poorly understood. In this paper, we present an empirical analysis and find that, although MLLMs incorrectly generate the…

Computation and Language · Computer Science 2025-02-25 Chenxi Wang , Xiang Chen , Ningyu Zhang , Bozhong Tian , Haoming Xu , Shumin Deng , Huajun Chen

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Large Vision-Language Models (LVLMs) demonstrate significant progress in multimodal understanding and reasoning, yet object hallucination remains a critical challenge. While existing research focuses on mitigating language priors or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yuxuan Xia , Siheng Wang , Peng Li

Large language models (LLMs) can suffer from hallucinations when generating text. These hallucinations impede various applications in society and industry by making LLMs untrustworthy. Current LLMs generate text in an autoregressive fashion…

Machine Learning · Computer Science 2025-11-05 Lukas Aichberger , Kajetan Schweighofer , Mykyta Ielanskyi , Sepp Hochreiter