English
Related papers

Related papers: Mitigating Hallucination in Visual Language Models…

200 papers

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

The troubling rise of hallucination presents perhaps the most significant impediment to the advancement of responsible AI. In recent times, considerable research has focused on detecting and mitigating hallucination in Large Language Models…

Artificial Intelligence · Computer Science 2024-04-02 Anku Rani , Vipula Rawte , Harshad Sharma , Neeraj Anand , Krishnav Rajbangshi , Amit Sheth , Amitava Das

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination-where…

Computation and Language · Computer Science 2025-06-11 Jinghan He , Kuan Zhu , Haiyun Guo , Junfeng Fang , Zhenglin Hua , Yuheng Jia , Ming Tang , Tat-Seng Chua , Jinqiao Wang

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

Large vision-language models (LVLMs) have achieved impressive results in various vision-language tasks. However, despite showing promising performance, LVLMs suffer from hallucinations caused by language bias, leading to diminished focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Haozhe Zhao , Shuzheng Si , Liang Chen , Yichi Zhang , Maosong Sun , Mingjia Zhang , Baobao Chang

Large Vision-Language Models (LVLMs) have achieved remarkable performance on diverse vision-language tasks. However, LVLMs still suffer from hallucinations, generating text that contradicts the visual input. Existing research has primarily…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Zhenxin Qin , Qiang Li , Qingzhuo Wang , Ruiyang Qin , Zhihua Wei , Wen Shen

The hallucination of large multimodal models (LMMs), providing responses that appear correct but are actually incorrect, limits their reliability and applicability. This paper aims to study the hallucination problem of LMMs in video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Hongcheng Gao , Jiashu Qu , Jingyi Tang , Baolong Bi , Yue Liu , Hongyu Chen , Li Liang , Li Su , Qingming Huang

Large Vision Language Models (LVLMs) have achieved significant progress in integrating visual and textual inputs for multimodal reasoning. However, a recurring challenge is ensuring these models utilize visual information as effectively as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Estelle Aflalo , Gabriela Ben Melech Stan , Tiep Le , Man Luo , Shachar Rosenman , Sayak Paul , Shao-Yen Tseng , Vasudev Lal

Despite the remarkable ability of large vision-language models (LVLMs) in image comprehension, these models frequently generate plausible yet factually incorrect responses, a phenomenon known as hallucination.Recently, in large language…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xiaoye Qu , Qiyuan Chen , Wei Wei , Jishuo Sun , Jianfeng Dong

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities in understanding and describing visual content, achieving state-of-the-art performance across various vision-language tasks. However, these models often generate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Kazi Hasan Ibn Arif , Sajib Acharjee Dip , Khizar Hussain , Lang Zhang , Chris Thomas

Large Vision-Language Models (LVLMs) have shown remarkable performance on many visual-language tasks. However, these models still suffer from multimodal hallucination, which means the generation of objects or content that violates the…

Computation and Language · Computer Science 2024-10-01 Fan Yuan , Chi Qin , Xiaogang Xu , Piji Li

Large Vision-Language Models (LVLMs) increasingly rely on retrieval to answer knowledge-intensive multimodal questions. Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections…

Computation and Language · Computer Science 2026-04-15 Nicholas Moratelli , Christopher Davis , Leonardo F. R. Ribeiro , Bill Byrne , Gonzalo Iglesias

Vision Large Language Models (VLLMs) are widely acknowledged to be prone to hallucinations. Existing research addressing this problem has primarily been confined to image inputs, with limited exploration of video-based hallucinations.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Wey Yeh Choong , Yangyang Guo , Mohan Kankanhalli

The rapid development of Multi-modality Large Language Models (MLLMs) has significantly influenced various aspects of industry and daily life, showcasing impressive capabilities in visual perception and understanding. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yinan Sun , Zicheng Zhang , Haoning Wu , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Large Vision-Language Models (LVLMs) have shown remarkable performance on a wide range of vision-language tasks. Despite this progress, they are still prone to hallucination, generating responses that are inconsistent with visual content.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yutong Xie , Zhenglin Hua , Ran Wang , Wing W. Y. Ng , Xizhao Wang , Yuheng Jia

Object hallucination is a significant challenge that hinders the application of large vision-language models (LVLMs) in practice. We hypothesize that one possible origin of hallucination is the model's tendency to prioritize text generation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Meng Shen , Minghao Wu , Deepu Rajan

Recently, Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multi-modal context comprehension. However, they still suffer from hallucination problems referring to generating inconsistent outputs with the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Xiaoye Qu , Jiashuo Sun , Wei Wei , Yu Cheng

Large Vision-Language Models (LVLMs) often suffer from object hallucination, making erroneous judgments about the presence of objects in images. We propose this primar- ily stems from spurious correlations arising when models strongly…

Artificial Intelligence · Computer Science 2025-11-14 Zhe Xu , Zhicai Wang , Junkang Wu , Jinda Lu , Xiang Wang

Instruction-following Vision Large Language Models (VLLMs) have achieved significant progress recently on a variety of tasks. These approaches merge strong pre-trained vision models and large language models (LLMs). Since these components…

Machine Learning · Computer Science 2024-02-20 Yiyang Zhou , Chenhang Cui , Rafael Rafailov , Chelsea Finn , Huaxiu Yao