English
Related papers

Related papers: Look Carefully: Adaptive Visual Reinforcements in …

200 papers

Multimodal Large Language Models (MLLMs) have emerged as a central focus in both industry and academia, but often suffer from biases introduced by visual and language priors, which can lead to multimodal hallucination. These biases arise…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Guanyu Zhou , Yibo Yan , Xin Zou , Kun Wang , Aiwei Liu , Xuming Hu

While multi-modal large language models (MLLMs) have made significant progress in recent years, the issue of hallucinations remains a major challenge. To mitigate this phenomenon, existing solutions either introduce additional data for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Fengyuan Sun , Hui Chen , Xinhao Xu , Dandan Zheng , Jingdong Chen , Jun Zhou , Jungong Han , Guiguang Ding

Large Vision-Language Models (VLMs) rely on effective multimodal alignment between pre-trained vision encoders and Large Language Models (LLMs) to integrate visual and textual information. This paper presents a comprehensive analysis of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shweta Mahajan , Hoang Le , Hyojin Park , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

Large Vision-Language Models (LVLMs) are susceptible to hallucinations, where generated responses seem semantically plausible yet exhibit little or no relevance to the input image. Previous studies reveal that this issue primarily stems…

Computation and Language · Computer Science 2025-10-24 Hao Fang , Changle Zhou , Jiawei Kong , Kuofeng Gao , Bin Chen , Shu-Tao Xia

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

Artificial Intelligence · Computer Science 2026-01-16 Ahmad Pesaranghader , Erin Li

Despite the impressive capabilities of multimodal large language models (MLLMs) in vision-language tasks, they are prone to hallucinations in real-world scenarios. This paper investigates the hallucination phenomenon in MLLMs from the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zongmeng Zhang , Wengang Zhou , Jie Zhao , Houqiang Li

Visual attention serves as the primary mechanism through which MLLMs interpret visual information; however, its limited localization capability often leads to hallucinations. We observe that although MLLMs can accurately extract visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jianfei Zhao , Feng Zhang , Xin Sun , Chong Feng , Zhixing Tan

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Hallucinations in Large Vision-Language Models (LVLMs) significantly undermine their reliability, motivating researchers to explore the causes of hallucination. However, most studies primarily focus on the language aspect rather than the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhangqi Jiang , Junkai Chen , Beier Zhu , Tingjin Luo , Yankun Shen , Xu Yang

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

The hallucination problem in multimodal large language models (MLLMs) remains a common issue. Although image tokens occupy a majority of the input sequence of MLLMs, there is limited research to explore the relationship between image tokens…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Xiaofeng Zhang , Yihao Quan , Chaochen Gu , Chen Shen , Xiaosong Yuan , Shaotian Yan , Hao Cheng , Kaijie Wu , Jieping Ye

Large Vision-Language Models have demonstrated exceptional performance in multimodal reasoning and complex scene understanding. However, these models still face significant hallucination issues, where outputs contradict visual facts. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wei Suo , Hanzu Zhang , Lijun Zhang , Ji Ma , Peng Wang , Yanning Zhang

Multimodal Large Language Models (MLLMs) have endowed LLMs with the ability to perceive and understand multi-modal signals. However, most of the existing MLLMs mainly adopt vision encoders pretrained on coarsely aligned image-text pairs,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Gongwei Chen , Leyang Shen , Rui Shao , Xiang Deng , Liqiang Nie

Large Vision-Language Models (LVLMs) exhibit impressive multimodal reasoning capabilities but remain highly susceptible to object hallucination, where models generate responses that are not factually aligned with the visual content. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Younan Zhu , Linwei Tao , Minjing Dong , Chang Xu

Multimodal Diffusion Large Language Models (MDLLMs) achieve high-concurrency generation through parallel masked decoding, yet the architectures remain prone to multimodal hallucinations. This structural vulnerability stems from an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Vishal Narnaware , Animesh Gupta , Kevin Zhai , Zhenyi Wang , Mubarak Shah

Large language models (LLMs) have enabled the creation of multi-modal LLMs that exhibit strong comprehension of visual data such as images and videos. However, these models usually rely on extensive visual tokens from visual encoders,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yiwu Zhong , Zhuoming Liu , Yin Li , Liwei Wang

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

Computation and Language · Computer Science 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Generative Vision-Language Models (VLMs) are prone to generate plausible-sounding textual answers that, however, are not always grounded in the input image. We investigate this phenomenon, usually referred to as "hallucination" and show…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Alessandro Favero , Luca Zancato , Matthew Trager , Siddharth Choudhary , Pramuditha Perera , Alessandro Achille , Ashwin Swaminathan , Stefano Soatto

Multimodal Large Language Models (MLLMs) suffer from cross-modal hallucinations, where one modality inappropriately influences generation about another, leading to fabricated output. This exposes a more fundamental deficiency in…

Artificial Intelligence · Computer Science 2026-01-30 Sangyun Chung , Se Yeon Kim , Youngchae Chee , Yong Man Ro

Large Language Models (LLMs) have strong instruction-following capability to interpret and execute tasks as directed by human commands. Multimodal Large Language Models (MLLMs) have inferior instruction-following ability compared to LLMs.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Te Yang , Jian Jia , Xiangyu Zhu , Weisong Zhao , Bo Wang , Yanhua Cheng , Yan Li , Shengyuan Liu , Quan Chen , Peng Jiang , Kun Gai , Zhen Lei