English
Related papers

Related papers: Mitigating Behavioral Hallucination in Multimodal …

200 papers

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

As scaling up training data has significantly improved the general multimodal capabilities of Large Vision-Language Models (LVLMs), they still suffer from the hallucination issue, generating text that is inconsistent with the visual input.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yifan Li , Kun Zhou , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Large Vision-Language Models (LVLMs) have achieved remarkable success but continue to struggle with object hallucination (OH), generating outputs inconsistent with visual inputs. While previous work has proposed methods to reduce OH, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Boxu Chen , Ziwei Zheng , Le Yang , Zeyu Geng , Zhengyu Zhao , Chenhao Lin , Chao Shen

Large Visual Language Models (LVLMs) have demonstrated impressive capabilities across multiple tasks. However, their trustworthiness is often challenged by hallucinations, which can be attributed to the modality misalignment and the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jiulong Wu , Zhengliang Shi , Shuaiqiang Wang , Jizhou Huang , Dawei Yin , Lingyong Yan , Min Cao , Min Zhang

Despite significant advancements in Vision-Language Models (VLMs), the performance of existing VLMs remains hindered by object hallucination, a critical challenge to achieving accurate visual understanding. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Woohyeon Park , Woojin Kim , Jaeik Kim , Jaeyoung Do

Large vision-language models (LVLMs) have shown remarkable abilities in understanding visual information with human languages. However, LVLMs still suffer from object hallucination, which is the problem of generating descriptions that…

Machine Learning · Computer Science 2024-03-19 Yiyang Zhou , Chenhang Cui , Jaehong Yoon , Linjun Zhang , Zhun Deng , Chelsea Finn , Mohit Bansal , Huaxiu Yao

The advancement of Large Vision-Language Models (LVLMs) has increasingly highlighted the critical issue of their tendency to hallucinate non-existing objects in the images. To address this issue, previous works focused on using specially…

Machine Learning · Computer Science 2025-06-13 Linxi Zhao , Yihe Deng , Weitong Zhang , Quanquan Gu

Multimodal Chain-of-Thought (MCoT) models have demonstrated impressive capability in complex visual reasoning tasks. Unfortunately, recent studies reveal that they suffer from severe hallucination problems due to diminished visual attention…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ji Ma , Wei Suo , Peng Wang , Yanning Zhang

Large Vision-Language Models (LVLMs) demonstrate impressive capabilities in generating detailed and coherent responses from visual inputs. However, they are prone to generate hallucinations due to an over-reliance on language priors. To…

Artificial Intelligence · Computer Science 2025-02-20 Kyungmin Min , Minbeom Kim , Kang-il Lee , Dongryeol Lee , Kyomin Jung

Model hallucination is one of the most critical challenges faced by Large Language Models (LLMs), especially in high-stakes code intelligence tasks. As LLMs become increasingly integrated into software engineering tasks, understanding and…

Software Engineering · Computer Science 2025-11-04 Cuiyun Gao , Guodong Fan , Chun Yong Chong , Shizhan Chen , Chao Liu , David Lo , Zibin Zheng , Qing Liao

Large Vision-Language Models (LVLMs) have made significant progress in recent years but are also prone to hallucination issues. They exhibit more hallucinations in longer, free-form responses, often attributed to accumulated uncertainties.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Ge Zheng , Jiaye Qian , Jiajin Tang , Sibei Yang

Hallucination has been a major problem for large language models and remains a critical challenge when it comes to multimodality in which vision-language models (VLMs) have to deal with not just textual but also visual inputs. Despite rapid…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhecan Wang , Garrett Bingham , Adams Yu , Quoc Le , Thang Luong , Golnaz Ghiasi

Multimodal large language models (MLLMs) have shown strong potential for medical Visual Question Answering (VQA), yet they remain prone to hallucinations, defined as generating responses that contradict the input image, posing serious risks…

Artificial Intelligence · Computer Science 2026-03-24 Mohammad Asadi , Tahoura Nedaee , Jack W. O'Sullivan , Euan Ashley , Ehsan Adeli

Retrieval-Augmented Generation (RAG) models frequently encounter hallucination phenomena when integrating external information with internal parametric knowledge. Empirical studies demonstrate that the disequilibrium between external…

Computation and Language · Computer Science 2025-05-13 Lei Wang

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

Artificial Intelligence · Computer Science 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

Despite the outstanding performance in vision-language reasoning, Large Vision-Language Models (LVLMs) might generate hallucinated contents that do not exist in the given image. Most existing LVLM hallucination benchmarks are constrained to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Junjie Wu , Tsz Ting Chung , Kai Chen , Dit-Yan Yeung

Recent advancements in large vision-language models (LVLM) have significantly enhanced their ability to comprehend visual inputs alongside natural language. However, a major challenge in their real-world application is hallucination, where…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Po-Hsuan Huang , Jeng-Lin Li , Chin-Po Chen , Ming-Ching Chang , Wei-Chao Chen

Vision-language models often hallucinate details, generating non-existent objects or inaccurate attributes that compromise output reliability. Existing methods typically address these issues via extensive human annotations or external…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mingfei Han , Haihong Hao , Jinxing Zhou , Zhihui Li , Yuhui Zheng , Xueqing Deng , Linjie Yang , Xiaojun Chang

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

Computation and Language · Computer Science 2024-08-12 Avshalom Manevich , Reut Tsarfaty

Medical Large Language Models (MLLMs) have demonstrated potential in healthcare applications, yet their propensity for hallucinations -- generating medically implausible or inaccurate information -- presents substantial risks to patient…

Computation and Language · Computer Science 2025-04-01 Kaiwen Zuo , Yirui Jiang