English
Related papers

Related papers: Visual Multi-Agent System: Mitigating Hallucinatio…

200 papers

Multimodal Large Language Models often suffer from object hallucination. While existing research utilizes attention enhancement and visual retracing, we find these works lack sufficient interpretability regarding attention drift in final…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chengxu Yang , Jingling Yuan , Chuang Hu , Jiawei Jiang

Rapid progress in large vision-language models (LVLMs) has achieved unprecedented performance in vision-language tasks. However, due to the strong prior of large language models (LLMs) and misaligned attention across modalities, LVLMs often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Ziqiang Shi , Rujie Liu , Shanshan Yu , Satoshi Munakata , Koichi Shirahata

Despite Video Large Language Models having rapidly advanced in recent years, perceptual hallucinations pose a substantial safety risk, which severely restricts their real-world applicability. While several methods for hallucination…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yiming Sun , Mi Zhang , Feifei Li , Geng Hong , Min Yang

Fusing visual understanding into language generation, Multi-modal Large Language Models (MLLMs) are revolutionizing visual-language applications. Yet, these models are often plagued by the hallucination problem, which involves generating…

Machine Learning · Computer Science 2025-01-28 Yining Wang , Mi Zhang , Junjie Sun , Chenyue Wang , Min Yang , Hui Xue , Jialing Tao , Ranjie Duan , Jiexi Liu

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Multimodal Large Language Models (MLLMs) have emerged as a central focus in both industry and academia, but often suffer from biases introduced by visual and language priors, which can lead to multimodal hallucination. These biases arise…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Guanyu Zhou , Yibo Yan , Xin Zou , Kun Wang , Aiwei Liu , Xuming Hu

Large Vision-Language Models (LVLMs) frequently suffer from severe hallucination issues. Existing mitigation strategies predominantly rely on isolated, single-step states to enhance visual focus or suppress strong linguistic priors.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Bei Yan , Yuecong Min , Jie Zhang , Shiguang Shan , Xilin Chen

Large Vision-Language Models (LVLMs) have achieved remarkable success but continue to struggle with object hallucination (OH), generating outputs inconsistent with visual inputs. While previous work has proposed methods to reduce OH, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Boxu Chen , Ziwei Zheng , Le Yang , Zeyu Geng , Zhengyu Zhao , Chenhao Lin , Chao Shen

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Although large vision-language models (LVLMs) have demonstrated remarkable capabilities, they are prone to hallucinations in multi-image tasks. We attribute this issue to limitations in existing attention mechanisms and insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xiaochen Yang , Hao Fang , Jiawei Kong , Yaoxin Mao , Bin Chen , Shu-Tao Xia

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Despite their success, Large Vision-Language Models (LVLMs) remain vulnerable to hallucinations. While existing studies attribute the cause of hallucinations to insufficient visual attention to image tokens, our findings indicate that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Beitao Chen , Xinyu Lyu , Lianli Gao , Jingkuan Song , Heng Tao Shen

As LLM-based Multi-Agent Systems (MAS) are increasingly deployed for complex tasks, ensuring their reliability has become a pressing challenge. Since MAS coordinate through unstructured natural language rather than rigid protocols, they are…

Software Engineering · Computer Science 2026-02-24 Jin Jia , Zhiling Deng , Zhuangbin Chen , Yingqi Wang , Zibin Zheng

While foundation models (FMs), such as diffusion models and large vision-language models (LVLMs), have been widely applied in educational contexts, their ability to generate pedagogically effective visual explanations remains limited. Most…

Artificial Intelligence · Computer Science 2025-05-29 Haonian Ji , Shi Qiu , Siyang Xin , Siwei Han , Zhaorun Chen , Dake Zhang , Hongyi Wang , Huaxiu Yao

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Although Large Vision-Language Models (LVLMs) have demonstrated remarkable performance on downstream tasks, they frequently produce contents that deviate from visual information, leading to object hallucination. To tackle this, recent works…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Qiming Li , Zekai Ye , Xiaocheng Feng , Weihong Zhong , Libo Qin , Ruihan Chen , Lei Huang , Baohang Li , Kui Jiang , Yaowei Wang , Ting Liu , Bing Qin

Large Vision-Language Models (LVLMs) recently achieve significant breakthroughs in understanding complex visual-textual contexts. However, hallucination issues still limit their real-world applicability. Although previous mitigation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zhaoxu Li , Chenqi Kong , Yi Yu , Qiangqiang Wu , Xinghao Jiang , Ngai-Man Cheung , Bihan Wen , Alex Kot , Xudong Jiang

Vision-Language Models (VLMs) have demonstrated strong capability in a wide range of tasks such as visual recognition, document parsing, and visual grounding. Nevertheless, recent work shows that while VLMs often manage to capture the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Chengxin Liu , Wonseok Choi , Chenshuang Zhang , Tae-Hyun Oh

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal abilities but remain prone to multilingual object hallucination, with a higher likelihood of generating responses inconsistent with the visual input when utilizing…

Computation and Language · Computer Science 2025-06-16 Zekai Ye , Qiming Li , Xiaocheng Feng , Libo Qin , Yichong Huang , Baohang Li , Kui Jiang , Yang Xiang , Zhirui Zhang , Yunfei Lu , Duyu Tang , Dandan Tu , Bing Qin

Existing adversarial attacks on vision-language models (VLMs) can steer model outputs toward attacker-specified target responses, but their effectiveness often degrades when the same perturbed input is paired with different textual queries.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zhiqiang Wang , Dongrui Liu , Yan Li , Zonghao Ying , Wei Xue , Wenhan Luo , Yike Guo