中文
相关论文

相关论文: SAVAA: Mitigating Hallucinations in LVLMs via Step…

200 篇论文

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

人工智能 · 计算机科学 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

Large vision-language models (LVLMs) have demonstrated impressive capabilities across diverse multimodal tasks, yet they remain highly susceptible to visual hallucinations (VH), often producing confident but inaccurate descriptions of…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Lexiang Tang , Xianwei Zhuang , Bang Yang , Zhiyuan Hu , Hongxiang Li , Lu Ma , Jinghan Ru , Yuexian Zou

Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language reasoning, yet they remain vulnerable to hallucination, where generated content deviates from visual evidence. Existing mitigation strategies…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Xingyu Zhu , Kesen Zhao , Liang Yi , Shuo Wang , Zhicai Wang , Beier Zhu , Hanwang Zhang

Despite the remarkable ability of large vision-language models (LVLMs) in image comprehension, these models frequently generate plausible yet factually incorrect responses, a phenomenon known as hallucination.Recently, in large language…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Qiyuan Chen , Wei Wei , Jishuo Sun , Jianfeng Dong

Large Vision-Language Models (LVLMs) have achieved remarkable performance on diverse vision-language tasks. However, LVLMs still suffer from hallucinations, generating text that contradicts the visual input. Existing research has primarily…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Zhenxin Qin , Qiang Li , Qingzhuo Wang , Ruiyang Qin , Zhihua Wei , Wen Shen

Prompt-based verification is widely used to mitigate hallucinations in large vision-language models (LVLMs), yet when it helps remains poorly understood. We systematically study verification prompting across two representative LVLM…

计算与语言 · 计算机科学 2026-05-28 Yuang Huang , Yafeng Zhang , Yu Zilan

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities in understanding and describing visual content, achieving state-of-the-art performance across various vision-language tasks. However, these models often generate…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Kazi Hasan Ibn Arif , Sajib Acharjee Dip , Khizar Hussain , Lang Zhang , Chris Thomas

Large Vision-Language Models (LVLMs) have achieved impressive progress in multimodal reasoning, yet they remain prone to object hallucinations, generating descriptions of objects that are not present in the input image. Recent approaches…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Sohyeon Kim , Sang Yeon Yoon , Kyeongbo Kong

LVLMs have achieved strong multimodal reasoning capabilities but remain prone to hallucinations, producing outputs inconsistent with visual inputs or user instructions. Existing training-free methods, including contrastive decoding and…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Guangtao Lyu , Qi Liu , Chenghao Xu , Jiexi Yan , Muli Yang , Xueting Li , Fen Fang , Cheng Deng

Multimodal Large Language Models often suffer from object hallucination. While existing research utilizes attention enhancement and visual retracing, we find these works lack sufficient interpretability regarding attention drift in final…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Chengxu Yang , Jingling Yuan , Chuang Hu , Jiawei Jiang

Large Vision-Language Models (LVLMs) have shown remarkable capabilities, yet hallucinations remain a persistent challenge. This work presents a systematic analysis of the internal evolution of visual perception and token generation in…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Guangtao Lyu , Xinyi Cheng , Chenghao Xu , Qi Liu , Muli Yang , Fen Fang , Huilin Chen , Jiexi Yan , Xu Yang , Cheng Deng

Medical Vision-Language Models (VLMs) often hallucinate by generating responses based on language priors rather than visual evidence, posing risks in clinical applications. We propose Visual Grounding Score Guided Decoding (VGS-Decoding), a…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Govinda Kolli , Adinath Madhavrao Dukre , Behzad Bozorgtabar , Dwarikanath Mahapatra , Imran Razzak

Despite great success across various multimodal tasks, Large Vision-Language Models (LVLMs) often encounter object hallucinations with generated textual responses being inconsistent with the actual objects in images. We examine different…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Wenbin An , Feng Tian , Sicong Leng , Jiahao Nie , Haonan Lin , QianYing Wang , Ping Chen , Xiaoqin Zhang , Shijian Lu

Multimodal large language models (MLLMs) have achieved remarkable success across diverse vision-language tasks, yet they remain highly susceptible to hallucinations, producing content that is fluent but inconsistent with visual evidence.…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Youxu Shi , Suorong Yang , Dong Liu

Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal tasks, yet their reliability is persistently undermined by hallucinations-generating text that contradicts visual input. Recent studies often attribute…

多媒体 · 计算机科学 2026-05-12 Yangneng Chen , Junlin Li , Weijun Yao , Xilai Ma , Guodong Du , Wenya Wang , Jing Li

Large Vision-Language Models (LVLMs) have achieved substantial progress in cross-modal tasks. However, due to language bias, LVLMs are susceptible to object hallucination, which can be primarily divided into category, attribute, and…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Tianbo Wang , Yuqing Ma , Kewei Liao , Zhange Zhang , Simin Li , Jinyang Guo , Xianglong Liu

Despite their remarkable progress in multimodal understanding tasks, large vision language models (LVLMs) often suffer from "hallucinations", generating texts misaligned with the visual context. Existing methods aimed at reducing…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Sreetama Sarkar , Yue Che , Alex Gavin , Peter A. Beerel , Souvik Kundu

Although Multimodal Large Language Models (MLLMs) have advanced substantially, they remain vulnerable to object hallucination caused by language priors and visual information loss. To address this, we propose SAVE (Sparse Autoencoder-Driven…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Sangha Park , Seungryong Yoo , Jisoo Mok , Sungroh Yoon

Large Vision-Language Models (LVLMs) have achieved remarkable success across cross-modal tasks but remain hindered by hallucinations, producing textual outputs inconsistent with visual content. Existing methods mitigate hallucinations but…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Yuanhong Zhang , Zhaoyang Wang , Xin Zhang , Weizhan Zhang , Joey Tianyi Zhou

Like a body at rest that stays at rest, we find that visual attention in multimodal large language models (MLLMs) exhibits pronounced inertia, remaining largely static once settled during early decoding steps and failing to support the…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Boyang Gong , Yu Zheng , Fanye Kong , Jie Zhou , Jiwen Lu