中文
相关论文

相关论文: Tracing and Mitigating Hallucinations in Multimoda…

200 篇论文

The hallucination problem in multimodal large language models (MLLMs) remains a common issue. Although image tokens occupy a majority of the input sequence of MLLMs, there is limited research to explore the relationship between image tokens…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Xiaofeng Zhang , Yihao Quan , Chaochen Gu , Chen Shen , Xiaosong Yuan , Shaotian Yan , Hao Cheng , Kaijie Wu , Jieping Ye

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

人工智能 · 计算机科学 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

Large Vision-Language Models (LVLMs) exhibit impressive multimodal reasoning capabilities but remain highly susceptible to object hallucination, where models generate responses that are not factually aligned with the visual content. Recent…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Younan Zhu , Linwei Tao , Minjing Dong , Chang Xu

Hallucinations in Large Vision-Language Models (LVLMs) significantly undermine their reliability, motivating researchers to explore the causes of hallucination. However, most studies primarily focus on the language aspect rather than the…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Zhangqi Jiang , Junkai Chen , Beier Zhu , Tingjin Luo , Yankun Shen , Xu Yang

Multimodal large language models (MLLMs) frequently suffer from object hallucinations, yet the visual perceptual mechanism underlying this failure remains poorly understood. In this work, we reveal that hallucinations are strongly…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Quanjiang Li , Zhiming Liu , Wei Luo , Tingjin Luo , Chenping Hou

Large language model hallucination represents a critical challenge where outputs deviate from factual accuracy due to distributional biases in training data. While recent investigations establish that specific hidden layers exhibit…

计算与语言 · 计算机科学 2025-09-29 Wenkai Wang , Vincent Lee , Yizhen Zheng

Large Vision-Language Models (LVLMs) achieve strong performance on many multimodal tasks, but object hallucinations severely undermine their reliability. Most existing studies focus on the text modality, attributing hallucinations to overly…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Jiale Song , Jiaxin Luo , Xue-song Tang , Kuangrong Hao , Mingbo Zhao

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Due to the unidirectional masking mechanism, Decoder-Only models propagate information from left to right. LVLMs (Large Vision-Language Models) follow the same architecture, with visual information gradually integrated into semantic…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Jianfei Zhao , Feng Zhang , Xin Sun , Chong Feng

Despite their significant advancements, Multimodal Large Language Models (MLLMs) often generate factually inaccurate information, referred to as hallucination. In this work, we address object hallucinations in MLLMs, where information is…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Pritam Sarkar , Sayna Ebrahimi , Ali Etemad , Ahmad Beirami , Sercan Ö. Arık , Tomas Pfister

Large vision-language models (LVLMs) achieve impressive performance on multimodal tasks but often suffer from hallucination, and confidently describe objects or attributes not present in the image. Current training-free interventions…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Mehrdad Fazli , Bowen Wei , Ahmet Sari , Ziwei Zhu

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

人工智能 · 计算机科学 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable reasoning capabilities yet continue to suffer from hallucination, where generated text contradicts visual content. In this paper, we introduce Dual-Anchor Introspective…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Yebo Wu , Han Jin , Zhijiang Guo , Li Li

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

计算与语言 · 计算机科学 2024-08-12 Avshalom Manevich , Reut Tsarfaty

Recent advancements in Large Vision-Language Models (LVLMs) have significantly expanded their utility in tasks like image captioning and visual question answering. However, they still struggle with object hallucination, where models…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Yeongjae Cho , Keonwoo Kim , Taebaek Hwang , Sungzoon Cho

Although Large Vision-Language Models (LVLMs) have made substantial progress, hallucination, where generated text is not grounded in the visual input, remains a challenge. As LVLMs become stronger, previously reported hallucination…

计算机视觉与模式识别 · 计算机科学 2026-03-03 April Fu

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal abilities but remain prone to multilingual object hallucination, with a higher likelihood of generating responses inconsistent with the visual input when utilizing…

Despite the impressive capabilities of Large Vision-Language Models (LVLMs), they remain susceptible to hallucinations-generating content that is inconsistent with the input image. Existing training-free hallucination mitigation methods…

机器学习 · 计算机科学 2025-05-20 Kai Tang , Jinhao You , Xiuqi Ge , Hanze Li , Yichen Guo , Xiande Huang

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Contrastive decoding strategies are widely used to mitigate object hallucinations in multimodal large language models (MLLMs). By reducing over-reliance on language priors, these strategies ensure that generated content remains closely…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Hao Yin , Guangzong Si , Zilei Wang
‹ 上一页 1 2 3 10 下一页 ›