中文
相关论文

相关论文: Prefill-Time Intervention for Mitigating Hallucina…

200 篇论文

Object hallucination remains a primary obstacle to the reliable deployment of Multimodal Large Language Models (MLLMs). Current inference-time mitigation methods mainly assume hallucinations stem from visual neglect, steering models to…

计算与语言 · 计算机科学 2026-05-28 Jingwen Wu , Xijun Zhang , Ge Song

Object Hallucination (OH) has been acknowledged as one of the major trustworthy challenges in Large Vision-Language Models (LVLMs). Recent advancements in Large Language Models (LLMs) indicate that internal states, such as hidden states,…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Jinhao Duan , Fei Kong , Hao Cheng , James Diffenderfer , Bhavya Kailkhura , Lichao Sun , Xiaofeng Zhu , Xiaoshuang Shi , Kaidi Xu

Large vision-language models (LVLMs) exhibit impressive ability to jointly reason over visual and textual inputs. However, they often produce outputs that are linguistically fluent but factually inconsistent with the visual evidence, i.e.,…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Zihu Wang , Boxun Xu , Yuxuan Xia , Peng Li

Large Language Models (LLMs) demonstrate remarkable capabilities in text understanding and generation. However, their tendency to produce factually inconsistent outputs, commonly referred to as ''hallucinations'', remains a critical…

Hallucination has been a long-standing and inevitable problem that hinders the application of Large Vision-Language Models (LVLMs) in domains that require high reliability. Various methods focus on improvement depending on data annotations…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Chao Wang , Jianming Yang , Yang Zhou

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Large Vision-Language Models (LVLMs) are susceptible to hallucinations, where generated responses seem semantically plausible yet exhibit little or no relevance to the input image. Previous studies reveal that this issue primarily stems…

计算与语言 · 计算机科学 2025-10-24 Hao Fang , Changle Zhou , Jiawei Kong , Kuofeng Gao , Bin Chen , Shu-Tao Xia

Large Vision-Language Models (LVLMs) have achieved remarkable success across cross-modal tasks but remain hindered by hallucinations, producing textual outputs inconsistent with visual content. Existing methods mitigate hallucinations but…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Yuanhong Zhang , Zhaoyang Wang , Xin Zhang , Weizhan Zhang , Joey Tianyi Zhou

To address hallucination issues in large language models (LLMs), this paper proposes a method for mitigating prompt-induced hallucinations. Building on a knowledge distillation chain-style model, we introduce a code module to guide…

计算与语言 · 计算机科学 2026-01-07 Jinbo Hao , Kai Yang , Qingzhen Su , Yang Chen , Yifan Li , Chao Jiang

Although Large Vision-Language Models (LVLMs) have demonstrated powerful capabilities in interpreting visual information, they frequently produce content that deviates from visual information, leading to object hallucination. To tackle…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Qiming Li , Zekai Ye , Xiaocheng Feng , Weihong Zhong , Libo Qin , Ruihan Chen , Baohang Li , Kui Jiang , Yaowei Wang , Ting Liu , Bing Qin

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Large vision-language models (LVLMs) have demonstrated impressive capabilities across diverse multimodal tasks, yet they remain highly susceptible to visual hallucinations (VH), often producing confident but inaccurate descriptions of…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Lexiang Tang , Xianwei Zhuang , Bang Yang , Zhiyuan Hu , Hongxiang Li , Lu Ma , Jinghan Ru , Yuexian Zou

Hallucinations in large vision-language models (LVLMs) are a significant challenge, i.e., generating objects that are not presented in the visual input, which impairs their reliability. Recent studies often attribute hallucinations to a…

计算与语言 · 计算机科学 2025-08-13 Yuying Shang , Xinyi Zeng , Yutao Zhu , Xiao Yang , Zhengwei Fang , Jingyuan Zhang , Jiawei Chen , Zinan Liu , Yu Tian

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Recently, Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multi-modal context comprehension. However, they still suffer from hallucination problems referring to generating inconsistent outputs with the…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Xiaoye Qu , Jiashuo Sun , Wei Wei , Yu Cheng

Despite their success, Large Vision-Language Models (LVLMs) remain vulnerable to hallucinations. While existing studies attribute the cause of hallucinations to insufficient visual attention to image tokens, our findings indicate that…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Beitao Chen , Xinyu Lyu , Lianli Gao , Jingkuan Song , Heng Tao Shen

Despite their remarkable progress in multimodal understanding tasks, large vision language models (LVLMs) often suffer from "hallucinations", generating texts misaligned with the visual context. Existing methods aimed at reducing…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Sreetama Sarkar , Yue Che , Alex Gavin , Peter A. Beerel , Souvik Kundu

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu

Hallucinations in large language models (LLMs) present a growing challenge across real-world applications, from healthcare to law, where factual reliability is essential. Despite advances in alignment and instruction tuning, LLMs can still…

计算与语言 · 计算机科学 2025-05-02 Makoto Sato

Large Vision-Language Models (LVLMs) have achieved remarkable success but continue to struggle with object hallucination (OH), generating outputs inconsistent with visual inputs. While previous work has proposed methods to reduce OH, the…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Boxu Chen , Ziwei Zheng , Le Yang , Zeyu Geng , Zhengyu Zhao , Chenhao Lin , Chao Shen