中文
相关论文

相关论文: Causally-Grounded Dual-Path Attention Intervention…

200 篇论文

Recent Large Vision-Language Models (LVLMs) have introduced a new paradigm for understanding and reasoning about image input through textual responses. Although they have achieved remarkable performance across a range of multi-modal tasks,…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Zifu Wan , Ce Zhang , Silong Yong , Martin Q. Ma , Simon Stepputtis , Louis-Philippe Morency , Deva Ramanan , Katia Sycara , Yaqi Xie

Large Vision-Language Models have shown strong multimodal reasoning capabilities, yet they remain susceptible to object hallucinations when language priors dominate insufficient or misaligned visual evidence. Training-free contrastive…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Xiaoyi Huang , Kejia Zhang , Zhiming Luo

Despite the remarkable multimodal capabilities of Large Vision-Language Models (LVLMs), discrepancies often occur between visual inputs and textual outputs--a phenomenon we term visual hallucination. This critical reliability gap poses…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Tao Huang , Zhekun Liu , Rui Wang , Yang Zhang , Liping Jing

Recently, Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multi-modal context comprehension. However, they still suffer from hallucination problems referring to generating inconsistent outputs with the…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Xiaoye Qu , Jiashuo Sun , Wei Wei , Yu Cheng

Large Vision-Language Models (LVLMs) frequently suffer from severe hallucination issues. Existing mitigation strategies predominantly rely on isolated, single-step states to enhance visual focus or suppress strong linguistic priors.…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Bei Yan , Yuecong Min , Jie Zhang , Shiguang Shan , Xilin Chen

Hallucination poses a persistent challenge for multimodal large language models (MLLMs). However, existing benchmarks for evaluating hallucinations are generally static, which may overlook the potential risk of data contamination. To…

计算与语言 · 计算机科学 2025-07-08 Yahan Tu , Rui Hu , Jitao Sang

Recent studies have shown that large vision-language models (LVLMs) often suffer from the issue of object hallucinations (OH). To mitigate this issue, we introduce an efficient method that edits the model weights based on an unsafe…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Le Yang , Ziwei Zheng , Boxu Chen , Zhengyu Zhao , Chenhao Lin , Chao Shen

Multimodal Large Language Models (MLLMs) excel in vision-language tasks, such as image captioning and visual question answering. However, they often suffer from over-reliance on spurious correlations, primarily due to linguistic priors that…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Yixuan Wu , Yang Zhang , Jian Wu , Philip Torr , Jindong Gu

Large Vision-Language Models (LVLMs) face a tug-of-war between powerful linguistic priors and visual evidence, often leading to \emph{semantic drift}: a progressive detachment from the input image that can abruptly emerge at specific…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Jiahe Chen , Jiaying He , Qiyuan Chen , Qian Shao , Jiahe Ying , Hongxia Xu , Jintai Chen , Jianwei Zheng , Jian Wu

Large Vision-Language Models (LVLMs) exhibit strong multimodal capabilities but remain vulnerable to hallucinations from intrinsic errors and adversarial attacks from external exploitations, limiting their reliability in real-world…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

Large Language Models (LLMs) often hallucinate, producing unfaithful or factually incorrect outputs by misrepresenting the provided context or incorrectly recalling internal knowledge. Recent studies have identified specific attention heads…

When asked to summarize articles or answer questions given a passage, large language models (LLMs) can hallucinate details and respond with unsubstantiated answers that are inaccurate with respect to the input context. This paper describes…

计算与语言 · 计算机科学 2024-10-04 Yung-Sung Chuang , Linlu Qiu , Cheng-Yu Hsieh , Ranjay Krishna , Yoon Kim , James Glass

Large vision language models (LVLMs) often suffer from object hallucination, producing objects not present in the given images. While current benchmarks for object hallucination primarily concentrate on the presence of a single object class…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Xuweiyi Chen , Ziqiao Ma , Xuejun Zhang , Sihan Xu , Shengyi Qian , Jianing Yang , David F. Fouhey , Joyce Chai

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

The troubling rise of hallucination presents perhaps the most significant impediment to the advancement of responsible AI. In recent times, considerable research has focused on detecting and mitigating hallucination in Large Language Models…

人工智能 · 计算机科学 2024-04-02 Anku Rani , Vipula Rawte , Harshad Sharma , Neeraj Anand , Krishnav Rajbangshi , Amit Sheth , Amitava Das

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Video Large Language Models (Video-LLMs) remain prone to spatiotemporal hallucinations, often generating visually unsupported details or incorrect temporal relations. Existing mitigation methods typically treat hallucination as a uniform…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Linfeng Fan , Yuan Tian , Ziwei Li , Zhiwu Lu

Hallucinations pose a significant challenge to the reliability of large vision-language models, making their detection essential for ensuring accuracy in critical applications. Current detection methods often rely on computationally…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Eunkyu Park , Minyeong Kim , Gunhee Kim

Multimodal Large Language Models (MLLMs) frequently exhibit hallucination phenomena, but the underlying reasons remain poorly understood. In this paper, we present an empirical analysis and find that, although MLLMs incorrectly generate the…

计算与语言 · 计算机科学 2025-02-25 Chenxi Wang , Xiang Chen , Ningyu Zhang , Bozhong Tian , Haoming Xu , Shumin Deng , Huajun Chen

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

计算与语言 · 计算机科学 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui