English
Related papers

Related papers: MASH-VLM: Mitigating Action-Scene Hallucination in…

200 papers

Despite the remarkable multimodal capabilities of Large Vision-Language Models (LVLMs), discrepancies often occur between visual inputs and textual outputs--a phenomenon we term visual hallucination. This critical reliability gap poses…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Tao Huang , Zhekun Liu , Rui Wang , Yang Zhang , Liping Jing

Hallucinations in video-capable vision-language models (Video-VLMs) remain frequent and high-confidence, while existing uncertainty metrics often fail to align with correctness. We introduce VideoHEDGE, a modular framework for hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Sushant Gautam , Cise Midoglu , Vajira Thambawita , Michael A. Riegler , Pål Halvorsen

Despite growing interest in hallucination in Multimodal Large Language Models, existing studies primarily focus on single-image settings, leaving hallucination in multi-image scenarios largely unexplored. To address this gap, we conduct the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Jiale Li , Mingrui Wu , Zixiang Jin , Hao Chen , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Rongrong Ji

Large Vision-Language Models (LVLMs) have exhibited impressive capabilities across various visual tasks, yet they remain hindered by the persistent challenge of hallucinations. To address this critical issue, we propose Mixture of Decoding…

Computation and Language · Computer Science 2025-06-11 Xinlong Chen , Yuanxing Zhang , Qiang Liu , Junfei Wu , Fuzheng Zhang , Tieniu Tan

Video Large Language Models (VideoLLMs) have shown remarkable progress in video understanding. However, these models still struggle to effectively perceive and exploit rich temporal information in videos when responding to user queries.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chang-Hsun Wu , Kai-Po Chang , Yu-Yang Sheng , Hung-Kai Chung , Kuei-Chun Wang , Yu-Chiang Frank Wang

Multimodal large language models (MLLMs) have recently shown significant advancements in video understanding, excelling in content reasoning and instruction-following tasks. However, hallucination, where models generate inaccurate or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Chaoyu Li , Eun Woo Im , Pooyan Fazli

Video large language models (Video-LLMs) have made strong progress in general video understanding, but their ability to maintain temporal object consistency remains underexplored. Existing benchmarks often emphasize event recognition,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Junzhe Chen , Siyuan Meng , Yuxi Chen , Man Zhao , Wenyao Gui , Xiaojie Guo

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Video Temporal Grounding (VTG) faces a cross-modal semantic gap that often leads to background features being incorrectly aligned with the query, while directly matching the query to moments results in insufficient discriminability and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Ran Ran , Jiwei Wei , Shuchang Zhou , Yitong Qin , Shiyuan He , Zeyu Ma , Yuyang Zhou , Yang Yang

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal abilities but remain prone to multilingual object hallucination, with a higher likelihood of generating responses inconsistent with the visual input when utilizing…

Computation and Language · Computer Science 2025-06-16 Zekai Ye , Qiming Li , Xiaocheng Feng , Libo Qin , Yichong Huang , Baohang Li , Kui Jiang , Yang Xiang , Zhirui Zhang , Yunfei Lu , Duyu Tang , Dandan Tu , Bing Qin

Existing Large Vision-Language Models (LVLMs) exhibit insufficient visual attention, leading to hallucinations. To alleviate this problem, some previous studies adjust and amplify visual attention. These methods present a limitation that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jingyi Wang , Fei Li , Rujie Liu

Large vision-language models (LVLMs) have demonstrated impressive capabilities across diverse multimodal tasks, yet they remain highly susceptible to visual hallucinations (VH), often producing confident but inaccurate descriptions of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Lexiang Tang , Xianwei Zhuang , Bang Yang , Zhiyuan Hu , Hongxiang Li , Lu Ma , Jinghan Ru , Yuexian Zou

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

Multimodal large language models (MLLMs) have revolutionized the landscape of AI, demonstrating impressive capabilities in tackling complex vision and audio-language tasks. However, a critical challenge remains: these models often suffer…

Machine Learning · Computer Science 2026-05-05 Itai Allouche , Joseph Keshet

Vision-and-language (V-L) tasks require the system to understand both vision content and natural language, thus learning fine-grained joint representations of vision and language (a.k.a. V-L representations) is of paramount importance.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Fenglin Liu , Xian Wu , Shen Ge , Xuancheng Ren , Wei Fan , Xu Sun , Yuexian Zou

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

Large Vision-Language Models (LVLMs) have achieved remarkable success across cross-modal tasks but remain hindered by hallucinations, producing textual outputs inconsistent with visual content. Existing methods mitigate hallucinations but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Yuanhong Zhang , Zhaoyang Wang , Xin Zhang , Weizhan Zhang , Joey Tianyi Zhou

Large Vision-Language Models (LVLMs) have shown remarkable performance on a wide range of vision-language tasks. Despite this progress, they are still prone to hallucination, generating responses that are inconsistent with visual content.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yutong Xie , Zhenglin Hua , Ran Wang , Wing W. Y. Ng , Xizhao Wang , Yuheng Jia

Multimodal Large Language Models (MLLMs) excel in numerous vision-language tasks yet suffer from hallucinations, producing content inconsistent with input visuals, that undermine reliability in precision-sensitive domains. This issue stems…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Nan Sun , Zhenyu Zhang , Xixun Lin , Kun Wang , Yanmin Shang , Naibin Gu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang , Yanan Cao

Human action recognition in long-term videos, characterized by complex backgrounds and subtle action differences, poses significant challenges for traditional deep learning models due to computational overhead, difficulty in capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Kaining Li , Shuwei He , Zihan Xu