English
Related papers

Related papers: MASH-VLM: Mitigating Action-Scene Hallucination in…

200 papers

Large Vision-Language Models (LVLMs) frequently suffer from severe hallucination issues. Existing mitigation strategies predominantly rely on isolated, single-step states to enhance visual focus or suppress strong linguistic priors.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Bei Yan , Yuecong Min , Jie Zhang , Shiguang Shan , Xilin Chen

Large vision-language models (VLMs) demonstrate strong performance in medical image understanding, but frequently generate clinically plausible yet incorrect statements, raising significant safety concerns. Existing medical hallucination…

Large Vision-Language Models (LVLMs) have made significant progress in recent years but are also prone to hallucination issues. They exhibit more hallucinations in longer, free-form responses, often attributed to accumulated uncertainties.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Ge Zheng , Jiaye Qian , Jiajin Tang , Sibei Yang

Large vision-language models (VLMs) frequently suffer from hallucinations, generating content that is inconsistent with visual inputs. Existing methods typically address this problem through post-hoc filtering, additional training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tripti Shukla , Zsolt Kira

Multi-modal Large Language Models (MLLMs) demonstrate remarkable success across various vision-language tasks. However, they suffer from visual hallucination, where the generated responses diverge from the provided image. Are MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Dingchen Yang , Bowen Cao , Guang Chen , Changjun Jiang

Unsupervised human motion segmentation (HMS) can be effectively achieved using subspace clustering techniques. However, traditional methods overlook the role of temporal semantic exploration in HMS. This paper explores the use of temporal…

Machine Learning · Computer Science 2025-12-30 Zheng Xing , Weibing Zhao

We propose a novel task, hallucination localization in video captioning, which aims to identify hallucinations in video captions at the span level (i.e. individual words or phrases). This allows for a more detailed analysis of…

Multimedia · Computer Science 2025-10-30 Shota Nakada , Kazuhiro Saito , Yuchi Ishikawa , Hokuto Munakata , Tatsuya Komatsu , Masayoshi Kondo

Recent video anomaly detection research has expanded rapidly with an emphasis on general models of normality intended to work across many different scenes. While this focus has led to improvements in scalability and multi-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Furkan Mumcu , Michael J. Jones , Anoop Cherian , Yasin Yilmaz

Large Vision Language Models (LVLMs) have recently achieved superior performance in various tasks on natural image and text data, which inspires a large amount of studies for LVLMs fine-tuning and training. Despite their advancements, there…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zishan Gu , Changchang Yin , Fenglin Liu , Ping Zhang

Fusing visual understanding into language generation, Multi-modal Large Language Models (MLLMs) are revolutionizing visual-language applications. Yet, these models are often plagued by the hallucination problem, which involves generating…

Machine Learning · Computer Science 2025-01-28 Yining Wang , Mi Zhang , Junjie Sun , Chenyue Wang , Min Yang , Hui Xue , Jialing Tao , Ranjie Duan , Jiexi Liu

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Rapid progress in large vision-language models (LVLMs) has achieved unprecedented performance in vision-language tasks. However, due to the strong prior of large language models (LLMs) and misaligned attention across modalities, LVLMs often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Ziqiang Shi , Rujie Liu , Shanshan Yu , Satoshi Munakata , Koichi Shirahata

Despite the significant success of Large Vision-Language models(LVLMs), these models still suffer hallucinations when describing images, generating answers that include non-existent objects. It is reported that these models tend to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Li , Dehong Gao , Yeyuan Wang , Linbo Jin , Shanqing Yu , Xiaoyan Cai , Libin Yang

Cause-and-effect reasoning in video is a significant challenge for Vision-Language Models (VLMs), as it requires going beyond surface-level perception to a deeper understanding of causal mechanisms. However, existing benchmarks rarely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Mingfang Zhang , Jingjing Pan , Ashutosh Kumar , Rajat Saini , Mustafa Erdogan , Hsuan-Kung Yang , Caixin Kang , Yifei Huang , Yoichi Sato , Quan Kong

Spatio-temporal video grounding (STVG) aims at localizing the spatio-temporal tube of a video, as specified by the input text query. In this paper, we utilize multimodal large language models (MLLMs) to explore a zero-shot solution in STVG.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Zaiquan Yang , Yuhao Liu , Gerhard Hancke , Rynson W. H. Lau

Long video understanding (LVU) remains a core challenge in multimodal learning. Although recent vision-language models (VLMs) have made notable progress, existing benchmarks mainly focus on either fine-grained perception or coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Seng Nam Chen , Hao Chen , Chenglam Ho , Xinyu Mao , Jinping Wang , Yu Zhang , Chao Li

Visual hallucination (VH) means that a multi-modal LLM (MLLM) imagines incorrect details about an image in visual question answering. Existing studies find VH instances only in existing image datasets, which results in biased understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Wen Huang , Hongbin Liu , Minxin Guo , Neil Zhenqiang Gong

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination-where…

Computation and Language · Computer Science 2025-06-11 Jinghan He , Kuan Zhu , Haiyun Guo , Junfeng Fang , Zhenglin Hua , Yuheng Jia , Ming Tang , Tat-Seng Chua , Jinqiao Wang

Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for safe semantic reasoning and decision-making. While recent VLMs demonstrate strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Guo Cheng

Recent advancements in large video models (LVMs) have significantly enhance video understanding. However, these models continue to suffer from hallucinations, producing content that conflicts with input videos. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Meng Luo , Shengqiong Wu , Liqiang Jing , Tianjie Ju , Li Zheng , Jinxiang Lai , Tianlong Wu , Xinya Du , Jian Li , Siyuan Yan , Jiebo Luo , William Yang Wang , Hao Fei , Mong-Li Lee , Wynne Hsu