中文
相关论文

相关论文: Pensieve: Retrospect-then-Compare Mitigates Visual…

200 篇论文

Multimodal large language models (MLLMs) have achieved remarkable success across diverse vision-language tasks, yet they remain highly susceptible to hallucinations, producing content that is fluent but inconsistent with visual evidence.…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Youxu Shi , Suorong Yang , Dong Liu

Multimodal Large Language Models (MLLMs) emerge as a unified interface to address a multitude of tasks, ranging from NLP to computer vision. Despite showcasing state-of-the-art results in many benchmarks, a long-standing issue is the…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Alberto Compagnoni , Davide Caffagni , Nicholas Moratelli , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

Recent work has demonstrated state-of-the-art results in large language model (LLM) hallucination detection and mitigation through consistency-based approaches which involve aggregating multiple responses sampled from a single LLM for a…

机器学习 · 计算机科学 2025-10-24 Demian Till , John Smeaton , Peter Haubrick , Gouse Saheb , Florian Graef , David Berman

Hallucination remains a fundamental challenge in vision-language models (VLMs), where autoregressive generation may produce linguistically plausible yet physically inconsistent or visually ungrounded responses due to likelihood maximization…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Qinwu Xu

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

人工智能 · 计算机科学 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities in understanding and describing visual content, achieving state-of-the-art performance across various vision-language tasks. However, these models often generate…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Kazi Hasan Ibn Arif , Sajib Acharjee Dip , Khizar Hussain , Lang Zhang , Chris Thomas

Despite the advanced capabilities of Large Vision-Language Models (LVLMs), they frequently suffer from object hallucination. One reason is that visual features and pretrained textual representations often become intertwined in the deeper…

人工智能 · 计算机科学 2026-05-12 Jialin Wu , Wei Shi , Han Shen , Peigui Qi , Kunsheng Tang , Zhicong Huang , Binghao Wang , Zhou Yang

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

计算与语言 · 计算机科学 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

The hallucination of large multimodal models (LMMs), providing responses that appear correct but are actually incorrect, limits their reliability and applicability. This paper aims to study the hallucination problem of LMMs in video…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Hongcheng Gao , Jiashu Qu , Jingyi Tang , Baolong Bi , Yue Liu , Hongyu Chen , Li Liang , Li Su , Qingming Huang

Large Vision-Language Models (LVLMs) have achieved impressive performance, yet research has pointed out a serious issue with object hallucinations within these models. However, there is no clear conclusion as to which part of the model…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Yufang Liu , Tao Ji , Changzhi Sun , Yuanbin Wu , Aimin Zhou

Large Vision Language Models (LVLMs) are becoming increasingly important in the medical domain, yet Medical LVLMs (Med-LVLMs) frequently generate hallucinations due to limited expertise and the complexity of medical applications. Existing…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Aofei Chang , Le Huang , Parminder Bhatia , Taha Kass-Hout , Fenglong Ma , Cao Xiao

The advancement of Large Vision-Language Models (LVLMs) has increasingly highlighted the critical issue of their tendency to hallucinate non-existing objects in the images. To address this issue, previous works focused on using specially…

机器学习 · 计算机科学 2025-06-13 Linxi Zhao , Yihe Deng , Weitong Zhang , Quanquan Gu

Multimodal Large Language Models (MLLMs) achieve strong multimodal reasoning performance, yet we identify a recurring failure mode in long-form generation: as outputs grow longer, models progressively drift away from image evidence and fall…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Shuai Lv , Chang Liu , Feng Tang , Yujie Yuan , Aojun Zhou , Kui Zhang , Xi Yang , Yangqiu Song

Vision-language models often hallucinate details, generating non-existent objects or inaccurate attributes that compromise output reliability. Existing methods typically address these issues via extensive human annotations or external…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Mingfei Han , Haihong Hao , Jinxing Zhou , Zhihui Li , Yuhui Zheng , Xueqing Deng , Linjie Yang , Xiaojun Chang

Hallucination is a common problem for Large Vision-Language Models (LVLMs) with long generations which is difficult to eradicate. The generation with hallucinations is partially inconsistent with the image content. To mitigate…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Yue Chang , Liqiang Jing , Xiaopeng Zhang , Yue Zhang

Multimodal Large Language Models (MLLMs) have emerged as a central focus in both industry and academia, but often suffer from biases introduced by visual and language priors, which can lead to multimodal hallucination. These biases arise…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Guanyu Zhou , Yibo Yan , Xin Zou , Kun Wang , Aiwei Liu , Xuming Hu

Large vision-language models (LVLMs) have shown remarkable abilities in understanding visual information with human languages. However, LVLMs still suffer from object hallucination, which is the problem of generating descriptions that…

机器学习 · 计算机科学 2024-03-19 Yiyang Zhou , Chenhang Cui , Jaehong Yoon , Linjun Zhang , Zhun Deng , Chelsea Finn , Mohit Bansal , Huaxiu Yao

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Multimodal large language models (MLLMs) frequently suffer from object hallucinations, yet the visual perceptual mechanism underlying this failure remains poorly understood. In this work, we reveal that hallucinations are strongly…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Quanjiang Li , Zhiming Liu , Wei Luo , Tingjin Luo , Chenping Hou

Hallucinations in Large Vision-Language Models (LVLMs) significantly undermine their reliability, motivating researchers to explore the causes of hallucination. However, most studies primarily focus on the language aspect rather than the…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Zhangqi Jiang , Junkai Chen , Beier Zhu , Tingjin Luo , Yankun Shen , Xu Yang