中文
相关论文

相关论文: Online Self-Calibration Against Hallucination in V…

200 篇论文

Large Vision-Language Models (LVLMs) exhibit impressive multimodal reasoning capabilities but remain highly susceptible to object hallucination, where models generate responses that are not factually aligned with the visual content. Recent…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Younan Zhu , Linwei Tao , Minjing Dong , Chang Xu

Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities in multimodal tasks, but visual object hallucination remains a persistent issue. It refers to scenarios where models generate inaccurate visual object-related…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Liqiang Jing , Guiming Hardy Chen , Ehsan Aghazadeh , Xin Eric Wang , Xinya Du

Multi-modal Large Language Models (MLLMs) demonstrate remarkable success across various vision-language tasks. However, they suffer from visual hallucination, where the generated responses diverge from the provided image. Are MLLMs…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Dingchen Yang , Bowen Cao , Guang Chen , Changjun Jiang

While Vision-Language Models (VLMs) have shown remarkable abilities in visual and language reasoning tasks, they invariably generate flawed responses. Self-correction that instructs models to refine their outputs presents a promising…

计算与语言 · 计算机科学 2025-06-06 Jiayi He , Hehai Lin , Qingyun Wang , Yi Fung , Heng Ji

Large Vision Language Models (LVLMs) demonstrate strong capabilities in visual understanding and description, yet often suffer from hallucinations, attributing incorrect or misleading features to images. We observe that LVLMs…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Sangmin Woo , Donguk Kim , Jaehyuk Jang , Yubin Choi , Changick Kim

Vision-Language Models (VLMs) excel at visual understanding but often suffer from visual hallucinations, where they generate descriptions of nonexistent objects, actions, or concepts, posing significant risks in safety-critical…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Tsung-Han Wu , Heekyung Lee , Jiaxin Ge , Joseph E. Gonzalez , Trevor Darrell , David M. Chan

Large vision language models (LVLMs) often suffer from object hallucination, producing objects not present in the given images. While current benchmarks for object hallucination primarily concentrate on the presence of a single object class…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Xuweiyi Chen , Ziqiao Ma , Xuejun Zhang , Sihan Xu , Shengyi Qian , Jianing Yang , David F. Fouhey , Joyce Chai

Recently, Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multi-modal context comprehension. However, they still suffer from hallucination problems referring to generating inconsistent outputs with the…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Xiaoye Qu , Jiashuo Sun , Wei Wei , Yu Cheng

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Despite great success across various multimodal tasks, Large Vision-Language Models (LVLMs) often encounter object hallucinations with generated textual responses being inconsistent with the actual objects in images. We examine different…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Wenbin An , Feng Tian , Sicong Leng , Jiahao Nie , Haonan Lin , QianYing Wang , Ping Chen , Xiaoqin Zhang , Shijian Lu

Vision-language models often hallucinate details, generating non-existent objects or inaccurate attributes that compromise output reliability. Existing methods typically address these issues via extensive human annotations or external…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Mingfei Han , Haihong Hao , Jinxing Zhou , Zhihui Li , Yuhui Zheng , Xueqing Deng , Linjie Yang , Xiaojun Chang

Large vision-language models (LVLMs) are increasingly being applied to multi-view image inputs captured from diverse viewpoints. However, despite this growing use, current LVLMs often confuse or mismatch visual information originating from…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Wooje Park , Insu Lee , Soohyun Kim , Jaeyun Jang , Minyoung Noh , Kyuhong Shim , Byonghyo Shim

Large Vision-Language Models (LVLMs) suffer from hallucination issues, wherein the models generate plausible-sounding but factually incorrect outputs, undermining their reliability. A comprehensive quantitative evaluation is necessary to…

计算与语言 · 计算机科学 2024-10-07 Haoyi Qiu , Wenbo Hu , Zi-Yi Dou , Nanyun Peng

Large vision-language models (LVLMs) exhibit impressive ability to jointly reason over visual and textual inputs. However, they often produce outputs that are linguistically fluent but factually inconsistent with the visual evidence, i.e.,…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Zihu Wang , Boxun Xu , Yuxuan Xia , Peng Li

Object hallucination critically undermines the reliability of Multimodal Large Language Models, often stemming from a fundamental failure in cognitive introspection, where models blindly trust linguistic priors over specific visual…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Shuliang Liu , Songbo Yang , Dong Fang , Sihang Jia , Yuqi Tang , Lingfeng Su , Ruoshui Peng , Yibo Yan , Xin Zou , Xuming Hu

Large Vision-Language Models (VLMs) rely on effective multimodal alignment between pre-trained vision encoders and Large Language Models (LLMs) to integrate visual and textual information. This paper presents a comprehensive analysis of…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Shweta Mahajan , Hoang Le , Hyojin Park , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

Multimodal Large Language Models (MLLMs) frequently suffer from hallucination issues, generating information about objects that are not present in input images during vision-language tasks. These hallucinations particularly undermine model…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Dokyoon Yoon , Youngsook Song , Woomyong Park

Object hallucination in Large Vision-Language Models (LVLMs) severely compromises their reliability in real-world applications, posing a critical barrier to their deployment in high-stakes scenarios such as autonomous driving and medical…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Han Sun , Qin Li , Peixin Wang , Min Zhang

Open-source multimodal large language models (MLLMs) excel in various tasks involving textual and visual inputs but still struggle with complex multimodal mathematical reasoning, lagging behind proprietary models like GPT-4V(ision) and…

计算与语言 · 计算机科学 2024-04-29 Mengzhao Jia , Zhihan Zhang , Wenhao Yu , Fangkai Jiao , Meng Jiang

Multimodal Diffusion Large Language Models (MDLLMs) achieve high-concurrency generation through parallel masked decoding, yet the architectures remain prone to multimodal hallucinations. This structural vulnerability stems from an…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Vishal Narnaware , Animesh Gupta , Kevin Zhai , Zhenyi Wang , Mubarak Shah