中文
相关论文

相关论文: SAVAA: Mitigating Hallucinations in LVLMs via Step…

200 篇论文

Multimodal Large Language Models (MLLMs) have made significant strides by combining visual recognition and language understanding to generate content that is both coherent and contextually accurate. However, MLLMs continue to struggle with…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Haoran Zhou , Zihan Zhang , Hao Chen

Large Vision-Language Models (LVLMs) have achieved significant success in recent years, and they have been extended to the medical domain. Although demonstrating satisfactory performance on medical Visual Question Answering (VQA) tasks,…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Danfeng Guo , Demetri Terzopoulos

Large vision-language models (LVLMs) have achieved remarkable performance on multimodal tasks. However, they still suffer from hallucinations, generating text inconsistent with visual input, posing significant risks in real-world…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Zhenglin Hua , Jinghan He , Zijun Yao , Tianxu Han , Haiyun Guo , Yuheng Jia , Junfeng Fang

Rapid progress in large vision-language models (LVLMs) has achieved unprecedented performance in vision-language tasks. However, due to the strong prior of large language models (LLMs) and misaligned attention across modalities, LVLMs often…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Ziqiang Shi , Rujie Liu , Shanshan Yu , Satoshi Munakata , Koichi Shirahata

Vision language models (VLMs) often generate hallucination, i.e., content that cannot be substantiated by either textual or visual inputs. Prior work primarily attributes this to over-reliance on linguistic prior knowledge rather than…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Zheng Qi , Chao Shang , Evangelia Spiliopoulou , Nikolaos Pappas

Vision-language models (VLMs) have great potential for medical image understanding, particularly in Visual Report Generation (VRG) and Visual Question Answering (VQA), but they may generate hallucinated responses that contradict visual…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Zehui Liao , Shishuai Hu , Ke Zou , Mengyuan Jin , Yanning Zhang , Huazhu Fu , Liangli Zhen , Yong Xia

Large language models (LLMs) have achieved remarkable success in various natural language processing tasks, yet they remain prone to generating factually incorrect outputs known as hallucinations. While recent approaches have shown promise…

计算与语言 · 计算机科学 2026-03-25 Qiyao Sun , Xingming Li , Xixiang He , Ao Cheng , Xuanyu Ji , Hailun Lu , Runke Huang , Qingyong Hu

Multimodal large language models (MLLMs) have shown strong potential for medical Visual Question Answering (VQA), yet they remain prone to hallucinations, defined as generating responses that contradict the input image, posing serious risks…

人工智能 · 计算机科学 2026-03-24 Mohammad Asadi , Tahoura Nedaee , Jack W. O'Sullivan , Euan Ashley , Ehsan Adeli

Recently, Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multi-modal context comprehension. However, they still suffer from hallucination problems referring to generating inconsistent outputs with the…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Xiaoye Qu , Jiashuo Sun , Wei Wei , Yu Cheng

Despite the significant progress of Multimodal Large Language Models (MLLMs) across diverse tasks, hallucination -- corresponding to the generation of visually inconsistent objects, attributes, or relations -- remains a major obstacle to…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Siyu Jiang , Feiyang Chen , Xiaojin Zhang , Kun He

In vision-language models (VLMs), misalignment between textual descriptions and visual coordinates often induces hallucinations. This issue becomes particularly severe in dense prediction tasks such as spatial-temporal video grounding…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Xiaowen Zhang , Zhi Gao , Licheng Jiao , Lingling Li , Qing Li

Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certainty, which hinders their usage in high-stakes domains. Existing verbalized confidence…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Wenyi Xiao , Xinchi Xu , Leilei Gan

Hallucinations remain a persistent challenge for vision-language models (VLMs), which often describe nonexistent objects or fabricate facts. Existing detection methods typically operate after text generation, making intervention both costly…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Sai Akhil Kogilathota , Sripadha Vallabha E G , Luzhe Sun , Jiawei Zhou

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Large Vision-Language Models (LVLMs) exhibit powerful generative capabilities but frequently produce hallucinations that compromise output reliability. Fine-tuning on annotated data devoid of hallucinations offers the most direct solution,…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Xingyu Zhu , Junfeng Fang , Shuo Wang , Beier Zhu , Zhicai Wang , Yonghui Yang , Xiangnan He

Large vision-language models (LVMs) extend large language models (LLMs) with visual perception capabilities, enabling them to process and interpret visual information. A major challenge compromising their reliability is object hallucination…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Kejia Zhang , Keda Tao , Jiasheng Tang , Huan Wang

Large Vision-Language Models (LVLMs) have recently achieved impressive results in multimodal tasks such as image captioning and visual question answering. However, they remain prone to object hallucination -- generating descriptions of…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Jinlin Li , Yuran Wang , Yifei Yuan , Xiao Zhou , Yingying Zhang , Xixian Yong , Yefeng Zheng , Xian Wu

Hallucination remains a fundamental challenge in vision-language models (VLMs), where autoregressive generation may produce linguistically plausible yet physically inconsistent or visually ungrounded responses due to likelihood maximization…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Qinwu Xu

Visual hallucination (VH) occurs when a multimodal large language model (MLLM) generates responses with incorrect visual details for prompts. Existing methods for generating VH test cases primarily rely on human annotations, typically in…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Zhongye Liu , Hongbin Liu , Yuepeng Hu , Zedian Shao , Neil Zhenqiang Gong

Multimodal Large Language Models (MLLMs) show strong performance in Visual Question Answering (VQA) but remain limited in fine-grained reasoning due to low-resolution inputs and noisy attention aggregation. We propose \textbf{Head Aware…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Junfei Xie , Peng Pan , Xulong Zhang