中文
相关论文

相关论文: PerturboLLaVA: Reducing Multimodal Hallucinations …

200 篇论文

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Large Vision Language Models (LVLMs) have shown remarkable capabilities in multimodal tasks like visual question answering or image captioning. However, inconsistencies between the visual information and the generated text, a phenomenon…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Laura Fieback , Jakob Spiegelberg , Hanno Gottschalk

Hallucination is a common issue in Multimodal Large Language Models (MLLMs), yet the underlying principles remain poorly understood. In this paper, we investigate which components of MLLMs contribute to object hallucinations. To analyze…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Yueqian Wang , Jianxin Liang , Yuxuan Wang , Huishuai Zhang , Dongyan Zhao

While large vision-language models (LVLMs) have shown impressive capabilities in generating plausible responses correlated with input visual contents, they still suffer from hallucinations, where the generated text inaccurately reflects…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yi-Lun Lee , Yi-Hsuan Tsai , Wei-Chen Chiu

While Large Language Models (LLMs) have emerged as powerful foundational models to solve a variety of tasks, they have also been shown to be prone to hallucinations, i.e., generating responses that sound confident but are actually incorrect…

计算与语言 · 计算机科学 2026-04-29 Jiawei Li , Akshayaa Magesh , Venugopal V. Veeravalli

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

计算与语言 · 计算机科学 2025-11-20 Moses Kiprono

Multi-modal Large Language Models (MLLMs) excel in vision-language tasks but remain vulnerable to visual adversarial perturbations that can induce hallucinations, manipulate responses, or bypass safety mechanisms. Existing methods seek to…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Hashmat Shadab Malik , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar , Fahad Khan , Salman Khan

Large Vision Language Models (LVLMs) have achieved significant progress in integrating visual and textual inputs for multimodal reasoning. However, a recurring challenge is ensuring these models utilize visual information as effectively as…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Estelle Aflalo , Gabriela Ben Melech Stan , Tiep Le , Man Luo , Shachar Rosenman , Sayak Paul , Shao-Yen Tseng , Vasudev Lal

Despite achieving rapid developments and with widespread applications, Large Vision-Language Models (LVLMs) confront a serious challenge of being prone to generating hallucinations. An over-reliance on linguistic priors has been identified…

计算机视觉与模式识别 · 计算机科学 2024-02-29 Lanyun Zhu , Deyi Ji , Tianrun Chen , Peng Xu , Jieping Ye , Jun Liu

The rapid advancements in Large Language Models (LLMs) and Large Visual-Language Models (LVLMs) have opened up new opportunities for integrating visual and linguistic modalities. However, effectively aligning these modalities remains…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Sihan Yang , Chenhang Cui , Zihao Zhao , Yiyang Zhou , Weilong Yan , Ying Wei , Huaxiu Yao

Multimodal Large Language Models (MLLMs) have shown impressive perception and reasoning capabilities, yet they often suffer from hallucinations -- generating outputs that are linguistically coherent but inconsistent with the context of the…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Bingkui Tong , Jiaer Xia , Kaiyang Zhou

Vision-Language Models (VLMs) have shown solid ability for multimodal understanding of both visual and language contexts. However, existing VLMs often face severe challenges of hallucinations, meaning that VLMs tend to generate responses…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Jinjin Cao , Zhiyang Chen , Zijun Wang , Liyuan Ma , Weijian Luo , Guojun Qi

Multimodal Large Language Models (MLLMs) suffer from hallucinations. Existing hallucination evaluation benchmarks are often limited by over-simplified tasks leading to saturated metrics, or insufficient diversity that fails to adequately…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Zhihan Yin , Jianxin Liang , Yueqian Wang , Yifeng Yao , Huishuai Zhang , Dongyan Zhao

Medical Large Language Models (MLLMs) have demonstrated potential in healthcare applications, yet their propensity for hallucinations -- generating medically implausible or inaccurate information -- presents substantial risks to patient…

计算与语言 · 计算机科学 2025-04-01 Kaiwen Zuo , Yirui Jiang

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Large vision-language models (LVLMs) have demonstrated remarkable multimodal comprehension and reasoning capabilities, but they still suffer from severe object hallucination. Previous studies primarily attribute the flaw to linguistic prior…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Haohan Zheng , Zhenguo Zhang

Large Vision Language Models (LVLMs) are increasingly integral to healthcare applications, including medical visual question answering and imaging report generation. While these models inherit the robust capabilities of foundational Large…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Jiawei Chen , Dingkang Yang , Tong Wu , Yue Jiang , Xiaolu Hou , Mingcheng Li , Shunli Wang , Dongling Xiao , Ke Li , Lihua Zhang

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

计算与语言 · 计算机科学 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Despite growing interest in hallucination in Multimodal Large Language Models, existing studies primarily focus on single-image settings, leaving hallucination in multi-image scenarios largely unexplored. To address this gap, we conduct the…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Jiale Li , Mingrui Wu , Zixiang Jin , Hao Chen , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Rongrong Ji

While multi-modal large language models (MLLMs) have made significant progress in recent years, the issue of hallucinations remains a major challenge. To mitigate this phenomenon, existing solutions either introduce additional data for…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Fengyuan Sun , Hui Chen , Xinhao Xu , Dandan Zheng , Jingdong Chen , Jun Zhou , Jungong Han , Guiguang Ding