中文
相关论文

相关论文: V-ITI: Mitigating Hallucinations in Multimodal Lar…

200 篇论文

Large vision-language models (LVLMs), which integrate a vision encoder (VE) with a large language model, have achieved remarkable success across various tasks. However, there are still crucial challenges in LVLMs such as object…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Hoigi Seo , Dong Un Kang , Hyunjin Cho , Joohoon Lee , Se Young Chun

Multi-modal Large Language Models (MLLMs) have emerged as a powerful paradigm for integrating visual and textual information, supporting a wide range of multi-modal tasks. However, these models often suffer from hallucination, producing…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Zhiyuan Chen , Yuecong Min , Jie Zhang , Bei Yan , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

Large Vision-Language Models (LVLMs) are susceptible to hallucinations, where generated responses seem semantically plausible yet exhibit little or no relevance to the input image. Previous studies reveal that this issue primarily stems…

计算与语言 · 计算机科学 2025-10-24 Hao Fang , Changle Zhou , Jiawei Kong , Kuofeng Gao , Bin Chen , Shu-Tao Xia

Large vision-language models (LVLMs) remain vulnerable to hallucination, often generating content misaligned with visual inputs. Although recent training-based approaches aim to mitigate hallucination, they typically rely on predefined or…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Shujun Liu , Siyuan Wang , Zejun Li , Jianxiang Wang , Cheng Zeng , Zhongyu Wei

Multimodal Large Language Models (MLLMs) have achieved impressive advances, yet object hallucination remains a persistent challenge. Existing methods, based on the flawed assumption that omission and fabrication hallucinations share a…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Guangzong Si , Hao Yin , Xianfei Li , Qing Ding , Wenlong Liao , Tao He , Pai Peng

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

Large Vision Language Models (LVLMs) are becoming increasingly important in the medical domain, yet Medical LVLMs (Med-LVLMs) frequently generate hallucinations due to limited expertise and the complexity of medical applications. Existing…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Aofei Chang , Le Huang , Parminder Bhatia , Taha Kass-Hout , Fenglong Ma , Cao Xiao

Multi-modal Large Language Models (MLLMs) demonstrate remarkable success across various vision-language tasks. However, they suffer from visual hallucination, where the generated responses diverge from the provided image. Are MLLMs…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Dingchen Yang , Bowen Cao , Guang Chen , Changjun Jiang

The increasing use of vision-language models (VLMs) in healthcare applications presents great challenges related to hallucinations, in which the models may generate seemingly plausible results that are in fact incorrect. Such hallucinations…

人工智能 · 计算机科学 2025-03-03 Qiao Yan , Yuchen Yuan , Xiaowei Hu , Yihan Wang , Jiaqi Xu , Jinpeng Li , Chi-Wing Fu , Pheng-Ann Heng

Multi-modal Large Langue Models (MLLMs) often process thousands of visual tokens, which consume a significant portion of the context window and impose a substantial computational burden. Prior work has empirically explored visual token…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Dingchen Yang , Bowen Cao , Anran Zhang , Weibo Gu , Winston Hu , Guang Chen

Large vision-language models show tremendous potential in understanding visual information through human languages. However, they are prone to suffer from object hallucination, i.e., the generated image descriptions contain objects that do…

计算与语言 · 计算机科学 2025-03-03 Jiaqi Bai , Hongcheng Guo , Zhongyuan Peng , Jian Yang , Zhoujun Li , Mohan Li , Zhihong Tian

Despite the remarkable multimodal capabilities of Large Vision-Language Models (LVLMs), discrepancies often occur between visual inputs and textual outputs--a phenomenon we term visual hallucination. This critical reliability gap poses…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Tao Huang , Zhekun Liu , Rui Wang , Yang Zhang , Liping Jing

Vision Large Language Models (VLLMs) are widely acknowledged to be prone to hallucinations. Existing research addressing this problem has primarily been confined to image inputs, with limited exploration of video-based hallucinations.…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Wey Yeh Choong , Yangyang Guo , Mohan Kankanhalli

Despite the advanced capabilities of Large Vision-Language Models (LVLMs), they frequently suffer from object hallucination. One reason is that visual features and pretrained textual representations often become intertwined in the deeper…

人工智能 · 计算机科学 2026-05-12 Jialin Wu , Wei Shi , Han Shen , Peigui Qi , Kunsheng Tang , Zhicong Huang , Binghao Wang , Zhou Yang

Despite the remarkable ability of large vision-language models (LVLMs) in image comprehension, these models frequently generate plausible yet factually incorrect responses, a phenomenon known as hallucination.Recently, in large language…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Qiyuan Chen , Wei Wei , Jishuo Sun , Jianfeng Dong

Despite the impressive advancements of Large Vision-Language Models (LVLMs), existing approaches suffer from a fundamental bottleneck: inefficient visual-language integration. Current methods either disrupt the model's inherent structure or…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Tongtian Yue , Longteng Guo , Yepeng Tang , Zijia Zhao , Xinxin Zhu , Hua Huang , Jing Liu

Since the resurgence of deep learning, vision-language models (VLMs) enhanced by large language models (LLMs) have grown exponentially in popularity. However, while LLMs can utilize extensive background knowledge and task information with…

计算与语言 · 计算机科学 2024-03-21 Haozhe Zhao , Zefan Cai , Shuzheng Si , Xiaojian Ma , Kaikai An , Liang Chen , Zixuan Liu , Sheng Wang , Wenjuan Han , Baobao Chang

Multimodal Large Language Models (MLLMs) have made significant progress in bridging the gap between visual and language modalities. However, hallucinations in MLLMs, where the generated text does not align with image content, continue to be…

人工智能 · 计算机科学 2024-08-05 Kohou Wang , Xiang Liu , Zhaoxiang Liu , Kai Wang , Shiguo Lian

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Multimodal Diffusion Large Language Models (MDLLMs) achieve high-concurrency generation through parallel masked decoding, yet the architectures remain prone to multimodal hallucinations. This structural vulnerability stems from an…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Vishal Narnaware , Animesh Gupta , Kevin Zhai , Zhenyi Wang , Mubarak Shah