中文
相关论文

相关论文: Volcano: Mitigating Multimodal Hallucination throu…

200 篇论文

Multimodal large language models (MLLMs) have recently shown significant advancements in video understanding, excelling in content reasoning and instruction-following tasks. However, hallucination, where models generate inaccurate or…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Chaoyu Li , Eun Woo Im , Pooyan Fazli

Vision Language Models (VLMs) are increasingly used in autonomous driving to help understand traffic scenes, but they sometimes produce hallucinations, which are false details not grounded in the visual input. Detecting and mitigating…

机器人学 · 计算机科学 2025-11-11 Keke Long , Jiacheng Guo , Tianyun Zhang , Hongkai Yu , Xiaopeng Li

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

While multi-modal large language models (MLLMs) have made significant progress in recent years, the issue of hallucinations remains a major challenge. To mitigate this phenomenon, existing solutions either introduce additional data for…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Fengyuan Sun , Hui Chen , Xinhao Xu , Dandan Zheng , Jingdong Chen , Jun Zhou , Jungong Han , Guiguang Ding

Video-language models (VLMs) achieve strong multimodal understanding but remain prone to hallucinations, especially when reasoning about actions and temporal order. Existing mitigation strategies, such as textual filtering or random video…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Tobia Poppi , Burak Uzkent , Amanmeet Garg , Lucas Porto , Garin Kessler , Yezhou Yang , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara , Florian Schiffers

Multimodal large language models (MLLMs) are increasingly adopted in remote sensing (RS) and have shown strong performance on tasks such as RS visual grounding (RSVG), RS visual question answering (RSVQA), and multimodal dialogue. However,…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Zihui Zhou , Yong Feng , Yanying Chen , Guofan Duan , Zhenxi Song , Mingliang Zhou , Weijia Jia

Recently, Multimodal Large Language Models (MLLMs) have made significant progress in the video comprehension field. Despite remarkable content reasoning and instruction following capabilities they demonstrated, the hallucination problem of…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Jiacheng Zhang , Yang Jiao , Shaoxiang Chen , Na Zhao , Zhiyu Tan , Hao Li , Xingjun Ma , Jingjing Chen

Large vision-language models (VLMs) are highly capable, yet often hallucinate by favoring textual prompts over visual evidence. We study this failure mode in a controlled object-counting setting, where the prompt overstates the number of…

计算机视觉与模式识别 · 计算机科学 2026-04-20 William Rudman , Michal Golovanevsky , Dana Arad , Yonatan Belinkov , Ritambhara Singh , Carsten Eickhoff , Kyle Mahowald

Multimodal Large Reasoning Models introduce the reasoning paradigm, demonstrating strong capabilities on complex vision-language tasks. However, they still suffer from severe hallucinations. Existing training-based methods typically…

人工智能 · 计算机科学 2026-05-28 Jiawei Kong , Hao Fang , Shunxiang Liao , Jinyu Li , Bin Chen , Hao Wu , Shu-Tao Xia , Min Zhang

Large vision-language models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding and generation tasks. However, these models occasionally generate hallucinatory texts, resulting in descriptions that seem reasonable…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Jiaqi Fan , Jianhua Wu , Hongqing Chu , Quanbo Ge , Bingzhao Gao

Since the resurgence of deep learning, vision-language models (VLMs) enhanced by large language models (LLMs) have grown exponentially in popularity. However, while LLMs can utilize extensive background knowledge and task information with…

计算与语言 · 计算机科学 2024-03-21 Haozhe Zhao , Zefan Cai , Shuzheng Si , Xiaojian Ma , Kaikai An , Liang Chen , Zixuan Liu , Sheng Wang , Wenjuan Han , Baobao Chang

Large Vision-Language Models (LVLMs) often produce responses that misalign with factual information, a phenomenon known as hallucinations. While hallucinations are well-studied, the exact causes behind them remain underexplored. In this…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Utkarsh Tyagi , Oriol Nieto , Zeyu Jin , Dinesh Manocha

While recent years have seen rapid progress in image-conditioned text generation, image captioning still suffers from the fundamental issue of hallucinations, namely, the generation of spurious details that cannot be inferred from the given…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Assaf Ben-Kish , Moran Yanuka , Morris Alper , Raja Giryes , Hadar Averbuch-Elor

Hallucinations in multimodal models have been extensively studied using benchmarks that probe reliability in image-text query settings. However, the effect of spoken queries on multimodal hallucinations remains largely unexplored, despite…

声音 · 计算机科学 2026-03-20 Hansol Park , Hoseong Ahn , Junwon Moon , Yejin Lee , Kyuhong Shim

The troubling rise of hallucination presents perhaps the most significant impediment to the advancement of responsible AI. In recent times, considerable research has focused on detecting and mitigating hallucination in Large Language Models…

人工智能 · 计算机科学 2024-04-02 Anku Rani , Vipula Rawte , Harshad Sharma , Neeraj Anand , Krishnav Rajbangshi , Amit Sheth , Amitava Das

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

计算与语言 · 计算机科学 2024-08-12 Avshalom Manevich , Reut Tsarfaty

Large Visual Language Models (LVLMs) have demonstrated impressive capabilities across multiple tasks. However, their trustworthiness is often challenged by hallucinations, which can be attributed to the modality misalignment and the…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Jiulong Wu , Zhengliang Shi , Shuaiqiang Wang , Jizhou Huang , Dawei Yin , Lingyong Yan , Min Cao , Min Zhang

Multimodal Large Language Models frequently suffer from inference hallucinations, partially stemming from language priors dominating visual evidence. Existing training-free mitigation methods either perturb the visual representation and…

计算与语言 · 计算机科学 2026-04-15 Sihang Jia , Shuliang Liu , Songbo Yang , Yibo Yan , Xin Zou , Xuming Hu

While Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse tasks, their practical deployment is severely hindered by hallucination issues, which become particularly acute during Reinforcement Learning…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Miao Pan , Wangjie Gan , Jintao Chen , Wenqi Zhang , Bing Sun , Jianwei Yin , Xuhong Zhang