中文
相关论文

相关论文: Don't Blink: Evidence Collapse during Multimodal R…

200 篇论文

Multimodal Diffusion Large Language Models (MDLLMs) achieve high-concurrency generation through parallel masked decoding, yet the architectures remain prone to multimodal hallucinations. This structural vulnerability stems from an…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Vishal Narnaware , Animesh Gupta , Kevin Zhai , Zhenyi Wang , Mubarak Shah

Vision Language Models (VLMs) have achieved impressive progress in multimodal reasoning; yet, they remain vulnerable to hallucinations, where outputs are not grounded in visual evidence. In this paper, we investigate a previously overlooked…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Sifan Li , Hongkai Chen , Yujun Cai , Qingwen Ye , Liyang Chen , Junsong Yuan , Yiwei Wang

Large Multimodal Models (LMMs) have demonstrated impressive capabilities in video reasoning via Chain-of-Thought (CoT). However, the robustness of their reasoning chains remains questionable. In this paper, we identify a critical failure…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Zhihao Zhu , Jiafeng Liang , Shixin Jiang , Jinlan Fu , Ming Liu , Guanglu Sun , See-Kiong Ng , Bing Qin

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Visual reasoning is challenging, requiring both precise object grounding and understanding complex spatial relationships. Existing methods fall into two camps: language-only chain-of-thought approaches, which demand large-scale (image,…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Damiano Marsili , Georgia Gkioxari

Recent large vision-language models (LVLMs) have demonstrated impressive reasoning ability by generating long chain-of-thought (CoT) responses. However, CoT reasoning in multimodal contexts is highly vulnerable to visual hallucination…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yongchang Zhang , Oliver Ma , Tianyi Liu , Guangquan Zhou , Yang Chen

Recent diffusion large language models (dLLMs) have demonstrated both effectiveness and efficiency in reasoning via a block-based semi-autoregressive generation paradigm. Despite their progress, the fixed-size block generations remain a…

机器学习 · 计算机科学 2026-05-28 Yan Jiang , Ruihong Qiu , Zi Huang

Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory generation. However, the robustness of such systems under…

密码学与安全 · 计算机科学 2026-05-29 Mohammadreza Teymoorianfard , Jean-Philippe Monteuuis , Jonathan Petit , Amir Houmansadr

Moral reasoning is fundamental to safe Artificial Intelligence (AI), yet ensuring its consistency across modalities becomes critical as AI systems evolve from text-based assistants to embodied agents. Current safety techniques demonstrate…

人工智能 · 计算机科学 2026-03-18 Xinyi Yang , Chenheng Xu , Weijun Hong , Ce Mo , Qian Wang , Fang Fang , Yixin Zhu

Recent advances in fine-tuning multimodal large language models (MLLMs) using reinforcement learning have achieved remarkable progress, particularly with the introduction of various entropy control techniques. However, the role and…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Shuo Li , Jiajun Sun , Zhihao Zhang , Xiaoran Fan , Senjie Jin , Hui Li , Yuming Yang , Junjie Ye , Lixing Shen , Tao Ji , Tao Gui , Qi Zhang , Xuanjing Huang

The robustness of Vision Language Models (VLMs) is commonly assessed through output-level invariance, implicitly assuming that stable predictions reflect stable multimodal processing. In this work, we argue that this assumption is…

LLMs trained on massive datasets may inadvertently acquire sensitive information such as personal details and potentially harmful content. This risk is further heightened in multimodal LLMs as they integrate information from multiple…

计算与语言 · 计算机科学 2025-05-06 Vaidehi Patil , Yi-Lin Sung , Peter Hase , Jie Peng , Tianlong Chen , Mohit Bansal

Large language models (LLMs) produce fluent but unsupported answers - hallucinations - limiting safe deployment in high-stakes domains. We propose ECLIPSE, a framework that treats hallucination as a mismatch between a model's semantic…

机器学习 · 计算机科学 2025-12-04 Mainak Singha

Vision-Language Models (VLMs) have gained community-spanning prominence due to their ability to integrate visual and textual inputs to perform complex tasks. Despite their success, the internal decision-making processes of these models…

计算与语言 · 计算机科学 2025-05-16 Michal Golovanevsky , William Rudman , Vedant Palit , Ritambhara Singh , Carsten Eickhoff

Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for safe semantic reasoning and decision-making. While recent VLMs demonstrate strong performance…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Guo Cheng

Vision-language models (VLMs) are increasingly proposed for clinical decision support, yet their reliability in real-world scenarios that require integrating both visual and textual context from medical records remains poorly characterized.…

计算机视觉与模式识别 · 计算机科学 2026-05-19 David Restrepo , Ira Ktena , Maria Vakalopoulou , Stergios Christodoulidis , Enzo Ferrante

Vision-language models (VLMs) are increasingly used as automated judges for multimodal systems, yet their scores provide no indication of reliability. We study this problem through conformal prediction, a distribution-free framework that…

机器学习 · 计算机科学 2026-04-30 Divake Kumar , Sina Tayebati , Devashri Naik , Ranganath Krishnan , Amit Ranjan Trivedi

As reasoning LLMs increasingly trade tokens for accuracy through deliberation, search, and self-correction, a single accuracy score can no longer tell whether those tokens buy useful reasoning, recovery from hard instances, or unnecessary…

计算与语言 · 计算机科学 2026-05-19 Daniel Kaiser , Arnoldo Frigessi , Ali Ramezani-Kebrya , Benjamin Ricaud

Vision language models (VLM) demonstrate sophisticated multimodal reasoning yet are prone to hallucination when confronted with knowledge conflicts, impeding their deployment in information-sensitive contexts. While existing research…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Peter Carragher , Nikitha Rao , Abhinand Jha , R Raghav , Kathleen M. Carley

Recent breakthroughs in reasoning language models have significantly advanced text-based reasoning. On the other hand, Multi-modal Large Language Models (MLLMs) still lag behind, hindered by their outdated internal LLMs. Upgrading these…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Xin Jin , Zhenguo Li , James T. Kwok , Yu Zhang