中文
相关论文

相关论文: Don't Blink: Evidence Collapse during Multimodal R…

200 篇论文

Large language models (LLMs) have recently shown strong potential in vulnerability detection (VD). However, accurately detecting vulnerabilities in real-world repositories requires reasoning over complex contextual interactions. Existing…

密码学与安全 · 计算机科学 2026-05-28 Youpeng Li , Fuxun Yu , Weiliang Qi , Xinda Wang

Vision Language Models (VLMs) have become essential backbones for multimodal intelligence, yet significant safety challenges limit their real-world application. While textual inputs are often effectively safeguarded, adversarial visual…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Yi Ding , Bolian Li , Ruqi Zhang

When VLMs answer correctly, do they genuinely rely on visual information? We introduce a Tri-Layer Diagnostic Framework with three per-sample metrics: Latent Anomaly Detection, Visual Necessity Score, and Competition Score, which…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Rui Hong , Shuxue Quan

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

When instructed to underperform on multiple-choice evaluations, do language models engage with question content or fall back on positional shortcuts? We map the boundary between these regimes using a six-condition adversarial…

计算与语言 · 计算机科学 2026-05-01 Jon-Paul Cacioli

Vision-language models (VLMs) are increasingly deployed in high-stakes settings where reliable uncertainty quantification (UQ) is as important as predictive accuracy. Extended reasoning via chain-of-thought (CoT) prompting or…

机器学习 · 计算机科学 2026-03-18 Robert Welch , Emir Konuk , Kevin Smith

Vision-language models (VLMs) are widely assumed to exhibit in-context learning (ICL), a property similar to that of their language-only counterparts. While recent work suggests VLMs can perform multimodal ICL (MM-ICL), studies show they…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Chengyue Huang , Yuchen Zhu , Sichen Zhu , Jingyun Xiao , Moises Andrade , Shivang Chopra , Zsolt Kira

Vision-Language Models (VLMs) map complex visual inputs to semantic spaces, but interpreting the cross-modal reasoning of VLMs currently relies on post-hoc explainers evaluated via unimodal perturbation metrics. We expose a limitation in…

人工智能 · 计算机科学 2026-05-22 Joël Roman Ky , Salah Ghamizi , Maxime Cordy

Multimodal large language models (MLLMs) often struggle to ground reasoning in perceptual evidence. We present a systematic study of perception strategies-explicit, implicit, visual, and textual-across four multimodal benchmarks and two…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Yizhuo Ding , Mingkang Chen , Zhibang Feng , Tong Xiao , Wanying Qu , Wenqi Shao , Yanwei Fu

Large vision-language models (LVLMs) excel at multimodal tasks but are prone to misinterpreting visual inputs, often resulting in hallucinations and unreliable outputs. We present DROPOUT DECODING, a novel inference-time approach that…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Yixiong Fang , Ziran Yang , Zhaorun Chen , Zhuokai Zhao , Jiawei Zhou

Reasoning-augmented vision language models (VLMs) generate explicit chains of thought that promise greater capability and transparency but also introduce new failure modes: models may reach correct answers via visually unfaithful…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Rheeya Uppaal , Phu Mon Htut , Min Bai , Nikolaos Pappas , Zheng Qi , Sandesh Swamy

Vision-Language Models (VLMs) have shown strong multimodal reasoning capabilities on Visual-Question-Answering (VQA) benchmarks. However, their robustness against textual misinformation remains under-explored. While existing research has…

计算与语言 · 计算机科学 2026-01-28 Chi Zhang , Wenxuan Ding , Jiale Liu , Mingrui Wu , Qingyun Wu , Ray Mooney

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Suyang Xi , Songtao Hu , Yuxiang Lai , Wangyun Dan , Yaqi Liu , Shansong Wang , Xiaofeng Yang

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

Vision--language models (VLMs) have achieved impressive performance on complex multimodal reasoning tasks, yet they still fail on simple grounding skills such as object counting. Existing evaluations mostly assess only final outputs,…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Duy Le Dinh Anh , Patrick Amadeus Irawan , Tuan Van Vo

Vision Language Models (VLMs) are designed to extend Large Language Models (LLMs) with visual capabilities, yet in this work we observe a surprising phenomenon: VLMs can outperform their underlying LLMs on purely text-only tasks,…

机器学习 · 计算机科学 2026-02-18 Nicolas Buzeta , Felipe del Rio , Cristian Hinostroza , Denis Parra , Hans Lobel , Rodrigo Toro Icarte

Vision-language models (VLMs) have shown impressive zero- and few-shot performance on real-world visual question answering (VQA) benchmarks, alluding to their capabilities as visual reasoning engines. However, the benchmarks being used…

计算与语言 · 计算机科学 2024-09-04 Aishik Nagar , Shantanu Jaiswal , Cheston Tan

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

人工智能 · 计算机科学 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

Current multimodal large language models (MLLMs) face a critical challenge in modality alignment, often exhibiting a bias towards textual information at the expense of other modalities like vision. This paper conducts a systematic…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Mingxiao Li , Na Su , Fang Qu , Zhizhou Zhong , Ziyang Chen , Yuan Li , Zhaopeng Tu , Xiaolong Li

Recent advancements in visual context compression enable MLLMs to process ultra-long contexts efficiently by rendering text into images. However, we identify a critical vulnerability inherent to this paradigm: lowering image resolution…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Zhixue Song , Boyan Han , Yiwei Wang , Chi Zhang