中文
相关论文

相关论文: Probing the effectiveness of World Models for Spat…

200 篇论文

While many vision-language models (VLMs) are developed to answer well-defined, straightforward questions with highly specified targets, as in most benchmarks, they often struggle in practice with complex open-ended tasks, which usually…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Chenrui Fan , Yijun Liang , Shweta Bhardwaj , Kwesi Cobbina , Ming Li , Tianyi Zhou

This work investigates a fundamental question: Do Video-Language Models (VidLMs) robustly account for video content, temporal sequence, and motion? Our investigation shows that, surprisingly, they often do not. We introduce REVEAL{}, a…

A recent trend in vision-language models (VLMs) has been to enhance their spatial cognition for embodied domains. Despite progress, existing evaluations have been limited both in paradigm and in coverage, hindering rapid, iterative model…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Yanpeng Zhao , Wentao Ding , Hongtao Li , Baoxiong Jia , Zilong Zheng

Integration of Large Language Models (LLMs) into visual domain tasks, resulting in visual-LLMs (V-LLMs), has enabled exceptional performance in vision-language tasks, particularly for visual question answering (VQA). However, existing…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Kanchana Ranasinghe , Satya Narayan Shukla , Omid Poursaeed , Michael S. Ryoo , Tsung-Yu Lin

According to the Test-Time Scaling, the integration of External Slow-Thinking with the Verify mechanism has been demonstrated to enhance multi-round reasoning in large language models (LLMs). However, in the multimodal (MM) domain, there is…

计算与语言 · 计算机科学 2025-02-20 Linzhuang Sun , Hao Liang , Jingxuan Wei , Bihui Yu , Tianpeng Li , Fan Yang , Zenan Zhou , Wentao Zhang

Understanding and resolving temporal references is essential in Natural Language Understanding as we often refer to the past or future in daily communication. Although existing benchmarks address a system's ability to reason about and…

计算与语言 · 计算机科学 2025-05-05 Svenja Kenneweg , Jörg Deigmöller , Philipp Cimiano , Julian Eggert

Vision-language models (VLMs) have achieved remarkable success across diverse tasks. However, concerns about their trustworthiness persist, particularly regarding tendencies to lean more on textual cues than visual evidence and the risk of…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Shizhan Gong , Minda Hu , Qiyuan Zhang , Chen Ma , Qi Dou

Multimodal large language models (MLLMs) often suffer from perceptual impairments under extended reasoning modes, particularly in visual question answering (VQA) tasks. We identify attention dispersion as the underlying cause: during…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Ruiying Peng , Xueyu Wu , Jing Lei , Lu Hou , Yuanzheng Ma , Xiaohui Li

Vision-Language Models (VLMs) have achieved impressive performance across a wide range of multimodal tasks, yet they often exhibit inconsistent behavior when faced with semantically equivalent inputs, undermining their reliability and…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Shih-Han Chou , Shivam Chandhok , James J. Little , Leonid Sigal

Understanding and reasoning about spatial relationships is a fundamental capability for Visual Question Answering (VQA) and robotics. While Vision Language Models (VLM) have demonstrated remarkable performance in certain VQA benchmarks,…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Boyuan Chen , Zhuo Xu , Sean Kirmani , Brian Ichter , Danny Driess , Pete Florence , Dorsa Sadigh , Leonidas Guibas , Fei Xia

Despite strong performance of Multimodal Large Language Models (MLLMs) on multimodal tasks, predicting whether and why an image is persuasive remains challenging. We first show that prompting MLLMs to reason before prediction does not…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Naeun Lee , Hyunjong Kim , Sunghwan Choi , Injin Kong , Yohan Jo

Test-time scaling increases inference-time computation by allowing models to generate long reasoning chains, and has improved performance across many domains. However, in this work, we show that this approach is not yet effective for…

人工智能 · 计算机科学 2026-02-03 James Xu Zhao , Bryan Hooi , See-Kiong Ng

Large Language Models (LLMs) have demonstrated remarkable progress in complex reasoning tasks through both post-training and test-time scaling laws. While prevalent test-time scaling approaches are often realized by using external reward…

机器学习 · 计算机科学 2025-10-31 Fuxiang Zhang , Jiacheng Xu , Chaojie Wang , Ce Cui , Yang Liu , Bo An

Vision-Language Models (VLMs) often produce self-reflective statements like "let me check the figure again" during reasoning. Do such statements trigger genuine visual re-examination, or are they merely learned textual patterns? We…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Chufan Shi , Cheng Yang , Yaokang Wu , Linghao Jin , Bo Shui , Taylor Berg-Kirkpatrick , Xuezhe Ma

Vision-language models (VLMs) lag behind text-only language models on mathematical reasoning when the same problems are presented as images rather than text. We empirically characterize this as a modality gap: the same question in text form…

人工智能 · 计算机科学 2026-03-18 Saeed Khaki , Ashudeep Singh , Nima Safaei , Kamal Ginotra

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Large Language Models (LLMs) by optimizing them against factual outcomes. However, this paradigm falters in long-context…

计算与语言 · 计算机科学 2026-03-03 Guanzheng Chen , Michael Qizhe Shieh , Lidong Bing

With the rapid development of large language models (LLMs), LLM-as-a-judge has emerged as a widely adopted approach for text quality evaluation, including hallucination evaluation. While previous studies have focused exclusively on…

计算与语言 · 计算机科学 2025-03-04 Siya Qi , Rui Cao , Yulan He , Zheng Yuan

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Angen Ye , Zeyu Zhang , Boyuan Wang , Xiaofeng Wang , Dapeng Zhang , Zheng Zhu

Vision-Language Models (VLMs) continue to struggle to make morally salient judgments in multimodal and socially ambiguous contexts. Prior works typically rely on binary or pairwise supervision, which often fail to capture the continuous and…

Test-time scaling has recently emerged as a promising approach for enhancing the reasoning capabilities of large language models or vision-language models during inference. Although a variety of test-time scaling strategies have been…

计算与语言 · 计算机科学 2025-06-17 Gyutaek Oh , Seoyeon Kim , Sangjoon Park , Byung-Hoon Kim