中文
相关论文

相关论文: When and How Much to Imagine: Adaptive Test-Time S…

200 篇论文

We propose MIRA, a new benchmark designed to evaluate models in scenarios where generating intermediate visual images is essential for successful reasoning. Unlike traditional CoT methods that rely solely on text, tasks in MIRA require…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Yiyang Zhou , Haoqin Tu , Zijun Wang , Zeyu Wang , Niklas Muennighoff , Fan Nie , Yejin Choi , James Zou , Chaorui Deng , Shen Yan , Haoqi Fan , Cihang Xie , Huaxiu Yao , Qinghao Ye

Recent advancements in Large Vision-Language Models (LVLMs) have significantly enhanced their ability to integrate visual and linguistic information, achieving near-human proficiency in tasks like object recognition, captioning, and visual…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Zhikai Wang , Jiashuo Sun , Wenqi Zhang , Zhiqiang Hu , Xin Li , Fan Wang , Deli Zhao

Recent advances in large vision-language models have led to impressive performance in visual question answering and multimodal reasoning. However, it remains unclear whether these models genuinely perform grounded visual reasoning or rely…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Chengfei Wu , Ronald Seoh , Bingxuan Li , Liqiang Zhang , Fengrong Han , Dan Goldwasser

How does irrelevant information (i.e., distractors) affect test-time scaling in vision-language models (VLMs)? Prior studies on language models have reported an inverse scaling effect, where textual distractors lead to longer but less…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Jiyun Bae , Hyunjong Ok , Sangwoo Mo , Jaeho Lee

Recent work proposes using world models to generate controlled virtual environments in which AI agents can be tested before deployment to ensure their reliability and safety. However, accurate world models often have high computational…

人工智能 · 计算机科学 2025-04-08 Fernando Rosas , Alexander Boyd , Manuel Baltieri

Spatial intelligence is essential for multimodal large language models (MLLMs) operating in the complex physical world. Existing benchmarks, however, probe only single-image relations and thus fail to assess the multi-image spatial…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Sihan Yang , Runsen Xu , Yiman Xie , Sizhe Yang , Mo Li , Jingli Lin , Chenming Zhu , Xiaochen Chen , Haodong Duan , Xiangyu Yue , Dahua Lin , Tai Wang , Jiangmiao Pang

Large Language Models (LLMs) often falter in complex reasoning tasks due to their static, parametric knowledge, leading to hallucinations and poor performance in specialized domains like mathematics. This work explores a fundamental…

机器学习 · 计算机科学 2026-02-10 Srijan Shakya , Anamaria-Roberta Hartl , Sepp Hochreiter , Korbinian Pöppel

Reasoning is a fundamental cognitive process underlying inference, problem-solving, and decision-making. While large language models (LLMs) demonstrate strong reasoning capabilities in closed-world settings, they struggle in open-ended and…

The physical world is not merely visual; it is governed by rigorous structural and procedural constraints. Yet, the evaluation of vision-language models (VLMs) remains heavily skewed toward perceptual realism, prioritizing the generation of…

人工智能 · 计算机科学 2026-03-27 Luyu Yang , Yutong Dai , An Yan , Viraj Prabhu , Ran Xu , Zeyuan Chen

Vision-Language Models (VLMs) have demonstrated strong capability in a wide range of tasks such as visual recognition, document parsing, and visual grounding. Nevertheless, recent work shows that while VLMs often manage to capture the…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Chengxin Liu , Wonseok Choi , Chenshuang Zhang , Tae-Hyun Oh

A recent trend in vision-language models (VLMs) has been to enhance their spatial cognition for embodied domains. Despite progress, existing evaluations have been limited both in paradigm and in coverage, hindering rapid, iterative model…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Yanpeng Zhao , Wentao Ding , Hongtao Li , Baoxiong Jia , Zilong Zheng

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

Image classification has traditionally relied on parameter-intensive model training, requiring large-scale annotated datasets and extensive fine tuning to achieve competitive performance. While recent vision language models (VLMs) alleviate…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Wonduk Seo , Minhyeong Yu , Hyunjin An , Seunghyun Lee

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

Combining model-based and model-free deep reinforcement learning has shown great promise for improving sample efficiency on complex control tasks while still retaining high performance. Incorporating imagination is a recent effort in this…

机器学习 · 计算机科学 2019-10-11 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

Planning with world models offers a powerful paradigm for robotic control. Conventional approaches train a model to predict future frames conditioned on current frames and actions, which can then be used for planning. However, the objective…

机器学习 · 计算机科学 2025-10-23 Jacob Berg , Chuning Zhu , Yanda Bao , Ishan Durugkar , Abhishek Gupta

Inducing reasoning in multimodal large language models (MLLMs) is critical for achieving human-level perception and understanding. Existing methods mainly leverage LLM reasoning to analyze parsed visuals, often limited by static perception…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Ziang Yan , Xinhao Li , Yinan He , Zhengrong Yue , Xiangyu Zeng , Yali Wang , Yu Qiao , Limin Wang , Yi Wang

Advances in large reasoning models have shown strong performance on complex reasoning tasks by scaling test-time compute through extended reasoning. However, recent studies observe that in vision-dependent tasks, extended textual reasoning…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Soumya Suvra Ghosal , Youngeun Kim , Zhuowei Li , Ritwick Chaudhry , Linghan Xu , Hongjing Zhang , Jakub Zablocki , Yifan Xing , Qin Zhang

Chain-of-thought reasoning has significantly improved the performance of Large Language Models (LLMs) across various domains. However, this reasoning process has been confined exclusively to textual space, limiting its effectiveness in…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Haozhe Wang , Alex Su , Weiming Ren , Fangzhen Lin , Wenhu Chen