English
Related papers

Related papers: SpatialThinker: Reinforcing 3D Reasoning in Multim…

200 papers

Visual Language Models (VLMs) are essential for various tasks, particularly visual reasoning tasks, due to their robust multi-modal information integration, visual reasoning capabilities, and contextual awareness. However, existing \VLMs{}'…

Computation and Language · Computer Science 2024-09-13 Zaiqiao Meng , Hao Zhou , Yifang Chen

Reinforcement learning (RL) has recently achieved remarkable success in eliciting visual reasoning within Multimodal Large Language Models (MLLMs). However, existing approaches typically train separate models for different tasks and treat…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Kaituo Feng , Manyuan Zhang , Hongyu Li , Kaixuan Fan , Shuang Chen , Yilei Jiang , Dian Zheng , Peiwen Sun , Yiyuan Zhang , Haoze Sun , Yan Feng , Peng Pei , Xunliang Cai , Xiangyu Yue

Time-series reasoning remains a significant challenge in multimodal large language models (MLLMs) due to the dynamic temporal patterns, ambiguous semantics, and lack of temporal priors. In this work, we introduce TimeMaster, a reinforcement…

Machine Learning · Computer Science 2025-06-17 Junru Zhang , Lang Feng , Xu Guo , Yuhan Wu , Yabo Dong , Duanqing Xu

Spatial reasoning -- the ability to perceive and reason about relationships in space -- advances vision-language models (VLMs) from visual perception toward spatial semantic understanding. Existing approaches either revisit local image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Weijian Ma , Shizhao Sun , Tianyu Yu , Ruiyu Wang , Tat-Seng Chua , Jiang Bian

Spatial reasoning is foundational for Vision-Language Models (VLMs), particularly when deployed as Vision-Language-Action (VLA) agents in physical environments. However, existing benchmarks predominantly focus on elementary, single-hop…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Youngwan Lee , Soojin Jang , Yoorhim Cho , Seunghwan Lee , Yong-Ju Lee , Sung Ju Hwang

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced cross-modal understanding and reasoning by incorporating Chain-of-Thought (CoT) reasoning in the semantic space. Building upon this, recent studies…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Chengzhi Liu , Yuzhe Yang , Yue Fan , Qingyue Wei , Sheng Liu , Xin Eric Wang

This paper explores the spatial reasoning capability of large language models (LLMs) over textual input through a suite of five tasks aimed at probing their spatial understanding and computational abilities. The models were tested on both…

Computation and Language · Computer Science 2025-10-24 Maggie Bai , Ava Kim Cohen , Eleanor Koss , Charlie Lichtenbaum

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

Multimodal Large Language Models (MLLMs) have achieved remarkable success in open-vocabulary perceptual tasks, yet their ability to solve complex cognitive problems remains limited, especially when visual details are abstract and require…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Boyi Li , Yifan Shen , Yuanzhe Liu , Yifan Xu , Jiateng Liu , Xinzhuo Li , Zhengyuan Li , Jingyuan Zhu , Yunhan Zhong , Fangzhou Lan , Jianguo Cao , James M. Rehg , Heng Ji , Ismini Lourentzou , Xu Cao

Reinforcement Learning with Verifiable Rewards (RLVR) has been shown effective in enhancing the visual reflection and reasoning capabilities of Large Multimodal Models (LMMs). However, existing datasets are predominantly derived from either…

Machine Learning · Computer Science 2026-02-20 Haoxiang Sun , Lizhen Xu , Bing Zhao , Wotao Yin , Wei Wang , Boyu Yang , Rui Wang , Hu Wei

Recent advances in natural-domain multi-modal large language models (MLLMs) have demonstrated effective spatial reasoning through visual and textual prompting. However, their direct transfer to remote sensing (RS) is hindered by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Wei Zhang , Miaoxin Cai , Yaqian Ning , Tong Zhang , Yin Zhuang , Shijian Lu , He Chen , Jun Li , Xuerui Mao

Reward models are critical for aligning vision-language systems with human preferences, yet current approaches suffer from hallucination, weak visual grounding, and an inability to use tools for verification, limiting their reliability on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Shengyuan Ding , Xinyu Fang , Ziyu Liu , Yuhang Zang , Yuhang Cao , Xiangyu Zhao , Haodong Duan , Xiaoyi Dong , Jianze Liang , Bin Wang , Conghui He , Dahua Lin , Jiaqi Wang

Reinforcement learning (RL) has shown impressive results in sequential decision-making tasks. Meanwhile, Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged, exhibiting impressive capabilities in multimodal…

Chain-of-thought reasoning has significantly improved the performance of Large Language Models (LLMs) across various domains. However, this reasoning process has been confined exclusively to textual space, limiting its effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Haozhe Wang , Alex Su , Weiming Ren , Fangzhen Lin , Wenhu Chen

Humans excel at performing complex tasks by leveraging long-term memory across temporal and spatial experiences. In contrast, current Large Language Models (LLMs) struggle to effectively plan and act in dynamic, multi-room 3D environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Wenbo Hu , Yining Hong , Yanjun Wang , Leison Gao , Zibu Wei , Xingcheng Yao , Nanyun Peng , Yonatan Bitton , Idan Szpektor , Kai-Wei Chang

Existing evaluations of multimodal large language models (MLLMs) on spatial intelligence are typically fragmented and limited in scope. In this work, we aim to conduct a holistic assessment of the spatial understanding capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haoning Wu , Xiao Huang , Yaohui Chen , Ya Zhang , Yanfeng Wang , Weidi Xie

Online Reinforcement Learning (RL) offers a promising avenue for complex image editing but is currently constrained by the scarcity of reliable and fine-grained reward signals. Existing evaluators frequently struggle with a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yancheng Long , Yankai Yang , Hongyang Wei , Wei Chen , Tianke Zhang , Haonan fan , Changyi Liu , Kaiyu Jiang , Jiankang Chen , Kaiyu Tang , Bin Wen , Fan Yang , Tingting Gao , Han Li , Shuo Yang

Vision-language models (VLM) excel at general understanding yet remain weak at dynamic spatial reasoning (DSR), i.e., reasoning about the evolvement of object geometry and relationship in 3D space over time, largely due to the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Shengchao Zhou , Yuxin Chen , Yuying Ge , Wei Huang , Jiehong Lin , Ying Shan , Xiaojuan Qi

Recent advancements in Large Language Models (LLMs) have leveraged increased test-time computation to enhance reasoning capabilities, a strategy that, while effective, incurs significant latency and resource costs, limiting their…

Machine Learning · Computer Science 2025-09-01 Hao Wen , Xinrui Wu , Yi Sun , Feifei Zhang , Liye Chen , Jie Wang , Yunxin Liu , Yunhao Liu , Ya-Qin Zhang , Yuanchun Li

Code reasoning refers to the task of predicting the output of a program given its source code and specific inputs. It can measure the reasoning capability of large language models (LLMs) and also benefit downstream tasks such as code…

Machine Learning · Computer Science 2026-05-19 Zhanyue Qin , Jia Feng , Yibo Lyu , Yun Peng , Dianbo Sui , Cuiyun Gao , Qing Liao