English
Related papers

Related papers: RoboTracer: Mastering Spatial Trace with Reasoning…

200 papers

Many language-guided robotic systems rely on collapsing spatial reasoning into discrete points, making them brittle to perceptual noise and semantic ambiguity. To address this challenge, we propose RoboMAP, a framework that represents…

Robotics · Computer Science 2025-10-16 Xinyu Shao , Yanzhe Tang , Pengwei Xie , Kaiwen Zhou , Yuzheng Zhuang , Xingyue Quan , Jianye Hao , Long Zeng , Xiu Li

Despite recent advances demonstrating vision-language models' (VLMs) abilities to describe complex relationships in images using natural language, their capability to quantitatively reason about object sizes and distances remains…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yuan-Hong Liao , Rafid Mahmood , Sanja Fidler , David Acuna

Achieving human-like spatial intelligence for vision-language models (VLMs) requires inferring 3D structures from 2D observations, recognizing object properties and relations in 3D space, and performing high-level spatial reasoning. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Huizhi Liang , Yichao Shen , Yu Deng , Sicheng Xu , Zhiyuan Feng , Tong Zhang , Yaobo Liang , Jiaolong Yang

Spatial reasoning is a fundamental capability for embodied intelligence, especially for fine-grained manipulation tasks such as robotic assembly. While recent vision-language models (VLMs) exhibit preliminary spatial awareness, they largely…

Robotics · Computer Science 2026-04-13 Zhi Jing , Jinbin Qiao , Ouyang Lu , Jicong Ao , Shuang Qiu , Yu-Gang Jiang , Chenjia Bai

Spatiotemporal reasoning plays a key role in Cyber-Physical Systems (CPS). Despite advances in Large Language Models (LLMs) and Large Reasoning Models (LRMs), their capacity to reason about complex spatiotemporal signals remains…

Artificial Intelligence · Computer Science 2026-01-13 Pengrui Quan , Brian Wang , Kang Yang , Liying Han , Mani Srivastava

Benchmarking spatial reasoning in multimodal large language models (MLLMs) has attracted growing interest in computer vision due to its importance for embodied AI and other agentic systems that require precise interaction with the physical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zelin Xu , Yupu Zhang , Saugat Adhikari , Saiful Islam , Tingsong Xiao , Zibo Liu , Shigang Chen , Da Yan , Zhe Jiang

Recent advances in imitation learning have shown significant promise for robotic control and embodied intelligence. However, achieving robust generalization across diverse mounted camera observations remains a critical challenge. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Travis Davies , Jiahuan Yan , Xiang Chen , Yu Tian , Yueting Zhuang , Yiqi Huang , Luhui Hu

LiDAR relocalization has attracted increasing attention as it can deliver accurate 6-DoF pose estimation in complex 3D environments. Recent learning-based regression methods offer efficient solutions by directly predicting global poses…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jianshi Wu , Minghang Zhu , Dunqiang Liu , Wen Li , Sheng Ao , Siqi Shen , Chenglu Wen , Cheng Wang

Vision-Language Models (VLMs) struggle to translate high-level instructions into the precise spatial affordances required for robotic manipulation. While visual Chain-of-Thought (CoT) methods exist, they are often computationally intensive.…

Robotics · Computer Science 2025-11-05 Sangyun Park , Jin Kim , Yuchen Cui , Matthew S. Brown

Visual transformation reasoning (VTR) is a vital cognitive capability that empowers intelligent agents to understand dynamic scenes, model causal relationships, and predict future states, and thereby guiding actions and laying the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yuheng Ji , Yipu Wang , Yuyang Liu , Xiaoshuai Hao , Yue Liu , Yuting Zhao , Huaihai Lyu , Xiaolong Zheng

Recent benchmarks and datasets have been proposed to improve spatial reasoning in vision-language models (VLMs), yet existing open resources remain limited in scale, visual diversity, and instruction expressiveness. In this work, we…

Spatial reasoning is a fundamental aspect of human cognition, yet it remains a major challenge for contemporary vision-language models (VLMs). Prior work largely relied on synthetic or LLM-generated environments with limited task designs…

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sashuai Zhou , Qiang Zhou , Junpeng Ma , Yue Cao , Ruofan Hu , Ziang Zhang , Xiaoda Yang , Zhibin Wang , Jun Song , Cheng Yu , Bo Zheng , Zhou Zhao

Multimodal Large Language Models (MLLMs) have made impressive progress in connecting vision and language, but they still struggle with spatial understanding and viewpoint-aware reasoning. Recent efforts aim to augment the input…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Kevin Qu , Haozhe Qi , Mihai Dusmanu , Mahdi Rad , Rui Wang , Marc Pollefeys

Vision-Language-Action (VLA) models have recently advanced robotic manipulation by translating natural-language instructions and visual observations into control actions. However, existing VLAs are primarily trained on successful expert…

Robotics · Computer Science 2026-03-24 Zewei Ye , Weifeng Lu , Minghao Ye , Tao Lin , Shuo Yang , Junchi Yan , Bo Zhao

End-to-end autonomous driving methods built on vision language models (VLMs) have undergone rapid development driven by their universal visual understanding and strong reasoning capabilities obtained from the large-scale pretraining.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Peizheng Li , Zhenghao Zhang , David Holtz , Hang Yu , Yutong Yang , Yuzhi Lai , Rui Song , Andreas Geiger , Andreas Zell

Spatial cognition is fundamental to real-world multimodal intelligence, allowing models to effectively interact with the physical environment. While multimodal large language models (MLLMs) have made significant strides, existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-08 Peiran Xu , Sudong Wang , Yao Zhu , Jianing Li , Gege Qi , Yunjian Zhang

Complex high-dimensional spaces with high Degree-of-Freedom and complicated action spaces, such as humanoid robots equipped with dexterous hands, pose significant challenges for reinforcement learning (RL) algorithms, which need to wisely…

Robotics · Computer Science 2025-02-25 Zifeng Zhuang , Diyuan Shi , Runze Suo , Xiao He , Hongyin Zhang , Ting Wang , Shangke Lyu , Donglin Wang

Dynamic spatial reasoning from monocular video is essential for bridging visual intelligence and the physical world, yet remains challenging for vision-language models (VLMs). Prior approaches either verbalize spatial-temporal reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zhangquan Chen , Manyuan Zhang , Xinlei Yu , Xiang An , Bo Li , Xin Xie , ZiDong Wang , Mingze Sun , Shuang Chen , Hongyu Li , Xiaobin Hu , Ruqi Huang

Reasoning about motion and space is a fundamental cognitive capability that is required by multiple real-world applications. While many studies highlight that large multimodal language models (MLMs) struggle to reason about space, they only…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Arijit Ray , Jiafei Duan , Ellis Brown , Reuben Tan , Dina Bashkirova , Rose Hendrix , Kiana Ehsani , Aniruddha Kembhavi , Bryan A. Plummer , Ranjay Krishna , Kuo-Hao Zeng , Kate Saenko