English
Related papers

Related papers: Thinking in Structures: Evaluating Spatial Intelli…

200 papers

Occlusion perception, a critical foundation for human-level spatial understanding, embodies the challenge of integrating visual recognition and reasoning. Though multimodal large language models (MLLMs) have demonstrated remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zhaochen Liu , Kaiwen Gao , Shuyi Liang , Bin Xiao , Limeng Qiao , Lin Ma , Tingting Jiang

Recent advances in point cloud perception have demonstrated remarkable progress in scene understanding through vision-language alignment leveraging large language models (LLMs). However, existing methods may still encounter challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhenhua Ning , Zhuotao Tian , Shaoshuai Shi , Guangming Lu , Daojing He , Wenjie Pei , Li Jiang

Spatial relation reasoning is a crucial task for multimodal large language models (MLLMs) to understand the objective world. However, current benchmarks have issues like relying on bounding boxes, ignoring perspective substitutions, or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jingping Liu , Ziyan Liu , Zhedong Cen , Yan Zhou , Yinan Zou , Weiyan Zhang , Haiyun Jiang , Tong Ruan

Vision-language models (VLMs) have advanced rapidly, yet they still struggle with basic spatial reasoning. Despite strong performance on general benchmarks, modern VLMs remain brittle at understanding 2D spatial relationships such as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Nahid Alam , Leema Krishna Murali , Siddhant Bharadwaj , Patrick Liu , Timothy Chung , Drishti Sharma , Akshata A. , Kranthi Kiran , Wesley Tam , Bala Krishna S Vegesna

As spatial intelligence becomes an increasingly important capability for foundation models, it remains unclear whether large language models' (LLMs) performance on spatial reasoning benchmarks reflects structured internal spatial…

Computation and Language · Computer Science 2026-03-30 Jiyuan An , Liner Yang , Mengyan Wang , Luming Lu , Weihua An , Erhong Yang

Visual Language Models (VLMs) have increasingly become the main paradigm for understanding indoor scenes, but they still struggle with metric and spatial reasoning. Current approaches rely on end-to-end video understanding or large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Fernando Ropero , Erkin Turkoz , Daniel Matos , Junqing Du , Antonio Ruiz , Yanfeng Zhang , Lu Liu , Mingwei Sun , Yongliang Wang

While Vision-Language Models (VLMs) exhibit exceptional 2D visual understanding, their ability to comprehend and reason about 3D space--a cornerstone of spatial intelligence--remains superficial. Current methodologies attempt to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Haoyi Jiang , Liu Liu , Xinjie Wang , Yonghao He , Wei Sui , Zhizhong Su , Wenyu Liu , Xinggang Wang

Learning commonsense reasoning from visual contexts and scenes in real-world is a crucial step toward advanced artificial intelligence. However, existing video reasoning benchmarks are still inadequate since they were mainly designed for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Andong Wang , Bo Wu , Sunli Chen , Zhenfang Chen , Haotian Guan , Wei-Ning Lee , Li Erran Li , Chuang Gan

Although Multimodal Large Language Models have achieved remarkable progress, they still struggle with complex 3D spatial reasoning due to the reliance on 2D visual priors. Existing approaches typically mitigate this limitation either…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jiahua Chen , Qihong Tang , Weinong Wang , Qi Fan

Large vision-language models (VLMs) still struggle with reliable 3D spatial reasoning, a core capability for embodied and physical AI systems. This limitation arises from their inability to capture fine-grained 3D geometry and spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jian Zhang , Shijie Zhou , Bangya Liu , Achuta Kadambi , Zhiwen Fan

Despite remarkable progress, multimodal foundation models still exhibit surprising deficiencies in spatial intelligence. In this work, we explore scaling up multimodal foundation models to cultivate spatial intelligence within the…

Spatial reasoning is a key capability in the field of artificial intelligence, especially crucial in areas such as robotics, computer vision, and natural language understanding. However, evaluating the ability of multimodal large language…

Artificial Intelligence · Computer Science 2025-11-25 Rui Xu , Dakuan Lu , Zicheng Zhao , Xiaoyu Tan , Xintao Wang , Siyu Yuan , Jiangjie Chen , Yinghui Xu

The 180x360 omnidirectional field of view captured by 360-degree cameras enables their use in a wide range of applications such as embodied AI and virtual reality. Although recent advances in multimodal large language models (MLLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zihao Dongfang , Xu Zheng , Ziqiao Weng , Yuanhuiyi Lyu , Danda Pani Paudel , Luc Van Gool , Kailun Yang , Xuming Hu

Vision-Language Models (VLMs) are known to struggle with spatial reasoning and visual alignment. To help overcome these limitations, we introduce iVISPAR, an interactive multimodal benchmark designed to evaluate the spatial reasoning…

Computation and Language · Computer Science 2025-10-01 Julius Mayer , Mohamad Ballout , Serwan Jassim , Farbod Nosrat Nezami , Elia Bruni

Spatial understanding is essential for Multimodal Large Language Models (MLLMs) to support perception, reasoning, and planning in embodied environments. Despite recent progress, existing studies reveal that MLLMs still struggle with spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Wanyue Zhang , Yibin Huang , Yangbin Xu , JingJing Huang , Helu Zhi , Shuo Ren , Wang Xu , Jiajun Zhang

Current evaluations of spatial intelligence can be systematically invalid under modern vision-language model (VLM) settings. First, many benchmarks derive question-answer (QA) pairs from point-cloud-based 3D annotations originally curated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yiming Zhang , Jiacheng Chen , Jiaqi Tan , Yongsen Mao , Wenhu Chen , Angel X. Chang

Spatiotemporal reasoning plays a key role in Cyber-Physical Systems (CPS). Despite advances in Large Language Models (LLMs) and Large Reasoning Models (LRMs), their capacity to reason about complex spatiotemporal signals remains…

Artificial Intelligence · Computer Science 2026-01-13 Pengrui Quan , Brian Wang , Kang Yang , Liying Han , Mani Srivastava

Spatial reasoning is an important component of human intelligence. We can imagine the shapes of 3D objects and reason about their spatial relations by merely looking at their three-view line drawings in 2D, with different levels of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Wenyu Han , Siyuan Xiang , Chenhui Liu , Ruoyu Wang , Chen Feng

Recent advances in multimodal large language models (MLLMs) have shown remarkable capabilities in integrating vision and language for complex reasoning. While most existing benchmarks evaluate models under offline settings with a fixed set…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jingli Lin , Chenming Zhu , Runsen Xu , Xiaohan Mao , Xihui Liu , Tai Wang , Jiangmiao Pang

The physical world is not merely visual; it is governed by rigorous structural and procedural constraints. Yet, the evaluation of vision-language models (VLMs) remains heavily skewed toward perceptual realism, prioritizing the generation of…

Artificial Intelligence · Computer Science 2026-03-27 Luyu Yang , Yutong Dai , An Yan , Viraj Prabhu , Ran Xu , Zeyuan Chen