English
Related papers

Related papers: SpatialEvo: Self-Evolving Spatial Intelligence via…

200 papers

Understanding and reasoning about spatial relationships is a fundamental capability for Visual Question Answering (VQA) and robotics. While Vision Language Models (VLM) have demonstrated remarkable performance in certain VQA benchmarks,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Boyuan Chen , Zhuo Xu , Sean Kirmani , Brian Ichter , Danny Driess , Pete Florence , Dorsa Sadigh , Leonidas Guibas , Fei Xia

Spatial intelligence is a critical frontier for Multimodal Large Language Models (MLLMs), empowering them to comprehend the physical world. Drawing inspiration from human perception mechanisms, prior studies attempt to construct a spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yibin Huang , Wang Xu , Wanyue Zhang , Helu Zhi , Jingjing Huang , Yangbin Xu , Yangang Sun , Conghui Zhu , Tiejun Zhao

Spatial reasoning is a fundamental capability for embodied intelligence, especially for fine-grained manipulation tasks such as robotic assembly. While recent vision-language models (VLMs) exhibit preliminary spatial awareness, they largely…

Robotics · Computer Science 2026-04-13 Zhi Jing , Jinbin Qiao , Ouyang Lu , Jicong Ao , Shuang Qiu , Yu-Gang Jiang , Chenjia Bai

Spatial reasoning in large-scale 3D environments remains challenging for current vision-language models, which are typically constrained to room-scale scenarios. We introduce H$^2$U3D (Holistic House Understanding in 3D), a 3D visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hongpei Zheng , Shijie Li , Yanran Li , Hujun Yin

Benchmarking spatial reasoning in multimodal large language models (MLLMs) has attracted growing interest in computer vision due to its importance for embodied AI and other agentic systems that require precise interaction with the physical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zelin Xu , Yupu Zhang , Saugat Adhikari , Saiful Islam , Tingsong Xiao , Zibo Liu , Shigang Chen , Da Yan , Zhe Jiang

Humans perceive and reason about their surroundings in four dimensions by building persistent, structured internal representations that encode semantic meaning, spatial layout, and temporal dynamics. These multimodal memories enable them to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Tin Stribor Sohn , Maximilian Dillitzer , Jason J. Corso , Eric Sax

Embodied scene understanding requires not only comprehending visual-spatial information that has been observed but also determining where to explore next in the 3D physical world. Existing 3D Vision-Language (3D-VL) models primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Ziyu Zhu , Xilin Wang , Yixuan Li , Zhuofan Zhang , Xiaojian Ma , Yixin Chen , Baoxiong Jia , Wei Liang , Qian Yu , Zhidong Deng , Siyuan Huang , Qing Li

The modelling, analysis, and visualisation of dynamic geospatial phenomena has been identified as a key developmental challenge for next-generation Geographic Information Systems (GIS). In this context, the envisaged paradigmatic extensions…

Artificial Intelligence · Computer Science 2013-12-17 Mehul Bhatt , Jan Oliver Wallgruen

Learning dense correspondences across deformable 3D shapes remains a long-standing challenge due to structural variability, non-isometric deformation, and inconsistent topology. Existing methods typically trade off generalization, geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Soyeon Yoon , Chang Wook Seo , Hyunjung Shim

While Multimodal Large Language Models (MLLMs) have achieved remarkable success in 2D visual understanding, their ability to reason about 3D space remains limited. To address this gap, we introduce geometrically referenced 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jiangye Yuan , Gowri Kumar , Baoyuan Wang

While multimodal large language models (MLLMs) have made groundbreaking progress in embodied intelligence, they still face significant challenges in spatial reasoning for complex long-horizon tasks. To address this gap, we propose…

Spatial intelligence unfolds through a perception-action loop: agents act to acquire observations, and reason about how observations vary as a function of action. Rather than passively processing what is seen, they actively uncover what is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yining Hong , Jiageng Liu , Han Yin , Manling Li , Leonidas Guibas , Li Fei-Fei , Jiajun Wu , Yejin Choi

Recent unified image generation models have achieved remarkable success by employing MLLMs for semantic understanding and diffusion backbones for image generation. However, these models remain fundamentally limited in spatially-aware tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Haiyi Qiu , Kaihang Pan , Jiacheng Li , Juncheng Li , Siliang Tang , Yueting Zhuang

Although great progress has been made in 3D visual grounding, current models still rely on explicit textual descriptions for grounding and lack the ability to reason human intentions from implicit instructions. We propose a new task called…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Chenming Zhu , Tai Wang , Wenwei Zhang , Kai Chen , Xihui Liu

Recognizing precise geometrical configurations of groups of objects is a key capability of human spatial cognition, yet little studied in the deep learning literature so far. In particular, a fundamental problem is how a machine can learn…

Machine Learning · Computer Science 2020-07-20 Laetitia Teodorescu , Katja Hofmann , Pierre-Yves Oudeyer

Recent progress in multimodal reasoning has enabled agents that interpret imagery, connect it with language, and execute structured analytical tasks. Extending these capabilities to remote sensing remains challenging, as models must reason…

The emergence of Vision-Language Models (VLMs) has introduced new paradigms for global image geo-localization through retrieval-augmented generation (RAG) and reasoning-driven inference. However, RAG methods are constrained by retrieval…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Bo Yu , Fengze Yang , Yiming Liu , Chao Wang , Xuewen Luo , Taozhe Li , Ruimin Ke , Xiaofan Zhou , Chenxi Liu

Embodied agents are expected to assist humans by actively exploring unknown environments and reasoning about spatial contexts. When deployed in real life, agents often face sequential tasks where each new task follows the completion of the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhongyi Cai , Yi Du , Chen Wang , Yu Kong

Humans can intuitively compose and arrange scenes in the 3D space for photography. However, can advanced AI image generators plan scenes with similar 3D spatial awareness when creating images from text or image prompts? We present GenSpace,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Zehan Wang , Jiayang Xu , Ziang Zhang , Tianyu Pang , Chao Du , Hengshuang Zhao , Zhou Zhao

Large Vision-Language Models (LVLMs) have become powerful general-purpose assistants, yet their predictions often lack reliability and interpretability due to insufficient grounding in visual evidence. The emerging thinking-with-images…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Meng Cao , Haoze Zhao , Can Zhang , Xiaojun Chang , Ian Reid , Xiaodan Liang