English
Related papers

Related papers: Towards Physics-informed Spatial Intelligence with…

200 papers

Transportation safety analysis requires integrating crash records, roadway attributes, and geospatial data through GIS-based workflows, but access remains uneven across agencies and community stakeholders. Technical prerequisites create a…

Computation and Language · Computer Science 2026-05-22 Mahdi Azhdari , Eric J. Gonzales

When retrieval-augmented generation (RAG) systems hallucinate, what geometric trace does this leave in embedding space? We introduce the Semantic Grounding Index (SGI), defined as the ratio of angular distances from the response to the…

Artificial Intelligence · Computer Science 2025-12-17 Javier Marín

We present SIM-FSVGD for learning robot dynamics from data. As opposed to traditional methods, SIM-FSVGD leverages low-fidelity physical priors, e.g., in the form of simulators, to regularize the training of neural network models. While…

Robotics · Computer Science 2024-09-04 Jonas Rothfuss , Bhavya Sukhija , Lenart Treven , Florian Dörfler , Stelian Coros , Andreas Krause

This paper presents SEGO (Semantic Graph Ontology), a cognitive mapping architecture designed to integrate geometric perception, semantic reasoning, and explanation generation into a unified framework for human-centric collaborative…

Robotics · Computer Science 2025-06-17 Jaehong Oh

Spatial reasoning, the ability to understand spatial relations, causality, and dynamic evolution, is central to human intelligence and essential for real-world applications such as autonomous driving and robotics. Existing studies, however,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Yanguang Zhao , Jie Yang , Shengqiong Wu , Shutong Hu , Hongbo Qiu , Yu Wang , Guijia Zhang , Tan Kai Ze , Hao Fei , Chia-Wen Lin , Mong-Li Lee , Wynne Hsu

End-to-end autonomous driving systems, predominantly trained through imitation learning, have demonstrated considerable effectiveness in leveraging large-scale expert driving data. Despite their success in open-loop evaluations, these…

Robotics · Computer Science 2025-11-12 Yi Huang , Zhan Qu , Lihui Jiang , Bingbing Liu , Hongbo Zhang

Significant progress in the development of highly adaptable and reusable Artificial Intelligence (AI) models is expected to have a significant impact on Earth science and remote sensing. Foundation models are pre-trained on large unlabeled…

Gait recognition is an emerging biometric technology that enables non-intrusive and hard-to-spoof human identification. However, most existing methods are confined to short-range, unimodal settings and fail to generalize to long-range and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhiyang Lu , Wen Jiang , Tianren Wu , Zhichao Wang , Changwang Zhang , Siqi Shen , Ming Cheng

Large vision-language models (VLMs) still struggle with reliable 3D spatial reasoning, a core capability for embodied and physical AI systems. This limitation arises from their inability to capture fine-grained 3D geometry and spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jian Zhang , Shijie Zhou , Bangya Liu , Achuta Kadambi , Zhiwen Fan

Perception research is increasingly modelled using streetscapes, yet many approaches still rely on pixel features or object co-occurrence statistics, overlooking the explicit relations that shape human perception. This study proposes a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yunlong Liu , Shuyang Li , Pengyuan Liu , Yu Zhang , Rudi Stouffs

Global navigation information and local scene understanding are two crucial components of autonomous driving systems. However, our experimental results indicate that many end-to-end autonomous driving systems tend to over-rely on local…

Robotics · Computer Science 2026-04-15 Zhihua Hua , Junli Wang , Pengfei LI , Qihao Jin , Bo Zhang , Kehua Sheng , Yilun Chen , Zhongxue Gan , Wenchao Ding

While Open Set Semantic Mapping and 3D Semantic Scene Graphs (3DSSGs) are established paradigms in robotic perception, deploying them effectively to support high-level reasoning in large-scale, real-world environments remains a significant…

Robotics · Computer Science 2026-02-04 Martin Günther , Felix Igelbrink , Oscar Lima , Lennart Niecksch , Marian Renz , Martin Atzmueller

Spatial intelligence is important in Architecture, Construction, Science, Technology, Engineering, and Mathematics (STEM), and Medicine. Understanding three-dimensional (3D) spatial rotations can involve verbal descriptions and visual or…

Artificial Intelligence · Computer Science 2025-03-18 Uttamasha Monjoree , Wei Yan

Spatial reasoning, which requires ability to perceive and manipulate spatial relationships in the 3D world, is a fundamental aspect of human intelligence, yet remains a persistent challenge for Multimodal large language models (MLLMs).…

Artificial Intelligence · Computer Science 2025-11-21 Weichen Liu , Qiyao Xue , Haoming Wang , Xiangyu Yin , Boyuan Yang , Wei Gao

We argue that progress in true multimodal intelligence calls for a shift from reactive, task-driven systems and brute-force long context towards a broader paradigm of supersensing. We frame spatial supersensing as four stages beyond…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Shusheng Yang , Jihan Yang , Pinzhi Huang , Ellis Brown , Zihao Yang , Yue Yu , Shengbang Tong , Zihan Zheng , Yifan Xu , Muhan Wang , Daohan Lu , Rob Fergus , Yann LeCun , Li Fei-Fei , Saining Xie

A detailed environment perception is a crucial component of automated vehicles. However, to deal with the amount of perceived information, we also require segmentation strategies. Based on a grid map environment representation, well-suited…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Sascha Wirges , Tom Fischer , Jesus Balado Frias , Christoph Stiller

Achieving fine-grained and structurally sound controllability is a cornerstone of advanced visual generation. Existing part-based frameworks treat user-provided parts as an unordered set and therefore ignore their intrinsic spatial and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Junbin Zhang , Meng Cao , Feng Tan , Yikai Lin , Yuexian Zou

Physics-informed deep learning approaches have been developed to solve forward and inverse stochastic differential equation (SDE) problems with high-dimensional stochastic space. However, the existing deep learning models have difficulties…

Computational Physics · Physics 2026-03-05 Shaoqian Zhou , Wen You , Ling Guo , Xuhui Meng

Current vision-language models may grasp basic spatial cues and simple directions (e.g. left, right, front, back), but struggle with the multi-dimensional spatial reasoning necessary for human-like understanding and real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Wenyu Zhang , Wei En Ng , Lixin Ma , Yuwen Wang , Junqi Zhao , Allison Koenecke , Boyang Li , Lu Wang

We introduce compute-grounded reasoning (CGR), a design paradigm for spatial-aware research agents in which every answerable sub-problem is resolved by deterministic computation before a language model is asked to generate. Spatial Atlas…

Artificial Intelligence · Computer Science 2026-04-16 Arun Sharma