English

Video4Spatial: Towards Visuospatial Intelligence with Context-Guided Video Generation

Computer Vision and Pattern Recognition 2025-12-12 v2 Artificial Intelligence

Abstract

We investigate whether video generative models can exhibit visuospatial intelligence, a capability central to human cognition, using only visual data. To this end, we present Video4Spatial, a framework showing that video diffusion models conditioned solely on video-based scene context can perform complex spatial tasks. We validate on two tasks: scene navigation - following camera-pose instructions while remaining consistent with 3D geometry of the scene, and object grounding - which requires semantic localization, instruction following, and planning. Both tasks use video-only inputs, without auxiliary modalities such as depth or poses. With simple yet effective design choices in the framework and data curation, Video4Spatial demonstrates strong spatial understanding from video context: it plans navigation and grounds target objects end-to-end, follows camera-pose instructions while maintaining spatial consistency, and generalizes to long contexts and out-of-domain environments. Taken together, these results advance video generative models toward general visuospatial reasoning.

Keywords

Cite

@article{arxiv.2512.03040,
  title  = {Video4Spatial: Towards Visuospatial Intelligence with Context-Guided Video Generation},
  author = {Zeqi Xiao and Yiwei Zhao and Lingxiao Li and Yushi Lan and Ning Yu and Rahul Garg and Roshni Cooper and Mohammad H. Taghavi and Xingang Pan},
  journal= {arXiv preprint arXiv:2512.03040},
  year   = {2025}
}

Comments

Project page at https://xizaoqu.github.io/video4spatial/

R2 v1 2026-07-01T08:06:11.618Z