English

SpatialNav: Leveraging Spatial Scene Graphs for Zero-Shot Vision-and-Language Navigation

Computer Vision and Pattern Recognition 2026-01-13 v1 Artificial Intelligence Robotics

Abstract

Although learning-based vision-and-language navigation (VLN) agents can learn spatial knowledge implicitly from large-scale training data, zero-shot VLN agents lack this process, relying primarily on local observations for navigation, which leads to inefficient exploration and a significant performance gap. To deal with the problem, we consider a zero-shot VLN setting that agents are allowed to fully explore the environment before task execution. Then, we construct the Spatial Scene Graph (SSG) to explicitly capture global spatial structure and semantics in the explored environment. Based on the SSG, we introduce SpatialNav, a zero-shot VLN agent that integrates an agent-centric spatial map, a compass-aligned visual representation, and a remote object localization strategy for efficient navigation. Comprehensive experiments in both discrete and continuous environments demonstrate that SpatialNav significantly outperforms existing zero-shot agents and clearly narrows the gap with state-of-the-art learning-based methods. Such results highlight the importance of global spatial representations for generalizable navigation.

Keywords

Cite

@article{arxiv.2601.06806,
  title  = {SpatialNav: Leveraging Spatial Scene Graphs for Zero-Shot Vision-and-Language Navigation},
  author = {Jiwen Zhang and Zejun Li and Siyuan Wang and Xiangyu Shi and Zhongyu Wei and Qi Wu},
  journal= {arXiv preprint arXiv:2601.06806},
  year   = {2026}
}

Comments

11 pages, 4 figures, 6 tables

R2 v1 2026-07-01T08:59:23.785Z