English

LASAR: Towards Spatio-temporal Reasoning with Latent Cognitive Map

Computer Vision and Pattern Recognition 2026-05-19 v1

Abstract

A fundamental challenge in embodied AI is verifying if agents build internal models of spatial structure or merely learn to mimic task-specific expert trajectories. This is critical as foundational approaches rooted in action-centric tasks (e.g., VLN) and reasoning-centric tasks (e.g., EQA) often share a common limitation: they lack a learning signal that forces them to encode fine-grained spatial relationships (like topology or distance) over long-range, fragmented experiences. To address this, we first propose LASAR, an architecture featuring a dual-memory system designed to maintain both episodic experiences and a semantic cognitive map. We then introduce Spatio-temporal Contextual Representation Learning (ST-CRL), a contrastive objective designed to train this architecture. ST-CRL leverages spatio-temporal cues from cognitive queries generated through annotated spatio-temporal context in simulation to build sample pairs, thereby forming the internal cognitive map from the agent's experiences. Experiments demonstrate that our method achieves 2\%-3.5\% gains in both zero-shot generalization on standard VLN-CE and VSI-Bench benchmarks. We also demonstrate that our proposed cognitive map has high self-consistency.

Keywords

Cite

@article{arxiv.2605.16899,
  title  = {LASAR: Towards Spatio-temporal Reasoning with Latent Cognitive Map},
  author = {Jinzhou Tang and Sidi Liu and Waikit Xiu and Weixing Chen and Keze Wang},
  journal= {arXiv preprint arXiv:2605.16899},
  year   = {2026}
}
R2 v1 2026-07-22T07:16:23.171Z