English

NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments

Computer Vision and Pattern Recognition 2025-07-23 v2

Abstract

Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to execute sequential navigation actions in complex environments guided by natural language instructions. Current approaches often struggle with generalizing to novel environments and adapting to ongoing changes during navigation. Inspired by human cognition, we present NavMorph, a self-evolving world model framework that enhances environmental understanding and decision-making in VLN-CE tasks. NavMorph employs compact latent representations to model environmental dynamics, equipping agents with foresight for adaptive planning and policy refinement. By integrating a novel Contextual Evolution Memory, NavMorph leverages scene-contextual information to support effective navigation while maintaining online adaptability. Extensive experiments demonstrate that our method achieves notable performance improvements on popular VLN-CE benchmarks. Code is available at https://github.com/Feliciaxyao/NavMorph.

Keywords

Cite

@article{arxiv.2506.23468,
  title  = {NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments},
  author = {Xuan Yao and Junyu Gao and Changsheng Xu},
  journal= {arXiv preprint arXiv:2506.23468},
  year   = {2025}
}

Comments

Accepted by ICCV 2025

R2 v1 2026-07-01T03:38:52.267Z