English

Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap

Robotics 2026-04-16 v1

Abstract

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in complex 3D environments. This paper provides a comprehensive and structured survey of the field, from its formal task definition to the current state of the art. We establish a methodological taxonomy that charts the technological evolution from early modular and deep learning approaches to contemporary agentic systems driven by large foundation models, including Vision-Language Models (VLMs), Vision-Language-Action (VLA) models, and the emerging integration of generative world models with VLA architectures for physically-grounded reasoning. The survey systematically reviews the ecosystem of essential resources simulators, datasets, and evaluation metrics that facilitates standardized research. Furthermore, we conduct a critical analysis of the primary challenges impeding real-world deployment: the simulation-to-reality gap, robust perception in dynamic outdoor settings, reasoning with linguistic ambiguity, and the efficient deployment of large models on resource-constrained hardware. By synthesizing current benchmarks and limitations, this survey concludes by proposing a forward-looking research roadmap to guide future inquiry into key frontiers such as multi-agent swarm coordination and air-ground collaborative robotics.

Keywords

Cite

@article{arxiv.2604.13654,
  title  = {Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap},
  author = {Hanxuan Chen and Jie Zheng and Siqi Yang and Tianle Zeng and Siwei Feng and Songsheng Cheng and Ruilong Ren and Hanzhong Guo and Shuai Yuan and Xiangyue Wang and Kangli Wang and Ji Pei},
  journal= {arXiv preprint arXiv:2604.13654},
  year   = {2026}
}
R2 v1 2026-07-01T12:10:25.249Z