English

A Survey on Improving Human Robot Collaboration through Vision-and-Language Navigation

Robotics 2025-12-02 v1 Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction

Abstract

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of recent VLN advancements in robotics and outlines promising directions to improve multi-robot coordination. Despite progress, current models struggle with bidirectional communication, ambiguity resolution, and collaborative decision-making in the multi-agent systems. We review approximately 200 relevant articles to provide an in-depth understanding of the current landscape. Through this survey, we aim to provide a thorough resource that inspires further research at the intersection of VLN and robotics. We advocate that the future VLN systems should support proactive clarification, real-time feedback, and contextual reasoning through advanced natural language understanding (NLU) techniques. Additionally, decentralized decision-making frameworks with dynamic role assignment are essential for scalable, efficient multi-robot collaboration. These innovations can significantly enhance human-robot interaction (HRI) and enable real-world deployment in domains such as healthcare, logistics, and disaster response.

Keywords

Cite

@article{arxiv.2512.00027,
  title  = {A Survey on Improving Human Robot Collaboration through Vision-and-Language Navigation},
  author = {Nivedan Yakolli and Avinash Gautam and Abhijit Das and Yuankai Qi and Virendra Singh Shekhawat},
  journal= {arXiv preprint arXiv:2512.00027},
  year   = {2025}
}
R2 v1 2026-07-01T07:59:58.621Z