English
Related papers

Related papers: Self-Monitoring Navigation Agent via Auxiliary Pro…

200 papers

Vision-and-Language Navigation (VLN) is unique in that it requires turning relatively general natural-language instructions into robot agent actions, on the basis of the visible environment. This requires to extract value from two very…

Computation and Language · Computer Science 2020-07-30 Yuankai Qi , Zizheng Pan , Shengping Zhang , Anton van den Hengel , Qi Wu

A core challenge in AI-guided autonomy is enabling agents to navigate realistically and effectively in previously unseen environments based on natural language commands. We propose UAV-VLN, a novel end-to-end Vision-Language Navigation…

Robotics · Computer Science 2025-10-01 Pranav Saxena , Nishant Raghuvanshi , Neena Goveas

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

Robotics · Computer Science 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

Vision language navigation is the task that requires an agent to navigate through a 3D environment based on natural language instructions. One key challenge in this task is to ground instructions with the current visual information that the…

Computation and Language · Computer Science 2021-04-21 Jialu Li , Hao Tan , Mohit Bansal

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of…

Robotics · Computer Science 2025-12-02 Nivedan Yakolli , Avinash Gautam , Abhijit Das , Yuankai Qi , Virendra Singh Shekhawat

Vision-Language Navigation (VLN) systems are fundamentally constrained by partial observability, as an agent can only accumulate knowledge from locations it has personally visited. As multiple robots increasingly coexist in shared…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Qunchao Jin , Yiliao Song , Qi Wu

Vision and language navigation (VLN) is a challenging visually-grounded language understanding task. Given a natural language navigation instruction, a visual agent interacts with a graph-based environment equipped with panorama images and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Raphael Schumann , Stefan Riezler

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

Artificial Intelligence · Computer Science 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

Vision-and-Language Navigation (VLN) is a natural language grounding task where an agent learns to follow language instructions and navigate to specified destinations in real-world environments. A key challenge is to recognize and stop at…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Jiannan Xiang , Xin Eric Wang , William Yang Wang

In Vision-and-Language Navigation (VLN), an embodied agent needs to reach a target destination with the only guidance of a natural language instruction. To explore the environment and progress towards the target location, the agent must…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Federico Landi , Lorenzo Baraldi , Massimiliano Corsini , Rita Cucchiara

Vision-and-Language Navigation in Continuous Environments (VLN-CE) is one of the most intuitive yet challenging embodied AI tasks. Agents are tasked to navigate towards a target goal by executing a set of low-level actions, following a…

This paper presents a novel approach for the Vision-and-Language Navigation (VLN) task in continuous 3D environments, which requires an autonomous agent to follow natural language instructions in unseen environments. Existing end-to-end…

Vision-and-language navigation (VLN) agents are trained to navigate in real-world environments by following natural language instructions. A major challenge in VLN is the limited availability of training data, which hinders the models'…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Zi-Yi Dou , Feng Gao , Nanyun Peng

As a long-term vision in the field of artificial intelligence, the core goal of embodied intelligence is to improve the perception, understanding, and interaction capabilities of agents and the environment. Vision-language navigation (VLN),…

Robotics · Computer Science 2024-03-21 Peng Gao , Peng Wang , Feng Gao , Fei Wang , Ruyue Yuan

Vision-Language Navigation (VLN) aims to empower robots with the ability to perform long-horizon navigation in unfamiliar environments based on complex linguistic instructions. Its success critically hinges on establishing an efficient…

Robotics · Computer Science 2026-03-04 Ling Luo , Qianqian Bai

Goal-oriented vision-language navigation requires robust exploration capabilities for agents to navigate to specified goals in unknown environments without step-by-step instructions. Existing methods tend to exclusively utilize…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Songze Li , Zun Wang , Gengze Zhou , Jialu Li , Xiangyu Zeng , Ziyang Gong , Limin Wang , Yu Qiao , Qi Wu , Mohit Bansal , Yi Wang

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

Robotics · Computer Science 2025-06-13 Yicheng Duan , Kaiyu tang

Recent studies in Vision-and-Language Navigation (VLN) train RL agents to execute natural-language navigation instructions in photorealistic environments, as a step towards robots that can follow human instructions. However, given the…

The challenging task of Vision-and-Language Navigation (VLN) requires embodied agents to follow natural language instructions to reach a goal location or object (e.g. `walk down the hallway and turn left at the piano'). For agents to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Meera Hahn , Amit Raj , James M. Rehg

Vision-language navigation (VLN) is the task of navigating an embodied agent to carry out natural language instructions inside real 3D environments. In this paper, we study how to address three critical challenges for this task: the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Xin Wang , Qiuyuan Huang , Asli Celikyilmaz , Jianfeng Gao , Dinghan Shen , Yuan-Fang Wang , William Yang Wang , Lei Zhang