English
Related papers

Related papers: OVER-NAV: Elevating Iterative Vision-and-Language …

200 papers

Vision-Language Navigation (VLN) is a task where agents learn to navigate following natural language instructions. The key to this task is to perceive both the visual scene and natural language sequentially. Conventional approaches exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Fengda Zhu , Yi Zhu , Xiaojun Chang , Xiaodan Liang

Most existing works solving Room-to-Room VLN problem only utilize RGB images and do not consider local context around candidate views, which lack sufficient visual cues about surrounding environment. Moreover, natural language contains…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyang Huo , Qiang Sun , Boyan Jiang , Haitao Lin , Yanwei Fu

Vision-language navigation (VLN) is the task of entailing an agent to carry out navigational instructions inside photo-realistic environments. One of the key challenges in VLN is how to conduct a robust navigation by mitigating the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Hanqing Wang , Wenguan Wang , Tianmin Shu , Wei Liang , Jianbing Shen

Vision-and-Language Navigation (VLN) is the task that requires an agent to navigate through the environment based on natural language instructions. At each step, the agent takes the next action by selecting from a set of navigable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jialu Li , Mohit Bansal

The aspiration of the Vision-and-Language Navigation (VLN) task has long been to develop an embodied agent with robust adaptability, capable of seamlessly transferring its navigation capabilities across various tasks. Despite remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Siqi Zhang , Yanyuan Qiao , Qunbo Wang , Longteng Guo , Zhihua Wei , Jing Liu

Multimodal large language models (MLLMs) have shown promising potential in Vision-Language Navigation (VLN). However, their practical development is severely hindered by the substantial training overhead. We recognize two key issues that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Duo Zheng , Shijia Huang , Yanyang Li , Liwei Wang

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of…

Robotics · Computer Science 2025-12-02 Nivedan Yakolli , Avinash Gautam , Abhijit Das , Yuankai Qi , Virendra Singh Shekhawat

Vision-and-Language Navigation (VLN) has gained increasing attention over recent years and many approaches have emerged to advance their development. The remarkable achievements of foundation models have shaped the challenges and proposed…

Computation and Language · Computer Science 2024-12-31 Yue Zhang , Ziqiao Ma , Jialu Li , Yanyuan Qiao , Zun Wang , Joyce Chai , Qi Wu , Mohit Bansal , Parisa Kordjamshidi

The Vision-and-Language Navigation (VLN) task requires an agent to follow natural language instructions and navigate through complex environments. Existing MLLM-based VLN methods primarily rely on imitation learning (IL) and often use…

Robotics · Computer Science 2025-09-17 Zekai Zhang , Weiye Zhu , Hewei Pan , Xiangchen Wang , Rongtao Xu , Xing Sun , Feng Zheng

Vision-and-Language Navigation (VLN) requires an agent to navigate in a real-world environment following natural language instructions. From both the textual and visual perspectives, we find that the relationships among the scene, its…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Yicong Hong , Cristian Rodriguez-Opazo , Yuankai Qi , Qi Wu , Stephen Gould

Vision-Language Navigation (VLN) is evolving from single-point pathfinding toward the more challenging Multi-Goal VLN. This task requires agents to accurately identify multiple entities while collaboratively reasoning over their…

Artificial Intelligence · Computer Science 2026-03-05 Ling Luo , Qiangian Bai

Deep Learning has revolutionized our ability to solve complex problems such as Vision-and-Language Navigation (VLN). This task requires the agent to navigate to a goal purely based on visual sensory inputs given natural language…

Robotics · Computer Science 2021-04-22 Muhammad Zubair Irshad , Chih-Yao Ma , Zsolt Kira

Vision-Language Navigation (VLN) aims to enable agents to navigate to a target location based on language instructions. Traditional VLN often follows a close-set assumption, i.e., training and test data share the same style of the input…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Yang Li , Aming Wu , Zihao Zhang , Yahong Han

Recent advances in vision-language navigation (VLN) were mainly attributed to emerging large language models (LLMs). These methods exhibited excellent generalization capabilities in instruction understanding and task reasoning. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiangyu Dong , Haoran Zhao , Jiang Gao , Haozhou Li , Xiaoguang Ma , Yaoming Zhou , Fuhai Chen , Juan Liu

Aerial Vision-and-Language Navigation (Aerial VLN) enables unmanned aerial vehicles (UAVs) to follow natural language instructions and navigate complex urban environments. While recent advances have achieved progress through large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yuwei Ning , Ganlong Zhao , Yipeng Qin , Si Liu , Yang Liu , Liang Lin , Guanbin Li

Vision-and-language navigation (VLN) enables the agent to navigate to a remote location following the natural language instruction in 3D environments. At each navigation step, the agent selects from possible candidate locations and then…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zihan Wang , Xiangyang Li , Jiahao Yang , Yeqi Liu , Junjie Hu , Ming Jiang , Shuqiang Jiang

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Inspired by the general Vision-and-Language Navigation (VLN) task, aerial VLN has attracted widespread attention, owing to its significant practical value in applications such as logistics delivery and urban inspection. However, existing…

Robotics · Computer Science 2026-04-13 Chengjie Fan , Cong Pan , Zijian Liu , Ningzhong Liu , Jie Qin

Vision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions. Despite the significant performance improvement, the wide use of fine-grained instructions fails to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Weixi Feng , Tsu-Jui Fu , Yujie Lu , William Yang Wang

Vision Language Navigation (VLN) typically requires agents to navigate to specified objects or remote regions in unknown scenes by obeying linguistic commands. Such tasks require organizing historical visual observations for linguistic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Bolei Chen , Jiaxu Kang , Yifei Wang , Ping Zhong , Qi Wu , Jianxin Wang