English
Related papers

Related papers: DecoVLN: Decoupling Observation, Reasoning, and Co…

200 papers

Vision-and-Language Navigation (VLN) is a task that an agent is required to follow a language instruction to navigate to the goal position, which relies on the ongoing interactions with the environment during moving. Recent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chuang Lin , Yi Jiang , Jianfei Cai , Lizhen Qu , Gholamreza Haffari , Zehuan Yuan

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Vision-and-Language Navigation (VLN) is a challenging task that requires an agent to navigate through photorealistic environments following natural-language instructions. One main obstacle existing in VLN is data scarcity, leading to poor…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Yu Zhong , Rui Zhang , Zihao Zhang , Shuo Wang , Chuan Fang , Xishan Zhang , Jiaming Guo , Shaohui Peng , Di Huang , Yanyang Yan , Xing Hu , Qi Guo

Vision-and-language navigation (VLN) enables the agent to navigate to a remote location following the natural language instruction in 3D environments. To represent the previously visited environment, most approaches for VLN implement memory…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zihan Wang , Xiangyang Li , Jiahao Yang , Yeqi Liu , Shuqiang Jiang

Visual Language Navigation is a task that challenges robots to navigate in realistic environments based on natural language instructions. While previous research has largely focused on static settings, real-world navigation must often…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Dillon Loh , Tomasz Bednarz , Xinxing Xia , Frank Guan

Vision-and-Language Navigation (VLN), as a crucial research problem of Embodied AI, requires an embodied agent to navigate through complex 3D environments following natural language instructions. Recent research has highlighted the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bingqian Lin , Yunshuang Nie , Ziming Wei , Jiaqi Chen , Shikui Ma , Jianhua Han , Hang Xu , Xiaojun Chang , Xiaodan Liang

Object navigation in open-world environments remains a formidable and pervasive challenge for robotic systems, particularly when it comes to executing long-horizon tasks that require both open-world object detection and high-level task…

Robotics · Computer Science 2025-07-10 Daojie Peng , Jiahang Cao , Qiang Zhang , Jun Ma

Recently, numerous algorithms have been developed to tackle the problem of vision-language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Hanqing Wang , Wenguan Wang , Wei Liang , Caiming Xiong , Jianbing Shen

Recently emerged Vision-and-Language Navigation (VLN) tasks have drawn significant attention in both computer vision and natural language processing communities. Existing VLN tasks are built for agents that navigate on the ground, either…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Shubo Liu , Hongsheng Zhang , Yuankai Qi , Peng Wang , Yaning Zhang , Qi Wu

Vision-language navigation (VLN) is the task of navigating an embodied agent to carry out natural language instructions inside real 3D environments. In this paper, we study how to address three critical challenges for this task: the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Xin Wang , Qiuyuan Huang , Asli Celikyilmaz , Jianfeng Gao , Dinghan Shen , Yuan-Fang Wang , William Yang Wang , Lei Zhang

Vision-and-Language Navigation (VLN) in large-scale urban environments requires embodied agents to ground linguistic instructions in complex scenes and recall relevant experiences over extended time horizons. Prior modular pipelines offer…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Lixuan He , Haoyu Dong , Zhenxing Chen , Yangcheng Yu , Jie Feng , Yong Li

Vision-and-Language Navigation (VLN) empowers agents to associate time-sequenced visual observations with corresponding instructions to make sequential decisions. However, generalization remains a persistent challenge, particularly when…

Robotics · Computer Science 2025-02-27 Zerui Li , Gengze Zhou , Haodong Hong , Yanyan Shao , Wenqi Lyu , Yanyuan Qiao , Qi Wu

In this paper we propose a new framework - MoViLan (Modular Vision and Language) for execution of visually grounded natural language instructions for day to day indoor household tasks. While several data-driven, end-to-end learning…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Homagni Saha , Fateme Fotouhif , Qisai Liu , Soumik Sarkar

Vision-and-Language Navigation (VLN) requires agents to navigate photo-realistic environments following natural language instructions. Current methods predominantly rely on imitation learning, which suffers from limited generalization and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiangyang Li , Cong Wan , SongLin Dong , Chenhao Ding , Qiang Wang , Zhiheng Ma , Yihong Gong

The aspiration of the Vision-and-Language Navigation (VLN) task has long been to develop an embodied agent with robust adaptability, capable of seamlessly transferring its navigation capabilities across various tasks. Despite remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Siqi Zhang , Yanyuan Qiao , Qunbo Wang , Longteng Guo , Zhihua Wei , Jing Liu

A core challenge in AI-guided autonomy is enabling agents to navigate realistically and effectively in previously unseen environments based on natural language commands. We propose UAV-VLN, a novel end-to-end Vision-Language Navigation…

Robotics · Computer Science 2025-10-01 Pranav Saxena , Nishant Raghuvanshi , Neena Goveas

Vision-and-Language Navigation (VLN) is a natural language grounding task where agents have to interpret natural language instructions in the context of visual scenes in a dynamic environment to achieve prescribed navigation goals.…

Computation and Language · Computer Science 2019-06-03 Haoshuo Huang , Vihan Jain , Harsh Mehta , Jason Baldridge , Eugene Ie

Aerial vision-and-language navigation (VLN), requiring drones to interpret natural language instructions and navigate complex urban environments, emerges as a critical embodied AI challenge that bridges human-robot interaction, 3D spatial…

Robotics · Computer Science 2025-12-29 Weichen Zhang , Chen Gao , Shiquan Yu , Ruiying Peng , Baining Zhao , Qian Zhang , Jinqiang Cui , Xinlei Chen , Yong Li

Vision-and-Language Navigation (VLN) is a natural language grounding task where an agent learns to follow language instructions and navigate to specified destinations in real-world environments. A key challenge is to recognize and stop at…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Jiannan Xiang , Xin Eric Wang , William Yang Wang