English
Related papers

Related papers: MapDream: Task-Driven Map Learning for Vision-Lang…

200 papers

Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to…

Robotics · Computer Science 2026-04-03 Xueying Li , Feng Lyu , Hao Wu , Mingliu Liu , Jia-Nan Liu , Guozi Liu

Vision-and-language navigation (VLN) tasks require agents to navigate three-dimensional environments guided by natural language instructions, offering substantial potential for diverse applications. However, the scarcity of training data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Sen Wang , Dongliang Zhou , Liang Xie , Chao Xu , Ye Yan , Erwei Yin

Vision-and-Language Navigation (VLN) requires agents to navigate photo-realistic environments following natural language instructions. Current methods predominantly rely on imitation learning, which suffers from limited generalization and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiangyang Li , Cong Wan , SongLin Dong , Chenhao Ding , Qiang Wang , Zhiheng Ma , Yihong Gong

Outdoor Vision-and-Language Navigation (VLN) requires an agent to navigate through realistic 3D outdoor environments based on natural language instructions. The performance of existing VLN methods is limited by insufficient diversity in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Jialu Li , Aishwarya Padmakumar , Gaurav Sukhatme , Mohit Bansal

Vision-and-language navigation (VLN) aims to enable embodied agents to navigate in realistic environments using natural language instructions. Given the scarcity of domain-specific training data and the high diversity of image and language…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Pierre-Louis Guhur , Makarand Tapaswi , Shizhe Chen , Ivan Laptev , Cordelia Schmid

Vision-language navigation (VLN) requires an agent to traverse complex 3D environments based on natural language instructions, necessitating a thorough scene understanding. While existing works equip agents with various scene…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jianzhe Gao , Rui Liu , Wenguan Wang

Aerial Vision-and-Language Navigation (Aerial VLN) aims to obtain an unmanned aerial vehicle agent to navigate aerial 3D environments following human instruction. Compared to ground-based VLN, aerial VLN requires the agent to decide the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ganlong Zhao , Guanbin Li , Jia Pan , Yizhou Yu

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Vision-and-Language Navigation (VLN) requires an embodied agent to navigate in a complex 3D environment according to natural language instructions. Recent progress in large language models (LLMs) has enabled language-driven navigation with…

Robotics · Computer Science 2026-01-27 Zijun Li , Shijie Li , Zhenxi Zhang , Bin Li , Shoujun Zhou

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

Robotics · Computer Science 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding,…

Robotics · Computer Science 2026-03-19 Zihao Xin , Wentong Li , Yixuan Jiang , Ziyuan Huang , Bin Wang , Piji Li , Jianke Zhu , Jie Qin , Shengjun Huang

Vision-Language Navigation (VLN) tasks require an agent to follow human language instructions to navigate in previously unseen environments. This challenging field involving problems in natural language processing, computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Wansen Wu , Tao Chang , Xinmeng Li

Vision-and-Language Navigation (VLN) requires agents to follow natural language instructions through environments, with memory-persistent variants demanding progressive improvement through accumulated experience. Existing approaches for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yunzhe Xu , Yiyuan Pan , Zhe Liu

Vision-language models (VLMs) have been widely-applied in ground-based vision-language navigation (VLN). However, the vast complexity of outdoor aerial environments compounds data acquisition challenges and imposes long-horizon trajectory…

Robotics · Computer Science 2025-11-24 Peican Lin , Gan Sun , Chenxi Liu , Fazeng Li , Weihong Ren , Yang Cong

Vision-and-Language Navigation (VLN) requires the agent to follow language instructions to navigate through 3D environments. One main challenge in VLN is the limited availability of photorealistic training environments, which makes it hard…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Jialu Li , Mohit Bansal

Recently emerged Vision-and-Language Navigation (VLN) tasks have drawn significant attention in both computer vision and natural language processing communities. Existing VLN tasks are built for agents that navigate on the ground, either…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Shubo Liu , Hongsheng Zhang , Yuankai Qi , Peng Wang , Yaning Zhang , Qi Wu

Despite significant progress in Vision-Language Navigation (VLN), existing approaches still rely on dense RGB videos that produce excessive patch tokens and lack explicit spatial structure, resulting in substantial computational overhead…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Jiahao Yang , Zihan Wang , Xiangyang Li , Xing Zhu , Yujun Shen , Yinghao Xu , Shuqiang Jiang

In Vision-and-Language Navigation (VLN), an agent is required to plan a path to the target specified by the language instruction, using its visual observations. Consequently, prevailing VLN methods primarily focus on building powerful…

Robotics · Computer Science 2026-03-19 Tianfu Li , Wenbo Chen , Haoxuan Xu , Xinhu Zheng , Haoang Li

In vision-and-language navigation (VLN), an embodied agent is required to navigate in realistic 3D environments following natural language instructions. One major bottleneck for existing VLN approaches is the lack of sufficient training…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Shizhe Chen , Pierre-Louis Guhur , Makarand Tapaswi , Cordelia Schmid , Ivan Laptev

Goal-driven mobile robot navigation in map-less environments requires effective state representations for reliable decision-making. Inspired by the favorable properties of Bird's-Eye View (BEV) in point clouds for visual perception, this…

Robotics · Computer Science 2024-09-04 Jiahao Jiang , Yuxiang Yang , Yingqi Deng , Chenlong Ma , Jing Zhang