English
Related papers

Related papers: A Priority Map for Vision-and-Language Navigation …

200 papers

In Vision-and-Language Navigation (VLN), an agent is required to plan a path to the target specified by the language instruction, using its visual observations. Consequently, prevailing VLN methods primarily focus on building powerful…

Robotics · Computer Science 2026-03-19 Tianfu Li , Wenbo Chen , Haoxuan Xu , Xinhu Zheng , Haoang Li

Vision and Language Navigation (VLN) requires an agent to navigate to a target location by following natural language instructions. Most of existing works represent a navigation candidate by the feature of the corresponding single view…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Dong An , Yuankai Qi , Yan Huang , Qi Wu , Liang Wang , Tieniu Tan

The challenging task of Vision-and-Language Navigation (VLN) requires embodied agents to follow natural language instructions to reach a goal location or object (e.g. `walk down the hallway and turn left at the piano'). For agents to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Meera Hahn , Amit Raj , James M. Rehg

Next Location Prediction is a fundamental task in the study of human mobility, with wide-ranging applications in transportation planning, urban governance, and epidemic forecasting. In practice, when humans attempt to predict the next…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Ruixing Zhang , Yang Zhang , Tongyu Zhu , Leilei Sun , Weifeng Lv

Vision-language navigation (VLN) is a challenging task due to its large searching space in the environment. To address this problem, previous works have proposed some methods of fine-tuning a large model that pretrained on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Xiwen Liang , Fengda Zhu , Lingling Li , Hang Xu , Xiaodan Liang

Vision-and-Language Navigation (VLN), as a widely discussed research direction in embodied intelligence, aims to enable embodied agents to navigate in complicated visual environments through natural language commands. Most existing VLN…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Youzhi Liu , Fanglong Yao , Yuanchang Yue , Guangluan Xu , Xian Sun , Kun Fu

We address a practical yet challenging problem of training robot agents to navigate in an environment following a path described by some language instructions. The instructions often contain descriptions of objects in the environment. To…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Peihao Chen , Dongyu Ji , Kunyang Lin , Runhao Zeng , Thomas H. Li , Mingkui Tan , Chuang Gan

In this work we concentrate on the task of goal-oriented Vision-and-Language Navigation (VLN). Existing methods often make decisions based on historical information, overlooking the future implications and long-term outcomes of the actions.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Peiran Xu , Xicheng Gong , Yadong MU

Recently, numerous algorithms have been developed to tackle the problem of vision-language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Hanqing Wang , Wenguan Wang , Wei Liang , Caiming Xiong , Jianbing Shen

Following language instructions to navigate in unseen environments is a challenging problem for autonomous embodied agents. The agent not only needs to ground languages in visual scenes, but also should explore the environment to reach its…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Shizhe Chen , Pierre-Louis Guhur , Makarand Tapaswi , Cordelia Schmid , Ivan Laptev

Autonomous navigation in highly constrained environments remains challenging for mobile robots. Classical navigation approaches offer safety assurances but require environment-specific parameter tuning; end-to-end learning bypasses…

Robotics · Computer Science 2026-03-11 Yuanjie Lu , Beichen Wang , Zhengqi Wu , Yang Li , Xiaomin Lin , Chengzhi Mao , Xuesu Xiao

The aspiration of the Vision-and-Language Navigation (VLN) task has long been to develop an embodied agent with robust adaptability, capable of seamlessly transferring its navigation capabilities across various tasks. Despite remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Siqi Zhang , Yanyuan Qiao , Qunbo Wang , Longteng Guo , Zhihua Wei , Jing Liu

Vision language navigation is the task that requires an agent to navigate through a 3D environment based on natural language instructions. One key challenge in this task is to ground instructions with the current visual information that the…

Computation and Language · Computer Science 2021-04-21 Jialu Li , Hao Tan , Mohit Bansal

Vision-language navigation is a task that requires an agent to follow instructions to navigate in environments. It becomes increasingly crucial in the field of embodied AI, with potential applications in autonomous navigation, search and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Dong An , Hanqing Wang , Wenguan Wang , Zun Wang , Yan Huang , Keji He , Liang Wang

Vision-and-Language Navigation (VLN), where an agent follows instructions to reach a target destination, has recently seen significant advancements. In contrast to navigation in discrete environments with predefined trajectories, VLN in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Guangzhao Dai , Jian Zhao , Yuantao Chen , Yusen Qin , Hao Zhao , Guosen Xie , Yazhou Yao , Xiangbo Shu , Xuelong Li

Sequential-Horizon Vision-and-Language Navigation (SH-VLN) presents a challenging scenario where agents should sequentially execute multi-task navigation guided by complex, long-horizon language instructions. Current vision-and-language…

Robotics · Computer Science 2026-01-09 Zebin Han , Xudong Wang , Baichen Liu , Qi Lyu , Zhenduo Shang , Jiahua Dong , Lianqing Liu , Zhi Han

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

Robotics · Computer Science 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

LLM-based agents have demonstrated impressive zero-shot performance in vision-language navigation (VLN) task. However, existing LLM-based methods often focus only on solving high-level task planning by selecting nodes in predefined…

Robotics · Computer Science 2024-08-21 Jiaqi Chen , Bingqian Lin , Xinmin Liu , Lin Ma , Xiaodan Liang , Kwan-Yee K. Wong

Vision-and-language navigation (VLN) agents are trained to navigate in real-world environments by following natural language instructions. A major challenge in VLN is the limited availability of training data, which hinders the models'…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Zi-Yi Dou , Feng Gao , Nanyun Peng

Vision-and-Language Navigation (VLN) is a challenging task in which an agent needs to follow a language-specified path to reach a target destination. The goal gets even harder as the actions available to the agent get simpler and move…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Federico Landi , Lorenzo Baraldi , Marcella Cornia , Massimiliano Corsini , Rita Cucchiara