English
Related papers

Related papers: Active Visual Information Gathering for Vision-Lan…

200 papers

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding,…

Robotics · Computer Science 2026-03-19 Zihao Xin , Wentong Li , Yixuan Jiang , Ziyuan Huang , Bin Wang , Piji Li , Jianke Zhu , Jie Qin , Shengjun Huang

Vision and language navigation (VLN) is a challenging visually-grounded language understanding task. Given a natural language navigation instruction, a visual agent interacts with a graph-based environment equipped with panorama images and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Raphael Schumann , Stefan Riezler

The Vision-and-Language Navigation (VLN) task entails an agent following navigational instruction in photo-realistic unknown environments. This challenging task demands that the agent be aware of which instruction was completed, which…

Artificial Intelligence · Computer Science 2019-01-11 Chih-Yao Ma , Jiasen Lu , Zuxuan Wu , Ghassan AlRegib , Zsolt Kira , Richard Socher , Caiming Xiong

Learning to navigate in a visual environment following natural-language instructions is a challenging task, because the multimodal inputs to the agent are highly variable, and the training data on a new task is often limited. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Weituo Hao , Chunyuan Li , Xiujun Li , Lawrence Carin , Jianfeng Gao

Vision-Language Navigation (VLN) aims to enable agents to navigate to a target location based on language instructions. Traditional VLN often follows a close-set assumption, i.e., training and test data share the same style of the input…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Yang Li , Aming Wu , Zihao Zhang , Yahong Han

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

Artificial Intelligence · Computer Science 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

Vision-Language Navigation (VLN) is a core challenge in embodied AI, requiring agents to navigate real-world environments using natural language instructions. Current language model-based navigation systems operate on discrete topological…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Zhangyang Qi , Zhixiong Zhang , Yizhou Yu , Jiaqi Wang , Hengshuang Zhao

Vision-and-Language Navigation (VLN), where an agent follows instructions to reach a target destination, has recently seen significant advancements. In contrast to navigation in discrete environments with predefined trajectories, VLN in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Guangzhao Dai , Jian Zhao , Yuantao Chen , Yusen Qin , Hao Zhao , Guosen Xie , Yazhou Yao , Xiangbo Shu , Xuelong Li

Outdoor Vision-and-Language Navigation (VLN) requires an agent to navigate through realistic 3D outdoor environments based on natural language instructions. The performance of existing VLN methods is limited by insufficient diversity in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Jialu Li , Aishwarya Padmakumar , Gaurav Sukhatme , Mohit Bansal

In the Vision-and-Language Navigation (VLN) task, the agent is required to navigate to a destination following a natural language instruction. While learning-based approaches have been a major solution to the task, they suffer from high…

Artificial Intelligence · Computer Science 2024-08-13 Zhaohuan Zhan , Lisha Yu , Sijie Yu , Guang Tan

Real-world navigation often involves dealing with unexpected obstructions such as closed doors, moved objects, and unpredictable entities. However, mainstream Vision-and-Language Navigation (VLN) tasks typically assume instructions…

Robotics · Computer Science 2024-08-01 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu

Vision Language Navigation (VLN) typically requires agents to navigate to specified objects or remote regions in unknown scenes by obeying linguistic commands. Such tasks require organizing historical visual observations for linguistic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Bolei Chen , Jiaxu Kang , Yifei Wang , Ping Zhong , Qi Wu , Jianxin Wang

Vision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions. Despite the significant performance improvement, the wide use of fine-grained instructions fails to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Weixi Feng , Tsu-Jui Fu , Yujie Lu , William Yang Wang

A core challenge in AI-guided autonomy is enabling agents to navigate realistically and effectively in previously unseen environments based on natural language commands. We propose UAV-VLN, a novel end-to-end Vision-Language Navigation…

Robotics · Computer Science 2025-10-01 Pranav Saxena , Nishant Raghuvanshi , Neena Goveas

Vision-and-Language Navigation (VLN) aims to develop embodied agents that navigate based on human instructions. However, current VLN frameworks often rely on static environments and optimal expert supervision, limiting their real-world…

Artificial Intelligence · Computer Science 2024-11-05 Heng Li , Minghan Li , Zhi-Qi Cheng , Yifei Dong , Yuxuan Zhou , Jun-Yan He , Qi Dai , Teruko Mitamura , Alexander G. Hauptmann

Recently emerged Vision-and-Language Navigation (VLN) tasks have drawn significant attention in both computer vision and natural language processing communities. Existing VLN tasks are built for agents that navigate on the ground, either…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Shubo Liu , Hongsheng Zhang , Yuankai Qi , Peng Wang , Yaning Zhang , Qi Wu

Vision-and-Language Navigation (VLN) requires an agent to navigate in a real-world environment following natural language instructions. From both the textual and visual perspectives, we find that the relationships among the scene, its…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Yicong Hong , Cristian Rodriguez-Opazo , Yuankai Qi , Qi Wu , Stephen Gould

In the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle 'off the path' scenarios where an agent veers from a reference…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Sonia Raychaudhuri , Saim Wani , Shivansh Patel , Unnat Jain , Angel X. Chang

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

Robotics · Computer Science 2025-06-13 Yicheng Duan , Kaiyu tang

Vision-and-language navigation (VLN) is a task in which an agent is embodied in a realistic 3D environment and follows an instruction to reach the goal node. While most of the previous studies have built and investigated a discriminative…

Computation and Language · Computer Science 2020-10-09 Shuhei Kurita , Kyunghyun Cho