中文
相关论文

相关论文: Improving Vision-and-Language Navigation by Genera…

200 篇论文

In the Vision-and-Language Navigation (VLN) task, the agent is required to navigate to a destination following a natural language instruction. While learning-based approaches have been a major solution to the task, they suffer from high…

人工智能 · 计算机科学 2024-08-13 Zhaohuan Zhan , Lisha Yu , Sijie Yu , Guang Tan

In Vision-and-Language Navigation (VLN), an embodied agent needs to reach a target destination with the only guidance of a natural language instruction. To explore the environment and progress towards the target location, the agent must…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Federico Landi , Lorenzo Baraldi , Massimiliano Corsini , Rita Cucchiara

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

机器人学 · 计算机科学 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

The Visual-and-Language Navigation (VLN) task requires understanding a textual instruction to navigate a natural indoor environment using only visual information. While this is a trivial task for most humans, it is still an open problem for…

计算机视觉与模式识别 · 计算机科学 2022-10-28 Joaquin Ossandón , Benjamin Earle , Álvaro Soto

Vision-Language Navigation (VLN) requires an agent to navigate 3D environments following natural language instructions. During navigation, existing agents commonly encounter perceptual uncertainty, such as insufficient evidence for reliable…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Jianzhe Gao , Rui Liu , Yuxuan Xu , Tongtong Cao , Yingxue Zhang , Zhanguang Zhang , Sida Peng , Yi Yang , Wenguan Wang

Outdoor Vision-and-Language Navigation (VLN) requires an agent to navigate through realistic 3D outdoor environments based on natural language instructions. The performance of existing VLN methods is limited by insufficient diversity in…

计算机视觉与模式识别 · 计算机科学 2024-02-08 Jialu Li , Aishwarya Padmakumar , Gaurav Sukhatme , Mohit Bansal

Vision-and-Language Navigation (VLN) agents are tasked with navigating an unseen environment using natural language instructions. In this work, we study if visual representations of sub-goals implied by the instructions can serve as…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Akhil Perincherry , Jacob Krantz , Stefan Lee

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of…

机器人学 · 计算机科学 2025-12-02 Nivedan Yakolli , Avinash Gautam , Abhijit Das , Yuankai Qi , Virendra Singh Shekhawat

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

Vision and language navigation (VLN) is a challenging visually-grounded language understanding task. Given a natural language navigation instruction, a visual agent interacts with a graph-based environment equipped with panorama images and…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Raphael Schumann , Stefan Riezler

Incremental decision making in real-world environments is one of the most challenging tasks in embodied artificial intelligence. One particularly demanding scenario is Vision and Language Navigation~(VLN) which requires visual and natural…

人工智能 · 计算机科学 2024-01-25 Raphael Schumann , Wanrong Zhu , Weixi Feng , Tsu-Jui Fu , Stefan Riezler , William Yang Wang

Recently emerged Vision-and-Language Navigation (VLN) tasks have drawn significant attention in both computer vision and natural language processing communities. Existing VLN tasks are built for agents that navigate on the ground, either…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Shubo Liu , Hongsheng Zhang , Yuankai Qi , Peng Wang , Yaning Zhang , Qi Wu

Vision-and-language navigation (VLN) is a challenging task that requires an agent to navigate in real-world environments by understanding natural language instructions and visual information received in real-time. Prior works have…

机器人学 · 计算机科学 2021-01-20 Ting Wang , Zongkai Wu , Donglin Wang

Vision-and-Language Navigation (VLN) requires the agent to follow language instructions to navigate through 3D environments. One main challenge in VLN is the limited availability of photorealistic training environments, which makes it hard…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Jialu Li , Mohit Bansal

Vision-and-language navigation (VLN) simulates a visual agent that follows natural-language navigation instructions in real-world scenes. Existing approaches have made enormous progress in navigation in new environments, such as beam…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Qi Zheng , Daqing Liu , Chaoyue Wang , Jing Zhang , Dadong Wang , Dacheng Tao

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

机器人学 · 计算机科学 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

人工智能 · 计算机科学 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

Vision-and-Language Navigation (VLN) tasks agents with locating specific objects in unseen environments using natural language instructions and visual cues. Many existing VLN approaches typically follow an 'observe-and-reason' schema, that…

机器人学 · 计算机科学 2026-02-04 Yanjia Huang , Mingyang Wu , Renjie Li , Zhengzhong Tu

Existing vision-and-language navigation (VLN) models primarily reason over past and current visual observations, while largely ignoring the future visual dynamics induced by actions. As a result, they often lack an effective understanding…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Haihong Hao , Lei Chen , Mingfei Han , Changlin Li , Dong An , Yuqiang Yang , Zhihui Li , Xiaojun Chang

Aerial Vision-and-Language Navigation (VLN) is a novel task enabling Unmanned Aerial Vehicles (UAVs) to navigate in outdoor environments through natural language instructions and visual cues. However, it remains challenging due to the…

机器人学 · 计算机科学 2025-08-12 Yunpeng Gao , Zhigang Wang , Pengfei Han , Linglin Jing , Dong Wang , Bin Zhao