中文
相关论文

相关论文: WebVLN: Vision-and-Language Navigation on Websites

200 篇论文

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Real-world navigation often involves dealing with unexpected obstructions such as closed doors, moved objects, and unpredictable entities. However, mainstream Vision-and-Language Navigation (VLN) tasks typically assume instructions…

机器人学 · 计算机科学 2024-08-01 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu

Vision and language navigation (VLN) is a challenging visually-grounded language understanding task. Given a natural language navigation instruction, a visual agent interacts with a graph-based environment equipped with panorama images and…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Raphael Schumann , Stefan Riezler

Vision-and-Language Navigation (VLN) refers to the task of enabling autonomous robots to navigate unfamiliar environments by following natural language instructions. While recent Large Vision-Language Models (LVLMs) have shown promise in…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Vebjørn Haug Kåsene , Pierre Lison

Vision-and-Language Navigation (VLN) agents are tasked with navigating an unseen environment using natural language instructions. In this work, we study if visual representations of sub-goals implied by the instructions can serve as…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Akhil Perincherry , Jacob Krantz , Stefan Lee

Vision-Language Navigation (VLN) aims to guide agents by leveraging language instructions and visual cues, playing a pivotal role in embodied AI. Indoor VLN has been extensively studied, whereas outdoor aerial VLN remains underexplored. The…

Vision-and-Language Navigation (VLN) tasks require an agent to navigate through the environment based on language instructions. In this paper, we aim to solve two key challenges in this task: utilizing multilingual instructions for improved…

计算机视觉与模式识别 · 计算机科学 2022-07-06 Jialu Li , Hao Tan , Mohit Bansal

Current Vision-and-Language Navigation (VLN) tasks mainly employ textual instructions to guide agents. However, being inherently abstract, the same textual instruction can be associated with different visual signals, causing severe…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu

Incremental decision making in real-world environments is one of the most challenging tasks in embodied artificial intelligence. One particularly demanding scenario is Vision and Language Navigation~(VLN) which requires visual and natural…

人工智能 · 计算机科学 2024-01-25 Raphael Schumann , Wanrong Zhu , Weixi Feng , Tsu-Jui Fu , Stefan Riezler , William Yang Wang

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

机器人学 · 计算机科学 2025-06-13 Yicheng Duan , Kaiyu tang

Existing Vision-Language Navigation (VLN) task requires agents to follow verbose instructions, ignoring some potentially useful global spatial priors, limiting their capability to reason about spatial structures. Although human-readable…

机器人学 · 计算机科学 2026-03-19 Kehan Chen , Yan Huang , Dong An , Jiawei He , Yifei Su , Jing Liu , Nianfeng Liu , Liang Wang

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

机器人学 · 计算机科学 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

Vision-language navigation (VLN) requires intelligent agents to navigate environments by interpreting linguistic instructions alongside visual observations, serving as a cornerstone task in Embodied AI. Current VLN research for unmanned…

Learning to follow instructions is of fundamental importance to autonomous agents for vision-and-language navigation (VLN). In this paper, we study how an agent can navigate long paths when learning from a corpus that consists of shorter…

人工智能 · 计算机科学 2020-06-16 Wang Zhu , Hexiang Hu , Jiacheng Chen , Zhiwei Deng , Vihan Jain , Eugene Ie , Fei Sha

We present Vision-based Navigation with Language-based Assistance (VNLA), a grounded vision-language task where an agent with visual perception is guided via language to find objects in photorealistic indoor environments. The task emulates…

机器学习 · 计算机科学 2019-04-09 Khanh Nguyen , Debadeepta Dey , Chris Brockett , Bill Dolan

The Vision-and-Language Navigation (VLN) task requires an agent to follow natural language instructions and navigate through complex environments. Existing MLLM-based VLN methods primarily rely on imitation learning (IL) and often use…

机器人学 · 计算机科学 2025-09-17 Zekai Zhang , Weiye Zhu , Hewei Pan , Xiangchen Wang , Rongtao Xu , Xing Sun , Feng Zheng

Vision-and-language navigation (VLN) is a challenging task that requires an agent to navigate in real-world environments by understanding natural language instructions and visual information received in real-time. Prior works have…

机器人学 · 计算机科学 2021-01-20 Ting Wang , Zongkai Wu , Donglin Wang

Aerial vision-and-language navigation (VLN), requiring drones to interpret natural language instructions and navigate complex urban environments, emerges as a critical embodied AI challenge that bridges human-robot interaction, 3D spatial…

机器人学 · 计算机科学 2025-12-29 Weichen Zhang , Chen Gao , Shiquan Yu , Ruiying Peng , Baining Zhao , Qian Zhang , Jinqiang Cui , Xinlei Chen , Yong Li

Vision-and-Language Navigation (VLN) is a core task where embodied agents leverage their spatial mobility to navigate in 3D environments toward designated destinations based on natural language instructions. Recently, video-language large…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Zihan Wang , Seungjun Lee , Gim Hee Lee

Vision-and-language navigation (VLN) is the task to enable an embodied agent to navigate to a remote location following the natural language instruction in real scenes. Most of the previous approaches utilize the entire features or…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Xiangyang Li , Zihan Wang , Jiahao Yang , Yaowei Wang , Shuqiang Jiang