中文
相关论文

相关论文: ETPNav: Evolving Topological Planning for Vision-L…

200 篇论文

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

机器人学 · 计算机科学 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

The emerging vision-and-language navigation (VLN) problem aims at learning to navigate an agent to the target location in unseen photo-realistic environments according to the given language instruction. The main challenges of VLN arise…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Weixia Zhang , Chao Ma , Qi Wu , Xiaokang Yang

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

机器人学 · 计算机科学 2025-06-13 Yicheng Duan , Kaiyu tang

In Vision-and-Language Navigation (VLN), an embodied agent needs to reach a target destination with the only guidance of a natural language instruction. To explore the environment and progress towards the target location, the agent must…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Federico Landi , Lorenzo Baraldi , Massimiliano Corsini , Rita Cucchiara

Existing Vision-Language Navigation (VLN) methods typically adopt an egocentric, step-by-step paradigm, which struggles with error accumulation and limits efficiency. While recent approaches attempt to leverage pre-built environment maps,…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Dijia Zhan , Jinyi Li , Chenxi Zheng , Shaoyu Huang , Yong Li , Jie Tang , Xuemiao Xu

Developing agents capable of navigating to a target location based on language instructions and visual information, known as vision-language navigation (VLN), has attracted widespread interest. Most research has focused on ground-based…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Xiangyu Wang , Donglin Yang , Ziqin Wang , Hohin Kwan , Jinyu Chen , Wenjun Wu , Hongsheng Li , Yue Liao , Si Liu

Vision-and-Language Navigation (VLN) task aims to enable AI agents to accurately understand and follow natural language instructions to navigate through real-world environments, ultimately reaching specific target locations. We recognise a…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Qi Chen , Dileepa Pitawela , Chongyang Zhao , Gengze Zhou , Hsiang-Ting Chen , Qi Wu

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Vision-and-Language Navigation (VLN) poses significant challenges for agents to interpret natural language instructions and navigate complex 3D environments. While recent progress has been driven by large-scale pre-training and data…

人工智能 · 计算机科学 2026-05-14 Tianyi Ma , Yue Zhang , Zehao Wang , Parisa Kordjamshidi

Inspired by the general Vision-and-Language Navigation (VLN) task, aerial VLN has attracted widespread attention, owing to its significant practical value in applications such as logistics delivery and urban inspection. However, existing…

机器人学 · 计算机科学 2026-04-13 Chengjie Fan , Cong Pan , Zijian Liu , Ningzhong Liu , Jie Qin

VLN-CE is a recently released embodied task, where AI agents need to navigate a freely traversable environment to reach a distant target location, given language instructions. It poses great challenges due to the huge space of possible…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Hanqing Wang , Wei Liang , Luc Van Gool , Wenguan Wang

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

人工智能 · 计算机科学 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

Vision-and-language navigation (VLN) simulates a visual agent that follows natural-language navigation instructions in real-world scenes. Existing approaches have made enormous progress in navigation in new environments, such as beam…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Qi Zheng , Daqing Liu , Chaoyue Wang , Jing Zhang , Dadong Wang , Dacheng Tao

While natural language is commonly used to guide embodied agents, the inherent ambiguity and verbosity of language often hinder the effectiveness of language-guided navigation in complex environments. To this end, we propose Visual Prompt…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Shuo Feng , Zihan Wang , Yuchen Li , Rui Kong , Hengyi Cai , Shuaiqiang Wang , Gim Hee Lee , Piji Li , Shuqiang Jiang

Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to execute sequential navigation actions in complex environments guided by natural language instructions. Current approaches often struggle with generalizing…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Xuan Yao , Junyu Gao , Changsheng Xu

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

Vision-Language Navigation in Continuous Environments (VLN-CE) presents a core challenge: grounding high-level linguistic instructions into precise, safe, and long-horizon spatial actions. Explicit topological maps have proven to be a vital…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Jiankun Peng , Jianyuan Guo , Ying Xu , Yue Liu , Jiashuang Yan , Xuanwei Ye , Houhua Li , Xiaoming Wang

Vision-and-Language Navigation (VLN) is a challenging task where an agent must understand language instructions and navigate unfamiliar environments using visual cues. The agent must accurately locate the target based on visual information…

计算机视觉与模式识别 · 计算机科学 2025-05-05 Yinfeng Yu , Dongsheng Yang

In the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle 'off the path' scenarios where an agent veers from a reference…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Sonia Raychaudhuri , Saim Wani , Shivansh Patel , Unnat Jain , Angel X. Chang

Vision-and-language navigation (VLN) is a key task in Embodied AI, requiring agents to navigate diverse and unseen environments while following natural language instructions. Traditional approaches rely heavily on historical observations as…