中文
相关论文

相关论文: Lookahead Exploration with Neural Radiance Represe…

200 篇论文

Recently, numerous algorithms have been developed to tackle the problem of vision-language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply…

计算机视觉与模式识别 · 计算机科学 2021-03-08 Hanqing Wang , Wenguan Wang , Wei Liang , Caiming Xiong , Jianbing Shen

Multimodal large language models (MLLMs) have shown promising potential in Vision-Language Navigation (VLN). However, their practical development is severely hindered by the substantial training overhead. We recognize two key issues that…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Duo Zheng , Shijia Huang , Yanyang Li , Liwei Wang

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

Inspired by the general Vision-and-Language Navigation (VLN) task, aerial VLN has attracted widespread attention, owing to its significant practical value in applications such as logistics delivery and urban inspection. However, existing…

机器人学 · 计算机科学 2026-04-13 Chengjie Fan , Cong Pan , Zijian Liu , Ningzhong Liu , Jie Qin

Vision-Language Navigation (VLN) requires agents to follow natural language instructions in partially observed 3D environments, motivating map representations that aggregate spatial context beyond local perception. However, most existing…

机器人学 · 计算机科学 2026-02-04 Guoxin Lian , Shuo Wang , Yucheng Wang , Yongcai Wang , Maiyue Chen , Kaihui Wang , Bo Zhang , Zhizhong Su , Deying Li , Zhaoxin Fan

Vision-and-Language Navigation (VLN) is a challenging task where an agent is required to navigate to a natural language described location via vision observations. The navigation abilities of the agent can be enhanced by the relations…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Bowen Huang , Yanwei Zheng , Chuanlin Lan , Xinpeng Zhao , Yifei Zou , Dongxiao yu

Vision-and-Language Navigation (VLN) requires agents to autonomously navigate complex environments via visual images and natural language instructions--remains highly challenging. Recent research on enhancing language-guided navigation…

人工智能 · 计算机科学 2026-02-10 Changxin Huang , Lv Tang , Zhaohuan Zhan , Lisha Yu , Runhao Zeng , Zun Liu , Zhengjie Wang , Jianqiang Li

Vision-language navigation (VLN) has emerged as a promising paradigm, enabling mobile robots to perform zero-shot inference and execute tasks without specific pre-programming. However, current systems often separate map exploration and path…

机器人学 · 计算机科学 2025-07-24 Yuxuan Zhang , Adnan Abdullah , Sanjeev J. Koppal , Md Jahidul Islam

Training end-to-end policies from image data to directly predict navigation actions for robotic systems has proven inherently difficult. Existing approaches often suffer from either the sim-to-real gap during policy transfer or a limited…

机器人学 · 计算机科学 2026-03-17 Lazar Milikic , Manthan Patel , Jonas Frey

Vision-and-Language Navigation (VLN) is an essential skill for embodied agents, allowing them to navigate in 3D environments following natural language instructions. High-performance navigation models require a large amount of training…

人工智能 · 计算机科学 2025-03-10 Zihan Wang , Yaohui Zhu , Gim Hee Lee , Yachun Fan

Vision-Language Navigation (VLN) for Unmanned Aerial Vehicles (UAVs) demands complex visual interpretation and continuous control in dynamic 3D environments. Existing hierarchical approaches rely on dense oracle guidance or auxiliary object…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Peng Xu , Zhengnan Deng , Jiayan Deng , Zonghua Gu , Shaohua Wan

Bridging the gap between embodied intelligence and embedded deployment remains a key challenge in intelligent robotic systems, where perception, reasoning, and planning must operate under strict constraints on computation, memory, energy,…

机器人学 · 计算机科学 2026-05-19 Kuan Xu , Ruimeng Liu , Yizhuo Yang , Denan Liang , Tongxing Jin , Shenghai Yuan , Chen Wang , Lihua Xie

Vision-language navigation (VLN) requires an agent to execute actions following human instructions. Existing VLN models are optimized through expert demonstrations by supervised behavioural cloning or incorporating manual reward…

计算机视觉与模式识别 · 计算机科学 2024-10-21 Rui Liu , Wenguan Wang , Yi Yang

The study of vision-and-language navigation (VLN) has typically relied on expert trajectories, which may not always be available in real-world situations due to the significant effort required to collect them. On the other hand, existing…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Valay Bundele , Mahesh Bhupati , Biplab Banerjee , Aditya Grover

With the rapid progress of foundation models and robotics, vision-language navigation (VLN) has emerged as a key task for embodied agents with broad practical applications. We address VLN in continuous environments, a particularly…

机器人学 · 计算机科学 2025-09-26 Boqi Li , Siyuan Li , Weiyi Wang , Anran Li , Zhong Cao , Henry X. Liu

Advances in learning and representations have reinvigorated work that connects language to other modalities. A particularly exciting direction is Vision-and-Language Navigation(VLN), in which agents interpret natural language instructions…

人工智能 · 计算机科学 2019-06-24 Vihan Jain , Gabriel Magalhaes , Alexander Ku , Ashish Vaswani , Eugene Ie , Jason Baldridge

Path planning is a fundamental capability of autonomous Unmanned Aerial Vehicles (UAVs), enabling them to efficiently navigate toward a target region or explore complex environments while avoiding obstacles. Traditional pathplanning…

机器人学 · 计算机科学 2025-05-30 Jianlin Ye , Savvas Papaioannou , Panayiotis Kolios

Aerial outdoor semantic navigation requires robots to explore large, unstructured environments to locate target objects. Recent advances in semantic navigation have demonstrated open-set object-goal navigation in indoor settings, but these…

Although learning-based vision-and-language navigation (VLN) agents can learn spatial knowledge implicitly from large-scale training data, zero-shot VLN agents lack this process, relying primarily on local observations for navigation, which…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Jiwen Zhang , Zejun Li , Siyuan Wang , Xiangyu Shi , Zhongyu Wei , Qi Wu

We introduce Room-Across-Room (RxR), a new Vision-and-Language Navigation (VLN) dataset. RxR is multilingual (English, Hindi, and Telugu) and larger (more paths and instructions) than other VLN datasets. It emphasizes the role of language…

计算机视觉与模式识别 · 计算机科学 2020-10-19 Alexander Ku , Peter Anderson , Roma Patel , Eugene Ie , Jason Baldridge