English
Related papers

Related papers: DreamNav: A Trajectory-Based Imaginative Framework…

200 papers

Vision-Language Navigation (VLN) for Unmanned Aerial Vehicles (UAVs) demands complex visual interpretation and continuous control in dynamic 3D environments. Existing hierarchical approaches rely on dense oracle guidance or auxiliary object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Peng Xu , Zhengnan Deng , Jiayan Deng , Zonghua Gu , Shaohua Wan

Aerial Vision-and-Language Navigation (VLN) is a novel task enabling Unmanned Aerial Vehicles (UAVs) to navigate in outdoor environments through natural language instructions and visual cues. However, it remains challenging due to the…

Robotics · Computer Science 2025-08-12 Yunpeng Gao , Zhigang Wang , Pengfei Han , Linglin Jing , Dong Wang , Bin Zhao

In language-guided visual navigation, agents locate target objects in unseen environments using natural language instructions. For reliable navigation in unfamiliar scenes, agents should possess strong perception, planning, and prediction…

Robotics · Computer Science 2025-08-11 Yufeng Zhong , Chengjian Feng , Feng Yan , Fanfan Liu , Liming Zheng , Lin Ma

Current vision-language navigation methods face substantial bottlenecks regarding heterogeneous robot compatibility, real-time performance, and navigation safety. Furthermore, they struggle to support open-vocabulary semantic generalization…

Robotics · Computer Science 2026-04-06 Mingao Tan , Yiyang Li , Shanze Wang , Xinming Zhang , Wei Zhang

Pre-trained large language models (LLMs) have demonstrated strong common-sense reasoning abilities, making them promising for robotic navigation and planning tasks. However, despite recent progress, bridging the gap between language…

Robotics · Computer Science 2025-12-29 Mingfeng Yuan , Letian Wang , Steven L. Waslander

We exploit the complementary strengths of vision and proprioception to develop a point-goal navigation system for legged robots, called VP-Nav. Legged systems are capable of traversing more complex terrain than wheeled robots, but to fully…

Robotics · Computer Science 2022-07-26 Zipeng Fu , Ashish Kumar , Ananye Agarwal , Haozhi Qi , Jitendra Malik , Deepak Pathak

Vision-and-language navigation (VLN) is a challenging task that requires an agent to navigate in real-world environments by understanding natural language instructions and visual information received in real-time. Prior works have…

Robotics · Computer Science 2021-01-20 Ting Wang , Zongkai Wu , Donglin Wang

Vision-and-Language Navigation (VLN) is a core task where embodied agents leverage their spatial mobility to navigate in 3D environments toward designated destinations based on natural language instructions. Recently, video-language large…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Zihan Wang , Seungjun Lee , Gim Hee Lee

Conventional Vision-and-Language Navigation (VLN) benchmarks assume instructions are feasible and the referenced target exists, leaving agents ill-equipped to handle false-premise goals. We introduce VLN-NF, a benchmark with false-premise…

Robotics · Computer Science 2026-04-21 Hung-Ting Su , Ting-Jun Wang , Jia-Fong Yeh , Min Sun , Winston H. Hsu

Long-horizon collaborative vision-language navigation (VLN) is critical for multi-robot systems to accomplish complex tasks beyond the capability of a single agent. CoNavBench takes a first step by introducing the first collaborative…

Robotics · Computer Science 2026-04-15 Sunyao Zhou , Yunzi Wu , Tianhang Wang , Xinhai Li , Guang Chen , Lizheng Liu , Chenjia Bai , Xuelong Li

Service robots are increasingly deployed in diverse and dynamic environments, where both physical layouts and social contexts change over time and across locations. In these unstructured settings, conventional navigation systems that rely…

Robotics · Computer Science 2025-07-16 Yanbo Wang , Zipeng Fang , Lei Zhao , Weidong Chen

Existing Vision-Language Navigation (VLN) agents based on Large Vision-Language Models (LVLMs) often suffer from perception errors, reasoning errors, and planning errors, which significantly hinder their navigation performance. To address…

Machine Learning · Computer Science 2025-12-03 Zhengcheng Wang , Zichuan Lin , Yijun Yang , Haobo Fu , Deheng Ye

Little inquiry has explicitly addressed the role of action spaces in language-guided visual navigation -- either in terms of its effect on navigation success or the efficiency with which a robotic agent could execute the resulting…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Jacob Krantz , Aaron Gokaslan , Dhruv Batra , Stefan Lee , Oleksandr Maksymets

The aspiration of the Vision-and-Language Navigation (VLN) task has long been to develop an embodied agent with robust adaptability, capable of seamlessly transferring its navigation capabilities across various tasks. Despite remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Siqi Zhang , Yanyuan Qiao , Qunbo Wang , Longteng Guo , Zhihua Wei , Jing Liu

LLM-based agents have demonstrated impressive zero-shot performance in vision-language navigation (VLN) task. However, existing LLM-based methods often focus only on solving high-level task planning by selecting nodes in predefined…

Robotics · Computer Science 2024-08-21 Jiaqi Chen , Bingqian Lin , Xinmin Liu , Lin Ma , Xiaodan Liang , Kwan-Yee K. Wong

Image-goal navigation (ImageNav) tasks a robot with autonomously exploring an unknown environment and reaching a location that visually matches a given target image. While prior works primarily study ImageNav for ground robots, enabling…

Robotics · Computer Science 2025-12-22 Zichen Yan , Rui Huang , Lei He , Shao Guo , Lin Zhao

Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Conventional navigation approaches often rely on dense 3D reconstruction and hand-crafted goal metrics,…

Robotics · Computer Science 2026-05-18 Esteban Padilla-Cerdio , Boyang Sun , Marc Pollefeys , Hermann Blum

Vision-and-Language Navigation (VLN) requires agents to follow natural language instructions through environments, with memory-persistent variants demanding progressive improvement through accumulated experience. Existing approaches for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yunzhe Xu , Yiyuan Pan , Zhe Liu

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

Artificial Intelligence · Computer Science 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

Aerial vision-language navigation (VLN) requires agents to follow natural-language instructions through closed-loop perception and action in 3D environments. We argue that aerial VLN can be formulated as a prediction-driven world-action…