English
Related papers

Related papers: IndoorUAV: Benchmarking Vision-Language UAV Naviga…

200 papers

Aerial vision-language navigation (AVLN) enables UAVs to follow natural-language instructions in complex 3D environments. However, existing zero-shot AVLN methods often suffer from unstable single-stream Vision-Language Model…

Robotics · Computer Science 2026-03-12 Guiyong Zheng , Yueting Ban , Mingjie Zhang , Juepeng Zheng , Boyu Zhou

With the rapid advancement of Large Language Models (LLMs), their capabilities in various automation domains, particularly Unmanned Aerial Vehicle (UAV) operations, have garnered increasing attention. Current research remains predominantly…

Following human instructions to explore and search for a specified target in an unfamiliar environment is a crucial skill for mobile service robots. Most of the previous works on object goal navigation have typically focused on a single…

Robotics · Computer Science 2024-11-19 Bangguo Yu , Yuzhen Liu , Lei Han , Hamidreza Kasaei , Tingguang Li , Ming Cao

Vision-and-Language Navigation (VLN) is a natural language grounding task where agents have to interpret natural language instructions in the context of visual scenes in a dynamic environment to achieve prescribed navigation goals.…

Computation and Language · Computer Science 2019-06-03 Haoshuo Huang , Vihan Jain , Harsh Mehta , Jason Baldridge , Eugene Ie

Vision-and-language navigation (VLN) enables the agent to navigate to a remote location following the natural language instruction in 3D environments. At each navigation step, the agent selects from possible candidate locations and then…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zihan Wang , Xiangyang Li , Jiahao Yang , Yeqi Liu , Junjie Hu , Ming Jiang , Shuqiang Jiang

In most existing embodied navigation tasks, instructions are well-defined and unambiguous, such as instruction following and object searching. Under this idealized setting, agents are required solely to produce effective navigation outputs…

Robotics · Computer Science 2026-01-26 Wensi Huang , Shaohao Zhu , Meng Wei , Jinming Xu , Xihui Liu , Hanqing Wang , Tai Wang , Feng Zhao , Jiangmiao Pang

Aerial Vision-and-Language Navigation (Aerial VLN) aims to obtain an unmanned aerial vehicle agent to navigate aerial 3D environments following human instruction. Compared to ground-based VLN, aerial VLN requires the agent to decide the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ganlong Zhao , Guanbin Li , Jia Pan , Yizhou Yu

Conventional Vision-and-Language Navigation (VLN) benchmarks assume instructions are feasible and the referenced target exists, leaving agents ill-equipped to handle false-premise goals. We introduce VLN-NF, a benchmark with false-premise…

Robotics · Computer Science 2026-04-21 Hung-Ting Su , Ting-Jun Wang , Jia-Fong Yeh , Min Sun , Winston H. Hsu

Vision-and-Language Navigation (VLN) has been studied mainly in either discrete or continuous settings, with little attention to dynamic, crowded environments. We present HA-VLN 2.0, a unified benchmark introducing explicit social-awareness…

Artificial Intelligence · Computer Science 2025-10-13 Yifei Dong , Fengyi Wu , Qi He , Zhi-Qi Cheng , Heng Li , Minghan Li , Zebang Cheng , Yuxuan Zhou , Jingdong Sun , Qi Dai , Alexander G Hauptmann

Vision-and-language navigation (VLN) requires an embodied agent to navigate in realistic 3D environments using natural language instructions. Existing VLN methods suffer from training on small-scale environments or unreasonable…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Kunyang Lin , Peihao Chen , Diwei Huang , Thomas H. Li , Mingkui Tan , Chuang Gan

The Vision-and-Language Navigation (VLN) task entails an agent following navigational instruction in photo-realistic unknown environments. This challenging task demands that the agent be aware of which instruction was completed, which…

Artificial Intelligence · Computer Science 2019-01-11 Chih-Yao Ma , Jiasen Lu , Zuxuan Wu , Ghassan AlRegib , Zsolt Kira , Richard Socher , Caiming Xiong

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

Robotics · Computer Science 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

The task of vision-and-language navigation in continuous environments (VLN-CE) aims at training an autonomous agent to perform low-level actions to navigate through 3D continuous surroundings using visual observations and language…

Robotics · Computer Science 2024-12-30 Lu Yue , Dongliang Zhou , Liang Xie , Feitian Zhang , Ye Yan , Erwei Yin

UAVs play an important role in applications such as autonomous exploration, disaster response, and infrastructure inspection. However, UAV VLN in complex 3D environments remains challenging. A key difficulty is the structural representation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wen Jiang , Kangyao Huang , Li Wang , Wang Xu , Wei Fan , Jinyuan Liu , Shaoyu Liu , Hanfang Liang , Hongwei Duan , Bin Xu , Xiangyang Ji

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

Robotics · Computer Science 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

This paper proposes VLA-AN, an efficient and onboard Vision-Language-Action (VLA) framework dedicated to autonomous drone navigation in complex environments. VLA-AN addresses four major limitations of existing large aerial navigation…

Robotics · Computer Science 2025-12-22 Yuze Wu , Mo Zhu , Xingxing Li , Yuheng Du , Yuxin Fan , Wenjun Li , Zhichao Han , Xin Zhou , Fei Gao

This paper presents a novel approach for the Vision-and-Language Navigation (VLN) task in continuous 3D environments, which requires an autonomous agent to follow natural language instructions in unseen environments. Existing end-to-end…

This paper addresses the challenge of fine-grained alignment in Vision-and-Language Navigation (VLN) tasks, where robots navigate realistic 3D environments based on natural language instructions. Current approaches use contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yuhang Song , Mario Gianni , Chenguang Yang , Kunyang Lin , Te-Chuan Chiu , Anh Nguyen , Chun-Yi Lee

Unmanned Aerial Vehicles (UAVs), equipped with cameras, are employed in numerous applications, including aerial photography, surveillance, and agriculture. In these applications, robust object detection and tracking are essential for the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Hui Ye , Rajshekhar Sunderraman , Shihao Ji

We investigate the Vision-and-Language Navigation (VLN) problem in the context of autonomous driving in outdoor settings. We solve the problem by explicitly grounding the navigable regions corresponding to the textual command. At each…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Kanishk Jain , Varun Chhangani , Amogh Tiwari , K. Madhava Krishna , Vineet Gandhi
‹ Prev 1 3 4 5 6 7 10 Next ›