English
Related papers

Related papers: AeroDuo: Aerial Duo for UAV-based Vision and Langu…

200 papers

Vision-Language Navigation (VLN) tasks require an agent to follow human language instructions to navigate in previously unseen environments. This challenging field involving problems in natural language processing, computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Wansen Wu , Tao Chang , Xinmeng Li

Vision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions. Despite the significant performance improvement, the wide use of fine-grained instructions fails to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Weixi Feng , Tsu-Jui Fu , Yujie Lu , William Yang Wang

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Vision-and-Language Navigation (VLN) has been studied mainly in either discrete or continuous settings, with little attention to dynamic, crowded environments. We present HA-VLN 2.0, a unified benchmark introducing explicit social-awareness…

Artificial Intelligence · Computer Science 2025-10-13 Yifei Dong , Fengyi Wu , Qi He , Zhi-Qi Cheng , Heng Li , Minghan Li , Zebang Cheng , Yuxuan Zhou , Jingdong Sun , Qi Dai , Alexander G Hauptmann

Recent Vision-and-Language Navigation (VLN) advancements are promising, but their idealized assumptions about robot movement and control fail to reflect physically embodied deployment challenges. To bridge this gap, we introduce VLN-PE, a…

Robotics · Computer Science 2025-09-29 Liuyi Wang , Xinyuan Xia , Hui Zhao , Hanqing Wang , Tai Wang , Yilun Chen , Chengju Liu , Qijun Chen , Jiangmiao Pang

Aerial vision-language navigation (AVLN) enables UAVs to follow natural-language instructions in complex 3D environments. However, existing zero-shot AVLN methods often suffer from unstable single-stream Vision-Language Model…

Robotics · Computer Science 2026-03-12 Guiyong Zheng , Yueting Ban , Mingjie Zhang , Juepeng Zheng , Boyu Zhou

Vision-and-Language Navigation (VLN) tasks require an agent to navigate through the environment based on language instructions. In this paper, we aim to solve two key challenges in this task: utilizing multilingual instructions for improved…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Jialu Li , Hao Tan , Mohit Bansal

Unmanned aerial vehicles (UAVs) are crucial tools for post-disaster search and rescue, facing challenges such as high information density, rapid changes in viewpoint, and dynamic structures, especially in long-horizon navigation. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Wen Jiang , Li Wang , Kangyao Huang , Wei Fan , Jinyuan Liu , Shaoyu Liu , Hongwei Duan , Bin Xu , Xiangyang Ji

Vision-and-Language Navigation (VLN) task aims to enable AI agents to accurately understand and follow natural language instructions to navigate through real-world environments, ultimately reaching specific target locations. We recognise a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Qi Chen , Dileepa Pitawela , Chongyang Zhao , Gengze Zhou , Hsiang-Ting Chen , Qi Wu

Vision-and-language navigation (VLN) is a trending topic which aims to navigate an intelligent agent to an expected position through natural language instructions. This work addresses the task of VLN from a previously-ignored aspect, namely…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Xinzhe Zhou , Wei Liu , Yadong Mu

Existing Vision-Language Navigation (VLN) task requires agents to follow verbose instructions, ignoring some potentially useful global spatial priors, limiting their capability to reason about spatial structures. Although human-readable…

Robotics · Computer Science 2026-03-19 Kehan Chen , Yan Huang , Dong An , Jiawei He , Yifei Su , Jing Liu , Nianfeng Liu , Liang Wang

Vision-and-Language Navigation (VLN), where an agent follows instructions to reach a target destination, has recently seen significant advancements. In contrast to navigation in discrete environments with predefined trajectories, VLN in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Guangzhao Dai , Jian Zhao , Yuantao Chen , Yusen Qin , Hao Zhao , Guosen Xie , Yazhou Yao , Xiangbo Shu , Xuelong Li

Vision-and-Language Navigation (VLN) requires an agent to follow natural-language instructions, explore the given environments, and reach the desired target locations. These step-by-step navigational instructions are crucial when the agent…

Computation and Language · Computer Science 2020-05-08 Yubo Zhang , Hao Tan , Mohit Bansal

Low-altitude mobility, exemplified by unmanned aerial vehicles (UAVs), has introduced transformative advancements across various domains, like transportation, logistics, and agriculture. Leveraging flexible perspectives and rapid…

Vision-and-Language Navigation (VLN) requires agents to autonomously navigate complex environments via visual images and natural language instructions--remains highly challenging. Recent research on enhancing language-guided navigation…

Artificial Intelligence · Computer Science 2026-02-10 Changxin Huang , Lv Tang , Zhaohuan Zhan , Lisha Yu , Runhao Zeng , Zun Liu , Zhengjie Wang , Jianqiang Li

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

Vision and language navigation (VLN) is a challenging visually-grounded language understanding task. Given a natural language navigation instruction, a visual agent interacts with a graph-based environment equipped with panorama images and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Raphael Schumann , Stefan Riezler

Increased utilization of unmanned aerial vehicles (UAVs) in critical operations necessitates secure and reliable communication with Ground Control Stations (GCS). This paper introduces Aero-LLM, a framework integrating multiple Large…

Cryptography and Security · Computer Science 2025-02-11 Balakrishnan Dharmalingam , Rajdeep Mukherjee , Brett Piggott , Guohuan Feng , Anyi Liu

Vision-and-language navigation (VLN) aims to enable embodied agents to navigate in realistic environments using natural language instructions. Given the scarcity of domain-specific training data and the high diversity of image and language…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Pierre-Louis Guhur , Makarand Tapaswi , Shizhe Chen , Ivan Laptev , Cordelia Schmid

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

Robotics · Computer Science 2025-06-13 Yicheng Duan , Kaiyu tang