English
Related papers

Related papers: FloorPlan-VLN: A New Paradigm for Floor Plan Guide…

200 papers

While recent large vision-language models (VLMs) have improved generalization in vision-language navigation (VLN), existing methods typically rely on end-to-end pipelines that map vision-language inputs directly to short-horizon discrete…

Achieving human-level performance in Vision-and-Language Navigation (VLN) requires an embodied agent to jointly understand multimodal instructions and visual-spatial context while reasoning over long action sequences. Recent works, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Jing Zuo , Lingzhou Mu , Fan Jiang , Chengcheng Ma , Mu Xu , Yonggang Qi

Vision-language Navigation (VLN) requires an agent to understand visual observations and language instructions to navigate in unseen environments. Most existing approaches rely on static scene assumptions and struggle to generalize in…

Robotics · Computer Science 2026-03-24 Xiangchen Liu , Hanghan Zheng , Jeil Jeong , Minsung Yoon , Lin Zhao , Zhide Zhong , Haoang Li , Sung-Eui Yoon

Vision-language models (VLMs) have been widely-applied in ground-based vision-language navigation (VLN). However, the vast complexity of outdoor aerial environments compounds data acquisition challenges and imposes long-horizon trajectory…

Robotics · Computer Science 2025-11-24 Peican Lin , Gan Sun , Chenxi Liu , Fazeng Li , Weihong Ren , Yang Cong

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Navigating in unseen environments is crucial for mobile robots. Enhancing them with the ability to follow instructions in natural language will further improve navigation efficiency in unseen cases. However, state-of-the-art (SOTA)…

Robotics · Computer Science 2023-10-18 Chengguang Xu , Hieu T. Nguyen , Christopher Amato , Lawson L. S. Wong

Vision-and-Language Navigation (VLN) is a task where an agent navigates in an embodied indoor environment under human instructions. Previous works ignore the distribution of sample difficulty and we argue that this potentially degrade their…

Machine Learning · Computer Science 2021-11-16 Jiwen Zhang , Zhongyu Wei , Jianqing Fan , Jiajie Peng

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

Unmanned Aerial Vehicle (UAV) Vision-and-Language Navigation (VLN) is vital for applications such as disaster response, logistics delivery, and urban inspection. However, existing methods often struggle with insufficient multimodal fusion,…

Computation and Language · Computer Science 2025-05-20 Hengxing Cai , Jinhan Dong , Jingjun Tan , Jingcheng Deng , Sihang Li , Zhifeng Gao , Haidong Wang , Zicheng Su , Agachai Sumalee , Renxin Zhong

Vision-and-Language Navigation (VLN) requires agents to follow language instructions while acting in continuous real-world spaces. Prior image imagination based VLN work shows benefits for discrete panoramas but lacks online,…

Robotics · Computer Science 2025-12-02 Yanjia Huang , Xianshun Jiang , Xiangbo Gao , Mingyang Wu , Zhengzhong Tu

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Aerial Vision-and-Language Navigation (Aerial VLN) aims to obtain an unmanned aerial vehicle agent to navigate aerial 3D environments following human instruction. Compared to ground-based VLN, aerial VLN requires the agent to decide the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ganlong Zhao , Guanbin Li , Jia Pan , Yizhou Yu

Vision-and-Language Navigation (VLN) is a natural language grounding task where agents have to interpret natural language instructions in the context of visual scenes in a dynamic environment to achieve prescribed navigation goals.…

Computation and Language · Computer Science 2019-06-03 Haoshuo Huang , Vihan Jain , Harsh Mehta , Jason Baldridge , Eugene Ie

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of…

Robotics · Computer Science 2025-12-02 Nivedan Yakolli , Avinash Gautam , Abhijit Das , Yuankai Qi , Virendra Singh Shekhawat

When navigating in a man-made environment they haven't visited before--like an office building--humans employ behaviors such as reading signs and asking others for directions. These behaviors help humans reach their destinations efficiently…

Robotics · Computer Science 2025-09-26 Bhargav Chandaka , Gloria X. Wang , Haozhe Chen , Henry Che , Albert J. Zhai , Shenlong Wang

Vision-and-Language Navigation (VLN) empowers agents to associate time-sequenced visual observations with corresponding instructions to make sequential decisions. However, generalization remains a persistent challenge, particularly when…

Robotics · Computer Science 2025-02-27 Zerui Li , Gengze Zhou , Haodong Hong , Yanyan Shao , Wenqi Lyu , Yanyuan Qiao , Qi Wu

UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous multi-step instructions over long horizons. Existing zero-shot methods remain limited, as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Dian Shao , Zhengzheng Xu , Peiyang Wang , Like Liu , Yule Wang , Jieqi Shi , Jing Huo

Vision-language navigation (VLN) requires intelligent agents to navigate environments by interpreting linguistic instructions alongside visual observations, serving as a cornerstone task in Embodied AI. Current VLN research for unmanned…

Vision-and-Language Navigation (VLN) has gained increasing attention over recent years and many approaches have emerged to advance their development. The remarkable achievements of foundation models have shaped the challenges and proposed…

Computation and Language · Computer Science 2024-12-31 Yue Zhang , Ziqiao Ma , Jialu Li , Yanyuan Qiao , Zun Wang , Joyce Chai , Qi Wu , Mohit Bansal , Parisa Kordjamshidi

Real-world navigation often involves dealing with unexpected obstructions such as closed doors, moved objects, and unpredictable entities. However, mainstream Vision-and-Language Navigation (VLN) tasks typically assume instructions…

Robotics · Computer Science 2024-08-01 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu