中文
相关论文

相关论文: Bridging the visual gap in VLN via semantically ri…

200 篇论文

Vision-and-Language Navigation (VLN) poses significant challenges for agents to interpret natural language instructions and navigate complex 3D environments. While recent progress has been driven by large-scale pre-training and data…

人工智能 · 计算机科学 2026-05-14 Tianyi Ma , Yue Zhang , Zehao Wang , Parisa Kordjamshidi

Vision-and-Language Navigation (VLN) requires an agent to ground language instructions to its own movement within a visual environment. While state-of-the-art methods leverage the reasoning capabilities of Vision-Language Models (VLMs) for…

机器人学 · 计算机科学 2026-05-22 Wenxuan Guo , Xiuwei Xu , Yichen Liu , Xiangyu Li , Hang Yin , Huangxing Chen , Wenzhao Zheng , Jianjiang Feng , Jie Zhou , Jiwen Lu

Visual Language Navigation is a task that challenges robots to navigate in realistic environments based on natural language instructions. While previous research has largely focused on static settings, real-world navigation must often…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Dillon Loh , Tomasz Bednarz , Xinxing Xia , Frank Guan

Vision-and-Language Navigation (VLN) is a task where agents must decide how to move through a 3D environment to reach a goal by grounding natural language instructions to the visual surroundings. One of the problems of the VLN task is data…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Tsu-Jui Fu , Xin Eric Wang , Matthew Peterson , Scott Grafton , Miguel Eckstein , William Yang Wang

Core to the vision-and-language navigation (VLN) challenge is building robust instruction representations and action decoding schemes, which can generalize well to previously unseen instructions and environments. In this paper, we report…

计算与语言 · 计算机科学 2019-09-06 Xiujun Li , Chunyuan Li , Qiaolin Xia , Yonatan Bisk , Asli Celikyilmaz , Jianfeng Gao , Noah Smith , Yejin Choi

Vision-Language Navigation (VLN) enables agents to navigate in complex environments by following natural language instructions grounded in visual observations. Although most existing work has focused on ground-based robots or outdoor…

机器人学 · 计算机科学 2025-12-23 Xu Liu , Yu Liu , Hanshuo Qiu , Yang Qirong , Zhouhui Lian

Vision-and-Language Navigation requires an embodied agent to navigate through unseen environments, guided by natural language instructions and a continuous video stream. Recent advances in VLN have been driven by the powerful semantic…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Shuang Zeng , Dekang Qi , Xinyuan Chang , Feng Xiong , Shichao Xie , Xiaolong Wu , Shiyi Liang , Mu Xu , Xing Wei , Ning Guo

A long-term goal of AI research is to build intelligent agents that can communicate with humans in natural language, perceive the environment, and perform real-world tasks. Vision-and-Language Navigation (VLN) is a fundamental and…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Jing Gu , Eliana Stefani , Qi Wu , Jesse Thomason , Xin Eric Wang

Vision-Language Navigation (VLN) aims to enable agents to navigate to a target location based on language instructions. Traditional VLN often follows a close-set assumption, i.e., training and test data share the same style of the input…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Yang Li , Aming Wu , Zihao Zhang , Yahong Han

Following a navigation instruction such as 'Walk down the stairs and stop at the brown sofa' requires embodied AI agents to ground scene elements referenced via language (e.g. 'stairs') to visual content in the environment (pixels…

计算机视觉与模式识别 · 计算机科学 2020-05-04 Arjun Majumdar , Ayush Shrivastava , Stefan Lee , Peter Anderson , Devi Parikh , Dhruv Batra

Real-world navigation often involves dealing with unexpected obstructions such as closed doors, moved objects, and unpredictable entities. However, mainstream Vision-and-Language Navigation (VLN) tasks typically assume instructions…

机器人学 · 计算机科学 2024-08-01 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu

Vision-and-Language Navigation (VLN) aims to develop embodied agents that navigate based on human instructions. However, current VLN frameworks often rely on static environments and optimal expert supervision, limiting their real-world…

人工智能 · 计算机科学 2024-11-05 Heng Li , Minghan Li , Zhi-Qi Cheng , Yifei Dong , Yuxuan Zhou , Jun-Yan He , Qi Dai , Teruko Mitamura , Alexander G. Hauptmann

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

人工智能 · 计算机科学 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Vision-Language Navigation (VLN) tasks require an agent to follow human language instructions to navigate in previously unseen environments. This challenging field involving problems in natural language processing, computer vision,…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Wansen Wu , Tao Chang , Xinmeng Li

Zero-shot vision-and-language navigation (VLN) has gained significant attention due to its minimal data collection costs and inherent generalization. This paradigm is typically driven by the integration of pre-trained Vision-Language Models…

机器人学 · 计算机科学 2026-05-15 Ziyi Xia , Chaoran Xiong , Litao Wei , Xinhao Hu , Ling Pei

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

The aspiration of the Vision-and-Language Navigation (VLN) task has long been to develop an embodied agent with robust adaptability, capable of seamlessly transferring its navigation capabilities across various tasks. Despite remarkable…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Siqi Zhang , Yanyuan Qiao , Qunbo Wang , Longteng Guo , Zhihua Wei , Jing Liu

Vision-and-Language Navigation (VLN) empowers agents to associate time-sequenced visual observations with corresponding instructions to make sequential decisions. However, generalization remains a persistent challenge, particularly when…

机器人学 · 计算机科学 2025-02-27 Zerui Li , Gengze Zhou , Haodong Hong , Yanyan Shao , Wenqi Lyu , Yanyuan Qiao , Qi Wu

The Vision-and-Language Navigation (VLN) task entails an agent following navigational instruction in photo-realistic unknown environments. This challenging task demands that the agent be aware of which instruction was completed, which…

人工智能 · 计算机科学 2019-01-11 Chih-Yao Ma , Jiasen Lu , Zuxuan Wu , Ghassan AlRegib , Zsolt Kira , Richard Socher , Caiming Xiong