English
Related papers

Related papers: GridMM: Grid Memory Map for Vision-and-Language Na…

200 papers

Vision-and-Language Navigation (VLN) requires an agent to follow natural-language instructions and navigate through previously unseen environments. Recent approaches increasingly employ large language models (LLMs) as high-level navigators…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Shutian Gu , Chengkai Huang , Ruoyu Wang , Lina Yao

A core challenge in AI-guided autonomy is enabling agents to navigate realistically and effectively in previously unseen environments based on natural language commands. We propose UAV-VLN, a novel end-to-end Vision-Language Navigation…

Robotics · Computer Science 2025-10-01 Pranav Saxena , Nishant Raghuvanshi , Neena Goveas

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

Robotics · Computer Science 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Vision-and-Language Navigation (VLN) is shifting from rigid, step-by-step instruction following toward open-vocabulary, goal-oriented autonomy. Achieving this transition without exhaustive routing prompts requires agents to leverage…

Robotics · Computer Science 2026-03-20 Zihui Yu , Pingcong Li , Bichi Zhang , Sören Schwertfeger

Vision-and-Language Navigation (VLN) is a challenging task where an agent is required to navigate to a natural language described location via vision observations. The navigation abilities of the agent can be enhanced by the relations…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Bowen Huang , Yanwei Zheng , Chuanlin Lan , Xinpeng Zhao , Yifei Zou , Dongxiao yu

Vision-and-language navigation (VLN) is the task to enable an embodied agent to navigate to a remote location following the natural language instruction in real scenes. Most of the previous approaches utilize the entire features or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Xiangyang Li , Zihan Wang , Jiahao Yang , Yaowei Wang , Shuqiang Jiang

We present DyNaVLM, an end-to-end vision-language navigation framework using Vision-Language Models (VLM). In contrast to prior methods constrained by fixed angular or distance intervals, our system empowers agents to freely select…

Robotics · Computer Science 2025-06-19 Zihe Ji , Huangxuan Lin , Yue Gao

Visual navigation is a fundamental capability for autonomous home-assistance robots, enabling long-horizon tasks such as object search. While recent methods have leveraged Large Language Models (LLMs) to incorporate commonsense reasoning…

Robotics · Computer Science 2026-05-01 Teng Wang , Xinxin Zhao , Wenzhe Cai , Changyin Sun

Vision and Language Navigation (VLN) requires an agent to navigate to a target location by following natural language instructions. Most of existing works represent a navigation candidate by the feature of the corresponding single view…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Dong An , Yuankai Qi , Yan Huang , Qi Wu , Liang Wang , Tieniu Tan

Vision-and-Language Navigation (VLN) is a task where an agent navigates in an embodied indoor environment under human instructions. Previous works ignore the distribution of sample difficulty and we argue that this potentially degrade their…

Machine Learning · Computer Science 2021-11-16 Jiwen Zhang , Zhongyu Wei , Jianqing Fan , Jiajie Peng

Vision-Language Navigation (VLN) approaches have currently followed two primary paradigms: the end-to-end Vision-Language Model (VLM) policy fine-tuned on navigation trajectories to directly predict actions, and the zero-shot modular…

Robotics · Computer Science 2026-05-19 Jingzhi Huang , Junkai Huang , Wenxuan Song , Haoyang Yang , Hailong Huang , Haoang Li , Yi Wang

Vision-and-Language Navigation (VLN) poses significant challenges for agents to interpret natural language instructions and navigate complex 3D environments. While recent progress has been driven by large-scale pre-training and data…

Artificial Intelligence · Computer Science 2026-05-14 Tianyi Ma , Yue Zhang , Zehao Wang , Parisa Kordjamshidi

Vision-and-language navigation (VLN) requires an embodied agent to ground natural-language instructions into executable navigation actions in unseen environments. Existing zero-shot methods typically rely on additional waypoint prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Kai Sheng , Liuyi Wang , Haojie Dai , Jinlong Li , Yongrui Qin , Zongtao He , Chengju Liu , Qijun Chen

Geo-localization from a single image at planet scale (essentially an advanced or extreme version of the kidnapped robot problem) is a fundamental and challenging task in applications such as navigation, autonomous driving and disaster…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Sania Waheed , Na Min An , Michael Milford , Sarvapali D. Ramchurn , Shoaib Ehsan

Aerial Vision-and-Language Navigation (VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and navigate complex urban environments using onboard visual observation. This task holds promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Huilin Xu , Zhuoyang Liu , Yixiang Luomei , Feng Xu

Vision-and-Language Navigation (VLN) requires agents to navigate photo-realistic environments following natural language instructions. Current methods predominantly rely on imitation learning, which suffers from limited generalization and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiangyang Li , Cong Wan , SongLin Dong , Chenhao Ding , Qiang Wang , Zhiheng Ma , Yihong Gong

Aerial Vision-and-Language Navigation (Aerial VLN) enables unmanned aerial vehicles (UAVs) to follow natural language instructions and navigate complex urban environments. While recent advances have achieved progress through large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yuwei Ning , Ganlong Zhao , Yipeng Qin , Si Liu , Yang Liu , Liang Lin , Guanbin Li

Aerial vision-and-language navigation (VLN), requiring drones to interpret natural language instructions and navigate complex urban environments, emerges as a critical embodied AI challenge that bridges human-robot interaction, 3D spatial…

Robotics · Computer Science 2025-12-29 Weichen Zhang , Chen Gao , Shiquan Yu , Ruiying Peng , Baining Zhao , Qian Zhang , Jinqiang Cui , Xinlei Chen , Yong Li

Visual target navigation in unknown environments is a crucial problem in robotics. Despite extensive investigation of classical and learning-based approaches in the past, robots lack common-sense knowledge about household objects and…

Robotics · Computer Science 2023-12-27 Bangguo Yu , Hamidreza Kasaei , Ming Cao