中文
相关论文

相关论文: FlexVLN: Flexible Adaptation for Diverse Vision-an…

200 篇论文

Vision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions. Despite the significant performance improvement, the wide use of fine-grained instructions fails to…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Weixi Feng , Tsu-Jui Fu , Yujie Lu , William Yang Wang

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding,…

机器人学 · 计算机科学 2026-03-19 Zihao Xin , Wentong Li , Yixuan Jiang , Ziyuan Huang , Bin Wang , Piji Li , Jianke Zhu , Jie Qin , Shengjun Huang

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Vision-and-Language Navigation (VLN) refers to the task of enabling autonomous robots to navigate unfamiliar environments by following natural language instructions. While recent Large Vision-Language Models (LVLMs) have shown promise in…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Vebjørn Haug Kåsene , Pierre Lison

A core challenge in AI-guided autonomy is enabling agents to navigate realistically and effectively in previously unseen environments based on natural language commands. We propose UAV-VLN, a novel end-to-end Vision-Language Navigation…

机器人学 · 计算机科学 2025-10-01 Pranav Saxena , Nishant Raghuvanshi , Neena Goveas

Deep Learning has revolutionized our ability to solve complex problems such as Vision-and-Language Navigation (VLN). This task requires the agent to navigate to a goal purely based on visual sensory inputs given natural language…

机器人学 · 计算机科学 2021-04-22 Muhammad Zubair Irshad , Chih-Yao Ma , Zsolt Kira

Vision-and-Language Navigation (VLN), where an agent follows instructions to reach a target destination, has recently seen significant advancements. In contrast to navigation in discrete environments with predefined trajectories, VLN in…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Guangzhao Dai , Jian Zhao , Yuantao Chen , Yusen Qin , Hao Zhao , Guosen Xie , Yazhou Yao , Xiangbo Shu , Xuelong Li

Vision-and-language navigation (VLN) is a challenging task that requires an agent to navigate in real-world environments by understanding natural language instructions and visual information received in real-time. Prior works have…

机器人学 · 计算机科学 2021-01-20 Ting Wang , Zongkai Wu , Donglin Wang

Advancements in large language models (LLMs) have demonstrated their potential in facilitating high-level reasoning, logical reasoning and robotics planning. Recently, LLMs have also been able to generate reward functions for low-level…

机器人学 · 计算机科学 2024-02-21 Marta Skreta , Zihan Zhou , Jia Lin Yuan , Kourosh Darvish , Alán Aspuru-Guzik , Animesh Garg

Vision-and-Language Navigation (VLN) task aims to enable AI agents to accurately understand and follow natural language instructions to navigate through real-world environments, ultimately reaching specific target locations. We recognise a…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Qi Chen , Dileepa Pitawela , Chongyang Zhao , Gengze Zhou , Hsiang-Ting Chen , Qi Wu

Recent Vision-and-Language Navigation (VLN) advancements are promising, but their idealized assumptions about robot movement and control fail to reflect physically embodied deployment challenges. To bridge this gap, we introduce VLN-PE, a…

机器人学 · 计算机科学 2025-09-29 Liuyi Wang , Xinyuan Xia , Hui Zhao , Hanqing Wang , Tai Wang , Yilun Chen , Chengju Liu , Qijun Chen , Jiangmiao Pang

Vision-Language Navigation (VLN) is a task where agents learn to navigate following natural language instructions. The key to this task is to perceive both the visual scene and natural language sequentially. Conventional approaches exploit…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Fengda Zhu , Yi Zhu , Xiaojun Chang , Xiaodan Liang

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

机器人学 · 计算机科学 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Large language models (LLMs) have gained increasing popularity in robotic task planning due to their exceptional abilities in text analytics and generation, as well as their broad knowledge of the world. However, they fall short in decoding…

机器人学 · 计算机科学 2024-08-01 Aoran Mei , Guo-Niu Zhu , Huaxiang Zhang , Zhongxue Gan

Despite remarkable progress in Vision-Language Navigation (VLN), existing benchmarks remain confined to fixed, small-scale datasets with naive physical simulation. These shortcomings limit the insight that the benchmarks provide into…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Sihao Lin , Zerui Li , Xunyi Zhao , Gengze Zhou , Liuyi Wang , Rong Wei , Rui Tang , Juncheng Li , Hanqing Wang , Jiangmiao Pang , Anton van den Hengel , Jiajun Liu , Qi Wu

Visual-Language Navigation (VLN) is a fundamental challenge in robotic systems, with broad applications for the deployment of embodied agents in real-world environments. Despite recent advances, existing approaches are limited in long-range…

机器人学 · 计算机科学 2025-11-26 Xiaolin Zhou , Tingyang Xiao , Liu Liu , Yucheng Wang , Maiyue Chen , Xinrui Meng , Xinjie Wang , Wei Feng , Wei Sui , Zhizhong Su

An emerging paradigm in vision-and-language navigation (VLN) is the use of history-aware multi-modal transformer models. Given a language instruction, these models process observation and navigation history to predict the most appropriate…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Dongwoo Kang , Akhil Perincherry , Zachary Coalson , Aiden Gabriel , Stefan Lee , Sanghyun Hong

Vision-language navigation (VLN) is the task of entailing an agent to carry out navigational instructions inside photo-realistic environments. One of the key challenges in VLN is how to conduct a robust navigation by mitigating the…

计算机视觉与模式识别 · 计算机科学 2020-08-21 Hanqing Wang , Wenguan Wang , Tianmin Shu , Wei Liang , Jianbing Shen

The emerging vision-and-language navigation (VLN) problem aims at learning to navigate an agent to the target location in unseen photo-realistic environments according to the given language instruction. The main challenges of VLN arise…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Weixia Zhang , Chao Ma , Qi Wu , Xiaokang Yang

The Vision-and-Language Navigation (VLN) task requires an agent to follow natural language instructions and navigate through complex environments. Existing MLLM-based VLN methods primarily rely on imitation learning (IL) and often use…

机器人学 · 计算机科学 2025-09-17 Zekai Zhang , Weiye Zhu , Hewei Pan , Xiangchen Wang , Rongtao Xu , Xing Sun , Feng Zheng