中文
相关论文

相关论文: Sim-to-Real Transfer via 3D Feature Fields for Vis…

200 篇论文

Vision-and-Language Navigation (VLN) tasks require an agent to navigate through the environment based on language instructions. In this paper, we aim to solve two key challenges in this task: utilizing multilingual instructions for improved…

计算机视觉与模式识别 · 计算机科学 2022-07-06 Jialu Li , Hao Tan , Mohit Bansal

Vision-Language Navigation (VLN) tasks require an agent to follow human language instructions to navigate in previously unseen environments. This challenging field involving problems in natural language processing, computer vision,…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Wansen Wu , Tao Chang , Xinmeng Li

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Vision-and-Language Navigation (VLN) is a natural language grounding task where agents have to interpret natural language instructions in the context of visual scenes in a dynamic environment to achieve prescribed navigation goals.…

计算与语言 · 计算机科学 2019-06-03 Haoshuo Huang , Vihan Jain , Harsh Mehta , Jason Baldridge , Eugene Ie

In the Vision-and-Language Navigation (VLN) field, agents are tasked with navigating real-world scenes guided by linguistic instructions. Enabling the agent to adhere to instructions throughout the process of navigation represents a…

人工智能 · 计算机科学 2024-05-28 Wen Hanlin

Aerial vision-and-language navigation (VLN), requiring drones to interpret natural language instructions and navigate complex urban environments, emerges as a critical embodied AI challenge that bridges human-robot interaction, 3D spatial…

机器人学 · 计算机科学 2025-12-29 Weichen Zhang , Chen Gao , Shiquan Yu , Ruiying Peng , Baining Zhao , Qian Zhang , Jinqiang Cui , Xinlei Chen , Yong Li

Vision-Language Navigation (VLN) approaches have currently followed two primary paradigms: the end-to-end Vision-Language Model (VLM) policy fine-tuned on navigation trajectories to directly predict actions, and the zero-shot modular…

机器人学 · 计算机科学 2026-05-19 Jingzhi Huang , Junkai Huang , Wenxuan Song , Haoyang Yang , Hailong Huang , Haoang Li , Yi Wang

Visual target navigation in unknown environments is a crucial problem in robotics. Despite extensive investigation of classical and learning-based approaches in the past, robots lack common-sense knowledge about household objects and…

机器人学 · 计算机科学 2023-12-27 Bangguo Yu , Hamidreza Kasaei , Ming Cao

Efficient target localization and autonomous navigation in complex environments are fundamental to real-world embodied applications. While recent advances in multimodal foundation models have enabled zero-shot object goal navigation,…

机器人学 · 计算机科学 2026-04-02 Ming-Ming Yu , Yi Chen , Börje F. Karlsson , Wenjun Wu

Vision-and-language navigation (VLN) agents are trained to navigate in real-world environments by following natural language instructions. A major challenge in VLN is the limited availability of training data, which hinders the models'…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Zi-Yi Dou , Feng Gao , Nanyun Peng

In the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle 'off the path' scenarios where an agent veers from a reference…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Sonia Raychaudhuri , Saim Wani , Shivansh Patel , Unnat Jain , Angel X. Chang

Navigation has been classically solved in robotics through the combination of SLAM and planning. More recently, beyond waypoint planning, problems involving significant components of (visual) high-level reasoning have been explored in…

机器人学 · 计算机科学 2024-01-26 Assem Sadek , Guillaume Bono , Boris Chidlovskii , Atilla Baskurt , Christian Wolf

Vision-and-Language Navigation (VLN) poses significant challenges for agents to interpret natural language instructions and navigate complex 3D environments. While recent progress has been driven by large-scale pre-training and data…

人工智能 · 计算机科学 2026-05-14 Tianyi Ma , Yue Zhang , Zehao Wang , Parisa Kordjamshidi

A core challenge in AI-guided autonomy is enabling agents to navigate realistically and effectively in previously unseen environments based on natural language commands. We propose UAV-VLN, a novel end-to-end Vision-Language Navigation…

机器人学 · 计算机科学 2025-10-01 Pranav Saxena , Nishant Raghuvanshi , Neena Goveas

Following human instructions to explore and search for a specified target in an unfamiliar environment is a crucial skill for mobile service robots. Most of the previous works on object goal navigation have typically focused on a single…

机器人学 · 计算机科学 2024-11-19 Bangguo Yu , Yuzhen Liu , Lei Han , Hamidreza Kasaei , Tingguang Li , Ming Cao

Traditional monocular Visual Simultaneous Localization and Mapping (vSLAM) systems can be divided into three categories: those that use features, those that rely on the image itself, and hybrid models. In the case of feature-based methods,…

机器人学 · 计算机科学 2022-10-31 Andreas Georgis , Panagiotis Mermigkas , Petros Maragos

Vision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions. Despite the significant performance improvement, the wide use of fine-grained instructions fails to…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Weixi Feng , Tsu-Jui Fu , Yujie Lu , William Yang Wang

In the Vision-and-Language Navigation task, the embodied agent follows linguistic instructions and navigates to a specific goal. It is important in many practical scenarios and has attracted extensive attention from both computer vision and…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Sinan Tan , Mengmeng Ge , Di Guo , Huaping Liu , Fuchun Sun

Vision-and-language navigation (VLN) is a trending topic which aims to navigate an intelligent agent to an expected position through natural language instructions. This work addresses the task of VLN from a previously-ignored aspect, namely…

计算机视觉与模式识别 · 计算机科学 2021-10-13 Xinzhe Zhou , Wei Liu , Yadong Mu

Although learning-based vision-and-language navigation (VLN) agents can learn spatial knowledge implicitly from large-scale training data, zero-shot VLN agents lack this process, relying primarily on local observations for navigation, which…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Jiwen Zhang , Zejun Li , Siyuan Wang , Xiangyu Shi , Zhongyu Wei , Qi Wu