中文
相关论文

相关论文: Safe-VLN: Collision Avoidance for Vision-and-Langu…

200 篇论文

Existing vision-and-language navigation (VLN) models primarily reason over past and current visual observations, while largely ignoring the future visual dynamics induced by actions. As a result, they often lack an effective understanding…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Haihong Hao , Lei Chen , Mingfei Han , Changlin Li , Dong An , Yuqiang Yang , Zhihui Li , Xiaojun Chang

Developing agents capable of navigating to a target location based on language instructions and visual information, known as vision-language navigation (VLN), has attracted widespread interest. Most research has focused on ground-based…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Xiangyu Wang , Donglin Yang , Ziqin Wang , Hohin Kwan , Jinyu Chen , Wenjun Wu , Hongsheng Li , Yue Liao , Si Liu

Vision-language navigation (VLN) requires intelligent agents to navigate environments by interpreting linguistic instructions alongside visual observations, serving as a cornerstone task in Embodied AI. Current VLN research for unmanned…

Vision-Language Navigation (VLN) aims to enable agents to navigate to a target location based on language instructions. Traditional VLN often follows a close-set assumption, i.e., training and test data share the same style of the input…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Yang Li , Aming Wu , Zihao Zhang , Yahong Han

Vision-Language Navigation (VLN) approaches have currently followed two primary paradigms: the end-to-end Vision-Language Model (VLM) policy fine-tuned on navigation trajectories to directly predict actions, and the zero-shot modular…

机器人学 · 计算机科学 2026-05-19 Jingzhi Huang , Junkai Huang , Wenxuan Song , Haoyang Yang , Hailong Huang , Haoang Li , Yi Wang

Vision Language Navigation in Continuous Environments (VLN-CE) represents a frontier in embodied AI, demanding agents to navigate freely in unbounded 3D spaces solely guided by natural language instructions. This task introduces distinct…

人工智能 · 计算机科学 2024-09-24 Zhiyuan Li , Yanfeng Lu , Yao Mu , Hong Qiao

Little inquiry has explicitly addressed the role of action spaces in language-guided visual navigation -- either in terms of its effect on navigation success or the efficiency with which a robotic agent could execute the resulting…

计算机视觉与模式识别 · 计算机科学 2021-10-06 Jacob Krantz , Aaron Gokaslan , Dhruv Batra , Stefan Lee , Oleksandr Maksymets

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Vision-and-language navigation (VLN) simulates a visual agent that follows natural-language navigation instructions in real-world scenes. Existing approaches have made enormous progress in navigation in new environments, such as beam…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Qi Zheng , Daqing Liu , Chaoyue Wang , Jing Zhang , Dadong Wang , Dacheng Tao

Vision-and-Language Navigation (VLN) poses significant challenges for agents to interpret natural language instructions and navigate complex 3D environments. While recent progress has been driven by large-scale pre-training and data…

人工智能 · 计算机科学 2026-05-14 Tianyi Ma , Yue Zhang , Zehao Wang , Parisa Kordjamshidi

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

机器人学 · 计算机科学 2025-06-13 Yicheng Duan , Kaiyu tang

Training end-to-end policies from image data to directly predict navigation actions for robotic systems has proven inherently difficult. Existing approaches often suffer from either the sim-to-real gap during policy transfer or a limited…

机器人学 · 计算机科学 2026-03-17 Lazar Milikic , Manthan Patel , Jonas Frey

Object navigation in open-world environments remains a formidable and pervasive challenge for robotic systems, particularly when it comes to executing long-horizon tasks that require both open-world object detection and high-level task…

机器人学 · 计算机科学 2025-07-10 Daojie Peng , Jiahang Cao , Qiang Zhang , Jun Ma

Safe visual navigation is critical for indoor mobile robots operating in cluttered environments. Existing benchmarks, however, often neglect collisions or are designed for outdoor scenarios, making them unsuitable for indoor visual…

机器人学 · 计算机科学 2026-03-05 Jaewon Lee , Jaeseok Heo , Gunmin Lee , Howoong Jun , Jeongwoo Oh , Songhwai Oh

Recent advances in vision-language navigation (VLN) were mainly attributed to emerging large language models (LLMs). These methods exhibited excellent generalization capabilities in instruction understanding and task reasoning. However,…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Xiangyu Dong , Haoran Zhao , Jiang Gao , Haozhou Li , Xiaoguang Ma , Yaoming Zhou , Fuhai Chen , Juan Liu

Although vision-language navigation (VLN) has progressed rapidly, zero-shot VLN in continuous environments (VLN-CE) remains highly challenging when using lightweight vision-language models (VLMs), whose limited reasoning capacity makes…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Kun Luo , Xiangyu Dong , Xiaoguang Ma , Haoran Zhao , Yaoming Zhou

Visual-Language Navigation (VLN) is a fundamental challenge in robotic systems, with broad applications for the deployment of embodied agents in real-world environments. Despite recent advances, existing approaches are limited in long-range…

机器人学 · 计算机科学 2025-11-26 Xiaolin Zhou , Tingyang Xiao , Liu Liu , Yucheng Wang , Maiyue Chen , Xinrui Meng , Xinjie Wang , Wei Feng , Wei Sui , Zhizhong Su

Vision-and-language navigation (VLN) is a long-standing challenge in autonomous robotics, aiming to empower agents with the ability to follow human instructions while navigating complex environments. Two key bottlenecks remain in this…

机器人学 · 计算机科学 2025-06-13 Yuhang Zhang , Haosheng Yu , Jiaping Xiao , Mir Feroskhan

Most existing works in vision-and-language navigation (VLN) focus on either discrete or continuous environments, training agents that cannot generalize across the two. The fundamental difference between the two setups is that discrete…

计算机视觉与模式识别 · 计算机科学 2022-03-08 Yicong Hong , Zun Wang , Qi Wu , Stephen Gould

Vision-and-Language Navigation (VLN) is a natural language grounding task where agents have to interpret natural language instructions in the context of visual scenes in a dynamic environment to achieve prescribed navigation goals.…

计算与语言 · 计算机科学 2019-06-03 Haoshuo Huang , Vihan Jain , Harsh Mehta , Jason Baldridge , Eugene Ie