中文
相关论文

相关论文: Human-Aware Vision-and-Language Navigation: Bridgi…

200 篇论文

Visual language navigation (VLN) is an embodied task demanding a wide range of skills encompassing understanding, perception, and planning. For such a multifaceted challenge, previous VLN methods totally rely on one model's own thinking to…

机器人学 · 计算机科学 2023-09-21 Yuxing Long , Xiaoqi Li , Wenzhe Cai , Hao Dong

With the recent rise of Large Language Models (LLMs), Vision-Language Models (VLMs), and other general foundation models, there is growing potential for multimodal, multi-task embodied agents that can operate in diverse environments given…

机器人学 · 计算机科学 2024-11-07 Haochen Zhang , Nader Zantout , Pujith Kachana , Zongyuan Wu , Ji Zhang , Wenshan Wang

Object Goal Navigation-requiring an agent to locate a specific object in an unseen environment-remains a core challenge in embodied AI. Although recent progress in Vision-Language Model (VLM)-based agents has demonstrated promising…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Dujun Nie , Xianda Guo , Yiqun Duan , Ruijun Zhang , Long Chen

Vision-and-Language Navigation (VLN) has long been constrained by the limited diversity and scalability of simulator-curated datasets, which fail to capture the complexity of real-world environments. To overcome this limitation, we…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Mingfei Han , Haihong Hao , Liang Ma , Kamila Zhumakhanova , Ekaterina Radionova , Jingyi Zhang , Xiaojun Chang , Xiaodan Liang , Ivan Laptev

Vision-language models (VLMs) have been widely-applied in ground-based vision-language navigation (VLN). However, the vast complexity of outdoor aerial environments compounds data acquisition challenges and imposes long-horizon trajectory…

机器人学 · 计算机科学 2025-11-24 Peican Lin , Gan Sun , Chenxi Liu , Fazeng Li , Weihong Ren , Yang Cong

Aerial vision-and-language navigation (Aerial VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and autonomously navigate complex three-dimensional environments by grounding language in visual…

机器人学 · 计算机科学 2026-04-10 Xingyu Xia , Lekai Zhou , Yujie Tang , Xiaozhou Zhu , Hai Zhu , Wen Yao

Vision-Language Navigation (VLN) requires an embodied agent to navigate complex environments by following natural language instructions, which typically demands tight fusion of visual and language modalities. Existing VLN methods often…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Daojie Peng , Fulong Ma , Jun Ma

Language-driven object navigation requires agents to interpret natural language descriptions of target objects, which combine intrinsic and extrinsic attributes for instance recognition and commonsense navigation. Existing methods either…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Francesco Taioli , Shiping Yang , Sonia Raychaudhuri , Marco Cristani , Unnat Jain , Angel X Chang

Vision-Language-Action (VLA) models mark a transformative advancement in artificial intelligence, aiming to unify perception, natural language understanding, and embodied action within a single computational framework. This foundational…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Ranjan Sapkota , Yang Cao , Konstantinos I. Roumeliotis , Manoj Karkee

Vision-language Navigation (VLN) tasks require an agent to navigate step-by-step while perceiving the visual observations and comprehending a natural language instruction. Large data bias, which is caused by the disparity ratio between the…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Chong Liu , Fengda Zhu , Xiaojun Chang , Xiaodan Liang , Zongyuan Ge , Yi-Dong Shen

Vision-and-Language Navigation (VLN) is a task where agents must decide how to move through a 3D environment to reach a goal by grounding natural language instructions to the visual surroundings. One of the problems of the VLN task is data…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Tsu-Jui Fu , Xin Eric Wang , Matthew Peterson , Scott Grafton , Miguel Eckstein , William Yang Wang

Vision-and-language navigation requires an agent to navigate through a real 3D environment following natural language instructions. Despite significant advances, few previous works are able to fully utilize the strong correspondence between…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Yicong Hong , Cristian Rodriguez-Opazo , Qi Wu , Stephen Gould

Vision-and-language navigation (VLN) is a challenging task that requires an agent to navigate in real-world environments by understanding natural language instructions and visual information received in real-time. Prior works have…

机器人学 · 计算机科学 2021-01-20 Ting Wang , Zongkai Wu , Donglin Wang

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

机器人学 · 计算机科学 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

Real-world deployment of Vision-and-Language Navigation (VLN) agents is constrained by the scarcity of reliable supervision after offline training. While recent adaptation methods attempt to mitigate distribution shifts via…

人工智能 · 计算机科学 2026-02-05 Yongqiang Yu , Xuhui Li , Hazza Mahmood , Jinxing Zhou , Haodong Hong , Longtao Jiang , Zhiqiang Xu , Qi Wu , Xiaojun Chang

Vision-and-Language Navigation (VLN) is a cornerstone of embodied intelligence. However, current agents often suffer from significant performance degradation when transitioning from simulation to real-world deployment, primarily due to…

This paper presents UnderwaterVLA, a novel framework for autonomous underwater navigation that integrates multimodal foundation models with embodied intelligence systems. Underwater operations remain difficult due to hydrodynamic…

Vision-and-Language Navigation (VLN) in continuous environments requires agents to interpret natural language instructions while navigating unconstrained 3D spaces. Existing VLN-CE frameworks rely on a two-stage approach: a waypoint…

机器人学 · 计算机科学 2025-06-18 Xiangyu Shi , Zerui Li , Wenqi Lyu , Jiatong Xia , Feras Dayoub , Yanyuan Qiao , Qi Wu

Vision-and-language navigation (VLN) is a task in which an agent is embodied in a realistic 3D environment and follows an instruction to reach the goal node. While most of the previous studies have built and investigated a discriminative…

计算与语言 · 计算机科学 2020-10-09 Shuhei Kurita , Kyunghyun Cho

Capitalizing on the remarkable advancements in Large Language Models (LLMs), there is a burgeoning initiative to harness LLMs for instruction following robotic navigation. Such a trend underscores the potential of LLMs to generalize…

计算机视觉与模式识别 · 计算机科学 2024-09-23 Gengze Zhou , Yicong Hong , Zun Wang , Xin Eric Wang , Qi Wu