中文
相关论文

相关论文: 1st Place Solutions for RxR-Habitat Vision-and-Lan…

200 篇论文

In the Vision-and-Language Navigation (VLN) task, the agent is required to navigate to a destination following a natural language instruction. While learning-based approaches have been a major solution to the task, they suffer from high…

人工智能 · 计算机科学 2024-08-13 Zhaohuan Zhan , Lisha Yu , Sijie Yu , Guang Tan

Vision-and-language navigation (VLN) is a trending topic which aims to navigate an intelligent agent to an expected position through natural language instructions. This work addresses the task of VLN from a previously-ignored aspect, namely…

计算机视觉与模式识别 · 计算机科学 2021-10-13 Xinzhe Zhou , Wei Liu , Yadong Mu

The emerging vision-and-language navigation (VLN) problem aims at learning to navigate an agent to the target location in unseen photo-realistic environments according to the given language instruction. The main challenges of VLN arise…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Weixia Zhang , Chao Ma , Qi Wu , Xiaokang Yang

Vision-and-Language Navigation (VLN) in continuous environments requires agents to interpret natural language instructions while navigating unconstrained 3D spaces. Existing VLN-CE frameworks rely on a two-stage approach: a waypoint…

机器人学 · 计算机科学 2025-06-18 Xiangyu Shi , Zerui Li , Wenqi Lyu , Jiatong Xia , Feras Dayoub , Yanyuan Qiao , Qi Wu

In this work, we propose a modular approach for the Vision-Language Navigation (VLN) task by decomposing the problem into four sub-modules that use state-of-the-art Large Language Models (LLMs) and Vision-Language Models (VLMs) in a…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Navid Rajabi , Jana Kosecka

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

机器人学 · 计算机科学 2025-06-13 Yicheng Duan , Kaiyu tang

Vision-and-language navigation (VLN) enables the agent to navigate to a remote location following the natural language instruction in 3D environments. At each navigation step, the agent selects from possible candidate locations and then…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Zihan Wang , Xiangyang Li , Jiahao Yang , Yeqi Liu , Junjie Hu , Ming Jiang , Shuqiang Jiang

Although large language models (LLMs) are introduced into vision-and-language navigation (VLN) to improve instruction comprehension and generalization, existing LLM- based VLN lacks the ability to selectively recall and use relevant priori…

人工智能 · 计算机科学 2026-03-10 Haozhou Li , Xiangyu Dong , Huiyan Jiang , Yaoming Zhou , Xiaoguang Ma

Developing Vision-and-Language Navigation (VLN) agents typically assumes a \textit{train-once-deploy-once} strategy, which is unrealistic as deployed agents continually encounter novel environments. To address this, we propose the Continual…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Seongjun Jeong , Gi-Cheon Kang , Seongho Choi , Joochan Kim , Byoung-Tak Zhang

Vision-and-Language Navigation (VLN) requires agents to follow natural language instructions through environments, with memory-persistent variants demanding progressive improvement through accumulated experience. Existing approaches for…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Yunzhe Xu , Yiyuan Pan , Zhe Liu

Vision-Language Navigation (VLN) is a core challenge in embodied AI, requiring agents to navigate real-world environments using natural language instructions. Current language model-based navigation systems operate on discrete topological…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Zhangyang Qi , Zhixiong Zhang , Yizhou Yu , Jiaqi Wang , Hengshuang Zhao

Object Goal Navigation-requiring an agent to locate a specific object in an unseen environment-remains a core challenge in embodied AI. Although recent progress in Vision-Language Model (VLM)-based agents has demonstrated promising…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Dujun Nie , Xianda Guo , Yiqun Duan , Ruijun Zhang , Long Chen

Vision-and-Language Navigation (VLN) aims to navigate to the target location by following a given instruction. Unlike existing methods focused on predicting a more accurate action at each step in navigation, in this paper, we make the first…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Chongyang Zhao , Yuankai Qi , Qi Wu

Existing Vision-Language Navigation (VLN) agents based on Large Vision-Language Models (LVLMs) often suffer from perception errors, reasoning errors, and planning errors, which significantly hinder their navigation performance. To address…

机器学习 · 计算机科学 2025-12-03 Zhengcheng Wang , Zichuan Lin , Yijun Yang , Haobo Fu , Deheng Ye

Vision-language navigation (VLN) is the task of navigating an embodied agent to carry out natural language instructions inside real 3D environments. In this paper, we study how to address three critical challenges for this task: the…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Xin Wang , Qiuyuan Huang , Asli Celikyilmaz , Jianfeng Gao , Dinghan Shen , Yuan-Fang Wang , William Yang Wang , Lei Zhang

Vision and Language Navigation (VLN) requires an agent to navigate to a target location by following natural language instructions. Most of existing works represent a navigation candidate by the feature of the corresponding single view…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Dong An , Yuankai Qi , Yan Huang , Qi Wu , Liang Wang , Tieniu Tan

Vision-and-Language Navigation (VLN) requires an agent to ground language instructions to its own movement within a visual environment. While state-of-the-art methods leverage the reasoning capabilities of Vision-Language Models (VLMs) for…

机器人学 · 计算机科学 2026-05-22 Wenxuan Guo , Xiuwei Xu , Yichen Liu , Xiangyu Li , Hang Yin , Huangxing Chen , Wenzhao Zheng , Jianjiang Feng , Jie Zhou , Jiwen Lu

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

人工智能 · 计算机科学 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

Vision-and-Language Navigation (VLN) requires an agent to follow natural-language instructions and navigate through previously unseen environments. Recent approaches increasingly employ large language models (LLMs) as high-level navigators…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Shutian Gu , Chengkai Huang , Ruoyu Wang , Lina Yao

We consider the problem of Vision-and-Language Navigation (VLN). The majority of current methods for VLN are trained end-to-end using either unstructured memory such as LSTM, or using cross-modal attention over the egocentric observations…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Georgios Georgakis , Karl Schmeckpeper , Karan Wanchoo , Soham Dan , Eleni Miltsakaki , Dan Roth , Kostas Daniilidis
‹ 上一页 1 2 3 10 下一页 ›