中文
相关论文

相关论文: Cross-modal Map Learning for Vision and Language N…

200 篇论文

Most existing works solving Room-to-Room VLN problem only utilize RGB images and do not consider local context around candidate views, which lack sufficient visual cues about surrounding environment. Moreover, natural language contains…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Jingyang Huo , Qiang Sun , Boyan Jiang , Haitao Lin , Yanwei Fu

Outdoor Vision-and-Language Navigation (VLN) requires an agent to navigate through realistic 3D outdoor environments based on natural language instructions. The performance of existing VLN methods is limited by insufficient diversity in…

计算机视觉与模式识别 · 计算机科学 2024-02-08 Jialu Li , Aishwarya Padmakumar , Gaurav Sukhatme , Mohit Bansal

Vision-and-Language Navigation (VLN) tasks require an agent to navigate through the environment based on language instructions. In this paper, we aim to solve two key challenges in this task: utilizing multilingual instructions for improved…

计算机视觉与模式识别 · 计算机科学 2022-07-06 Jialu Li , Hao Tan , Mohit Bansal

In a busy city street, a pedestrian surrounded by distractions can pick out a single sign if it is relevant to their route. Artificial agents in outdoor Vision-and-Language Navigation (VLN) are also confronted with detecting supervisory…

机器学习 · 计算机科学 2022-11-21 Jason Armitage , Leonardo Impett , Rico Sennrich

Vision-and-language navigation (VLN) agents are trained to navigate in real-world environments by following natural language instructions. A major challenge in VLN is the limited availability of training data, which hinders the models'…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Zi-Yi Dou , Feng Gao , Nanyun Peng

Vision and language navigation (VLN) is a challenging visually-grounded language understanding task. Given a natural language navigation instruction, a visual agent interacts with a graph-based environment equipped with panorama images and…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Raphael Schumann , Stefan Riezler

Vision-language navigation is a task that requires an agent to follow instructions to navigate in environments. It becomes increasingly crucial in the field of embodied AI, with potential applications in autonomous navigation, search and…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Dong An , Hanqing Wang , Wenguan Wang , Zun Wang , Yan Huang , Keji He , Liang Wang

Vision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions. Despite the significant performance improvement, the wide use of fine-grained instructions fails to…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Weixi Feng , Tsu-Jui Fu , Yujie Lu , William Yang Wang

Commanding a robot to navigate with natural language instructions is a long-term goal for grounded language understanding and robotics. But the dominant language is English, according to previous studies on vision-language navigation (VLN).…

计算与语言 · 计算机科学 2020-12-08 An Yan , Xin Eric Wang , Jiangtao Feng , Lei Li , William Yang Wang

Vision-language navigation (VLN) is the task of entailing an agent to carry out navigational instructions inside photo-realistic environments. One of the key challenges in VLN is how to conduct a robust navigation by mitigating the…

计算机视觉与模式识别 · 计算机科学 2020-08-21 Hanqing Wang , Wenguan Wang , Tianmin Shu , Wei Liang , Jianbing Shen

Developing agents capable of navigating to a target location based on language instructions and visual information, known as vision-language navigation (VLN), has attracted widespread interest. Most research has focused on ground-based…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Xiangyu Wang , Donglin Yang , Ziqin Wang , Hohin Kwan , Jinyu Chen , Wenjun Wu , Hongsheng Li , Yue Liao , Si Liu

The challenging task of Vision-and-Language Navigation (VLN) requires embodied agents to follow natural language instructions to reach a goal location or object (e.g. `walk down the hallway and turn left at the piano'). For agents to…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Meera Hahn , Amit Raj , James M. Rehg

Vision-Language Navigation (VLN) requires agents to follow natural language instructions in partially observed 3D environments, motivating map representations that aggregate spatial context beyond local perception. However, most existing…

机器人学 · 计算机科学 2026-02-04 Guoxin Lian , Shuo Wang , Yucheng Wang , Yongcai Wang , Maiyue Chen , Kaihui Wang , Bo Zhang , Zhizhong Su , Deying Li , Zhaoxin Fan

Visual Language Navigation (VLN) is a fundamental task within the field of Embodied AI, focusing on the ability of agents to navigate complex environments based on natural language instructions. Despite the progress made by existing…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Ruoyu Wang , Tong Yu , Junda Wu , Yao Liu , Julian McAuley , Lina Yao

Vision-Language Navigation (VLN) tasks require an agent to follow human language instructions to navigate in previously unseen environments. This challenging field involving problems in natural language processing, computer vision,…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Wansen Wu , Tao Chang , Xinmeng Li

Little inquiry has explicitly addressed the role of action spaces in language-guided visual navigation -- either in terms of its effect on navigation success or the efficiency with which a robotic agent could execute the resulting…

计算机视觉与模式识别 · 计算机科学 2021-10-06 Jacob Krantz , Aaron Gokaslan , Dhruv Batra , Stefan Lee , Oleksandr Maksymets

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding,…

机器人学 · 计算机科学 2026-03-19 Zihao Xin , Wentong Li , Yixuan Jiang , Ziyuan Huang , Bin Wang , Piji Li , Jianke Zhu , Jie Qin , Shengjun Huang

Vision-and-Language Navigation (VLN) is a task that an agent is required to follow a language instruction to navigate to the goal position, which relies on the ongoing interactions with the environment during moving. Recent…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Chuang Lin , Yi Jiang , Jianfei Cai , Lizhen Qu , Gholamreza Haffari , Zehuan Yuan

Vision-Language Navigation (VLN) requires an embodied agent to navigate complex environments by following natural language instructions, which typically demands tight fusion of visual and language modalities. Existing VLN methods often…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Daojie Peng , Fulong Ma , Jun Ma

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

人工智能 · 计算机科学 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao