中文
相关论文

相关论文: Fine-Grained Alignment in Vision-and-Language Navi…

200 篇论文

A core challenge in AI-guided autonomy is enabling agents to navigate realistically and effectively in previously unseen environments based on natural language commands. We propose UAV-VLN, a novel end-to-end Vision-Language Navigation…

机器人学 · 计算机科学 2025-10-01 Pranav Saxena , Nishant Raghuvanshi , Neena Goveas

Enabling robotic assistants to navigate complex environments and locate objects described in free-form language is a critical capability for real-world deployment. While foundation models, particularly Vision-Language Models (VLMs), offer…

机器人学 · 计算机科学 2026-04-16 Naoki Yokoyama , Sehoon Ha

In Vision-and-Language Navigation (VLN), an embodied agent needs to reach a target destination with the only guidance of a natural language instruction. To explore the environment and progress towards the target location, the agent must…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Federico Landi , Lorenzo Baraldi , Massimiliano Corsini , Rita Cucchiara

Vision-Language Navigation (VLN) enables agents to navigate in complex environments by following natural language instructions grounded in visual observations. Although most existing work has focused on ground-based robots or outdoor…

机器人学 · 计算机科学 2025-12-23 Xu Liu , Yu Liu , Hanshuo Qiu , Yang Qirong , Zhouhui Lian

In the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle 'off the path' scenarios where an agent veers from a reference…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Sonia Raychaudhuri , Saim Wani , Shivansh Patel , Unnat Jain , Angel X. Chang

Vision-and-Language Navigation (VLN) is a core task where embodied agents leverage their spatial mobility to navigate in 3D environments toward designated destinations based on natural language instructions. Recently, video-language large…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Zihan Wang , Seungjun Lee , Gim Hee Lee

Foundation models have revolutionized robotics by providing rich semantic representations without task-specific training. While many approaches integrate pretrained vision-language models (VLMs) with specialized navigation architectures,…

Vision-and-Language Navigation (VLN) requires agents to navigate photo-realistic environments following natural language instructions. Current methods predominantly rely on imitation learning, which suffers from limited generalization and…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Jiangyang Li , Cong Wan , SongLin Dong , Chenhao Ding , Qiang Wang , Zhiheng Ma , Yihong Gong

Vision-language models (VLMs) have made substantial progress across a wide range of visual question answering benchmarks, spanning visual reasoning, document understanding, and multimodal dialogue. These improvements are evident in a wide…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Dhruba Ghosh , Yuhui Zhang , Ludwig Schmidt

Vision-and-language navigation (VLN) stands as a key research problem of Embodied AI, aiming at enabling agents to navigate in unseen environments following linguistic instructions. In this field, generalization is a long-standing…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Jiazhao Zhang , Kunyu Wang , Rongtao Xu , Gengze Zhou , Yicong Hong , Xiaomeng Fang , Qi Wu , Zhizheng Zhang , He Wang

Vision-and-Language Navigation (VLN) requires an embodied agent to navigate in a complex 3D environment according to natural language instructions. Recent progress in large language models (LLMs) has enabled language-driven navigation with…

机器人学 · 计算机科学 2026-01-27 Zijun Li , Shijie Li , Zhenxi Zhang , Bin Li , Shoujun Zhou

The aspiration of the Vision-and-Language Navigation (VLN) task has long been to develop an embodied agent with robust adaptability, capable of seamlessly transferring its navigation capabilities across various tasks. Despite remarkable…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Siqi Zhang , Yanyuan Qiao , Qunbo Wang , Longteng Guo , Zhihua Wei , Jing Liu

Bridging the gap between embodied intelligence and embedded deployment remains a key challenge in intelligent robotic systems, where perception, reasoning, and planning must operate under strict constraints on computation, memory, energy,…

机器人学 · 计算机科学 2026-05-19 Kuan Xu , Ruimeng Liu , Yizhuo Yang , Denan Liang , Tongxing Jin , Shenghai Yuan , Chen Wang , Lihua Xie

Aerial vision-and-language navigation (Aerial VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and autonomously navigate complex three-dimensional environments by grounding language in visual…

机器人学 · 计算机科学 2026-04-10 Xingyu Xia , Lekai Zhou , Yujie Tang , Xiaozhou Zhu , Hai Zhu , Wen Yao

We investigate the Vision-and-Language Navigation (VLN) problem in the context of autonomous driving in outdoor settings. We solve the problem by explicitly grounding the navigable regions corresponding to the textual command. At each…

计算机视觉与模式识别 · 计算机科学 2022-09-27 Kanishk Jain , Varun Chhangani , Amogh Tiwari , K. Madhava Krishna , Vineet Gandhi

Core to the vision-and-language navigation (VLN) challenge is building robust instruction representations and action decoding schemes, which can generalize well to previously unseen instructions and environments. In this paper, we report…

计算与语言 · 计算机科学 2019-09-06 Xiujun Li , Chunyuan Li , Qiaolin Xia , Yonatan Bisk , Asli Celikyilmaz , Jianfeng Gao , Noah Smith , Yejin Choi

Vision-and-Language Navigation (VLN) tasks require an agent to navigate through the environment based on language instructions. In this paper, we aim to solve two key challenges in this task: utilizing multilingual instructions for improved…

计算机视觉与模式识别 · 计算机科学 2022-07-06 Jialu Li , Hao Tan , Mohit Bansal

Vision-and-Language Navigation (VLN) is a natural language grounding task where agents have to interpret natural language instructions in the context of visual scenes in a dynamic environment to achieve prescribed navigation goals.…

计算与语言 · 计算机科学 2019-06-03 Haoshuo Huang , Vihan Jain , Harsh Mehta , Jason Baldridge , Eugene Ie

Vision-and-Language Navigation (VLN) requires an agent to follow natural-language instructions, explore the given environments, and reach the desired target locations. These step-by-step navigational instructions are crucial when the agent…

计算与语言 · 计算机科学 2020-05-08 Yubo Zhang , Hao Tan , Mohit Bansal

Vision-and-Language Navigation (VLN), as a widely discussed research direction in embodied intelligence, aims to enable embodied agents to navigate in complicated visual environments through natural language commands. Most existing VLN…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Youzhi Liu , Fanglong Yao , Yuanchang Yue , Guangluan Xu , Xian Sun , Kun Fu