中文
相关论文

相关论文: STRIDER: Navigation via Instruction-Aligned Struct…

200 篇论文

Vision-and-Language Navigation in Continuous Environments (VLN-CE) is one of the most intuitive yet challenging embodied AI tasks. Agents are tasked to navigate towards a target goal by executing a set of low-level actions, following a…

This paper presents a novel approach for the Vision-and-Language Navigation (VLN) task in continuous 3D environments, which requires an autonomous agent to follow natural language instructions in unseen environments. Existing end-to-end…

Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to navigate unknown, continuous spaces based on natural language instructions. Compared to discrete settings, VLN-CE poses two core perception challenges.…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Lu Yue , Dongliang Zhou , Liang Xie , Erwei Yin , Feitian Zhang

Following human instructions to explore and search for a specified target in an unfamiliar environment is a crucial skill for mobile service robots. Most of the previous works on object goal navigation have typically focused on a single…

机器人学 · 计算机科学 2024-11-19 Bangguo Yu , Yuzhen Liu , Lei Han , Hamidreza Kasaei , Tingguang Li , Ming Cao

Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However,…

机器人学 · 计算机科学 2026-03-05 Hongyu Song , Rishabh Dev Yadav , Cheng Guo , Wei Pan

With the rapid progress of foundation models and robotics, vision-language navigation (VLN) has emerged as a key task for embodied agents with broad practical applications. We address VLN in continuous environments, a particularly…

机器人学 · 计算机科学 2025-09-26 Boqi Li , Siyuan Li , Weiyi Wang , Anran Li , Zhong Cao , Henry X. Liu

Vision-and-Language Navigation in Continuous Environments (VLN-CE), which links language instructions to perception and control in the real world, is a core capability of embodied robots. Recently, large-scale pretrained foundation models…

机器人学 · 计算机科学 2025-09-16 Yunheng Wang , Yuetong Fang , Taowen Wang , Yixiao Feng , Yawen Tan , Shuning Zhang , Peiran Liu , Yiding Ji , Renjing Xu

Recent advances in Vision-and-Language Navigation in Continuous Environments (VLN-CE) have leveraged multimodal large language models (MLLMs) to achieve zero-shot navigation. However, existing methods often rely on panoramic observations…

机器人学 · 计算机科学 2025-11-04 Xiangyu Shi , Zerui Li , Yanyuan Qiao , Qi Wu

Understanding and following natural language instructions while navigating through complex, real-world environments poses a significant challenge for general-purpose robots. These environments often include obstacles and pedestrians, making…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Xiwen Liang , Liang Ma , Shanshan Guo , Jianhua Han , Hang Xu , Shikui Ma , Xiaodan Liang

Vision-Language Navigation in Continuous Environments (VLNCE), where an agent follows instructions and moves freely to reach a destination, is a key research problem in embodied AI. However, most existing approaches are sensitive to…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Josh Qixuan Sun , Huaiyuan Weng , Xiaoying Xing , Chul Min Yeum , Mark Crowley

Goal-oriented vision-language navigation requires robust exploration capabilities for agents to navigate to specified goals in unknown environments without step-by-step instructions. Existing methods tend to exclusively utilize…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Songze Li , Zun Wang , Gengze Zhou , Jialu Li , Xiangyu Zeng , Ziyang Gong , Limin Wang , Yu Qiao , Qi Wu , Mohit Bansal , Yi Wang

Vision-and-language navigation (VLN) requires an embodied agent to ground natural-language instructions into executable navigation actions in unseen environments. Existing zero-shot methods typically rely on additional waypoint prediction…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Kai Sheng , Liuyi Wang , Haojie Dai , Jinlong Li , Yongrui Qin , Zongtao He , Chengju Liu , Qijun Chen

Zero-shot object navigation (ZSON) requires robots to locate target objects in unseen environments without task-specific fine-tuning or pre-built maps, a capability crucial for service and household robotics. Existing methods perform well…

机器人学 · 计算机科学 2026-03-25 Yu He , Da Huang , Zhenyang Liu , Zixiao Gu , Qiang Sun , Guangnan Ye , Yanwei Fu , Yu-Gang Jiang

Natural language instructions for visual navigation often use scene descriptions (e.g., "bedroom") and object references (e.g., "green chairs") to provide a breadcrumb trail to a goal location. This work presents a transformer-based…

计算机视觉与模式识别 · 计算机科学 2021-10-28 Abhinav Moudgil , Arjun Majumdar , Harsh Agrawal , Stefan Lee , Dhruv Batra

Zero-shot navigation is a critical challenge in Vision-Language Navigation (VLN) tasks, where the ability to adapt to unfamiliar instructions and to act in unknown environments is essential. Existing supervised learning-based models,…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Dingbang Li , Wenzhou Chen , Xin Lin

Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliable motion toward it. Existing systems remain limited in real…

机器人学 · 计算机科学 2026-03-19 Zhongyuang Liu , Min He , Shaonan Yu , Xinhang Xu , Muqing Cao , Jianping Li , Jianfei Yang , Lihua Xie

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across a wide range of vision-language tasks. However, their performance as embodied agents, which requires multi-round dialogue spatial reasoning and…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Xunyi Zhao , Gengze Zhou , Qi Wu

Vision-and-Language Navigation (VLN) aims to navigate to the target location by following a given instruction. Unlike existing methods focused on predicting a more accurate action at each step in navigation, in this paper, we make the first…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Chongyang Zhao , Yuankai Qi , Qi Wu

Most existing works in vision-and-language navigation (VLN) focus on either discrete or continuous environments, training agents that cannot generalize across the two. The fundamental difference between the two setups is that discrete…

计算机视觉与模式识别 · 计算机科学 2022-03-08 Yicong Hong , Zun Wang , Qi Wu , Stephen Gould

Navigating toward specific objects in unknown environments without additional training, known as Zero-Shot object navigation, poses a significant challenge in the field of robotics, which demands high levels of auxiliary information and…

机器人学 · 计算机科学 2024-03-25 Lingfeng Zhang , Qiang Zhang , Hao Wang , Erjia Xiao , Zixuan Jiang , Honglei Chen , Renjing Xu