中文
相关论文

相关论文: Three-Step Nav: A Hierarchical Global-Local Planne…

200 篇论文

Solving long-horizon tasks requires robots to integrate high-level semantic reasoning with low-level physical interaction. While vision-language models (VLMs) and video generation models can decompose tasks and imagine outcomes, they often…

机器人学 · 计算机科学 2026-02-24 Jiahui Fu , Junyu Nan , Lingfeng Sun , Hongyu Li , Jianing Qian , Jennifer L. Barry , Kris Kitani , George Konidaris

Enabling humanoid robots to reliably execute complex multi-step manipulation tasks is crucial for their effective deployment in industrial and household environments. This paper presents a hierarchical planning and control framework…

机器人学 · 计算机科学 2025-07-11 André Schakkal , Ben Zandonati , Zhutian Yang , Navid Azizan

Vision-and-Language Navigation (VLN) is a challenging task in the field of artificial intelligence. Although massive progress has been made in this task over the past few years attributed to breakthroughs in deep vision and language models,…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Wenda Qin , Teruhisa Misu , Derry Wijaya

Zero-shot object navigation (ZSON) in unseen environments remains a challenging problem for household robots, requiring strong perceptual understanding and decision-making capabilities. While recent methods leverage metric maps and Large…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Qunchao Jin , Yilin Wu , Changhao Chen

Vision-and-Language Navigation (VLN) aims to navigate to the target location by following a given instruction. Unlike existing methods focused on predicting a more accurate action at each step in navigation, in this paper, we make the first…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Chongyang Zhao , Yuankai Qi , Qi Wu

Object-goal navigation has traditionally been limited to ground robots with closed-set object vocabularies. Existing multi-agent approaches depend on precomputed probabilistic graphs tied to fixed category sets, precluding generalization to…

机器人学 · 计算机科学 2026-03-20 MoniJesu James , Amir Atef Habel , Aleksey Fedoseev , Dzmitry Tsetserokou

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding,…

机器人学 · 计算机科学 2026-03-19 Zihao Xin , Wentong Li , Yixuan Jiang , Ziyuan Huang , Bin Wang , Piji Li , Jianke Zhu , Jie Qin , Shengjun Huang

Vision-language navigation (VLN), which entails an agent to navigate 3D environments following human instructions, has shown great advances. However, current agents are built upon panoramic observations, which hinders their ability to…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Rui Liu , Xiaohan Wang , Wenguan Wang , Yi Yang

An emerging paradigm in vision-and-language navigation (VLN) is the use of history-aware multi-modal transformer models. Given a language instruction, these models process observation and navigation history to predict the most appropriate…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Dongwoo Kang , Akhil Perincherry , Zachary Coalson , Aiden Gabriel , Stefan Lee , Sanghyun Hong

Vision-and-Language Navigation (VLN) requires robots to follow natural language instructions and navigate complex environments without prior maps. While recent vision-language large models demonstrate strong reasoning abilities, they often…

机器人学 · 计算机科学 2026-01-26 Liuyi Wang , Zongtao He , Jinlong Li , Ruihao Xia , Mengxian Hu , Chenpeng Yao , Chengju Liu , Yang Tang , Qijun Chen

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

机器人学 · 计算机科学 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Recently, numerous algorithms have been developed to tackle the problem of vision-language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply…

计算机视觉与模式识别 · 计算机科学 2021-03-08 Hanqing Wang , Wenguan Wang , Wei Liang , Caiming Xiong , Jianbing Shen

Vision-and-Language Navigation (VLN) aims to enable an embodied agent to follow natural-language instructions and navigate to a target location in unseen 3D environments. We argue that adapting VLMs to VLN requires endowing them with two…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Pengna Li , Kangyi Wu , Shaoqing Xu , Fang Li , Hanbing Li , Lin Zhao , Kailin Lyu , Long Chen , Zhi-Xin Yang , Nanning Zheng

Recent advances in vision-language navigation (VLN) were mainly attributed to emerging large language models (LLMs). These methods exhibited excellent generalization capabilities in instruction understanding and task reasoning. However,…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Xiangyu Dong , Haoran Zhao , Jiang Gao , Haozhou Li , Xiaoguang Ma , Yaoming Zhou , Fuhai Chen , Juan Liu

Vision-and-Language Navigation (VLN) is a cornerstone of embodied intelligence. However, current agents often suffer from significant performance degradation when transitioning from simulation to real-world deployment, primarily due to…

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

人工智能 · 计算机科学 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

For intelligent quadcopter UAVs, a robust and reliable autonomous planning system is crucial. Most current trajectory planning methods for UAVs are suitable for static environments but struggle to handle dynamic obstacles, which can pose…

机器人学 · 计算机科学 2023-12-29 Jiageng Zhong , Ming Li , Yinliang Chen , Zihang Wei , Fan Yang , Haoran Shen

Vision-Language Models (VLMs) have been increasingly integrated into object navigation tasks for their rich prior knowledge and strong reasoning abilities. However, applying VLMs to navigation poses two key challenges: effectively…

机器人学 · 计算机科学 2025-09-17 Haokun Zhu , Zongtai Li , Zhixuan Liu , Wenshan Wang , Ji Zhang , Jonathan Francis , Jean Oh

Vision-language Navigation (VLN) requires an agent to understand visual observations and language instructions to navigate in unseen environments. Most existing approaches rely on static scene assumptions and struggle to generalize in…

机器人学 · 计算机科学 2026-03-24 Xiangchen Liu , Hanghan Zheng , Jeil Jeong , Minsung Yoon , Lin Zhao , Zhide Zhong , Haoang Li , Sung-Eui Yoon

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of…

机器人学 · 计算机科学 2025-12-02 Nivedan Yakolli , Avinash Gautam , Abhijit Das , Yuankai Qi , Virendra Singh Shekhawat