中文
相关论文

相关论文: NavOne: One-Step Global Planning for Vision-Langua…

200 篇论文

Core to the vision-and-language navigation (VLN) challenge is building robust instruction representations and action decoding schemes, which can generalize well to previously unseen instructions and environments. In this paper, we report…

计算与语言 · 计算机科学 2019-09-06 Xiujun Li , Chunyuan Li , Qiaolin Xia , Yonatan Bisk , Asli Celikyilmaz , Jianfeng Gao , Noah Smith , Yejin Choi

Recent applications of deep learning to navigation have generated end-to-end navigation solutions whereby visual sensor input is mapped to control signals or to motion primitives. The resulting visual navigation strategies work very well at…

机器人学 · 计算机科学 2018-01-17 Justin S. Smith , Jin-Ha Hwang , Fu-Jen Chu , Patricio A. Vela

Large Vision-Language Models (VLMs) face an inherent contradiction in image captioning: their powerful single-step generation capabilities often lead to a myopic decision-making process. This makes it difficult to maintain global narrative…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Jusheng Zhang , Kaitong Cai , Jing Yang , Jian Wang , Chengpei Tang , Keze Wang

Vision-Language Navigation (VLN) agents often struggle with long-horizon reasoning in unseen environments, particularly when facing ambiguous, coarse-grained instructions. While recent advances use knowledge graph to enhance reasoning, the…

机器人学 · 计算机科学 2026-03-02 Haoxuan Xu , Tianfu Li , Wenbo Chen , Yi Liu , Xingxing Zuo , Yaoxian Song , Haoang Li

Vision-and-language navigation (VLN) enables the agent to navigate to a remote location following the natural language instruction in 3D environments. At each navigation step, the agent selects from possible candidate locations and then…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Zihan Wang , Xiangyang Li , Jiahao Yang , Yeqi Liu , Junjie Hu , Ming Jiang , Shuqiang Jiang

In vision-and-language navigation (VLN), an embodied agent is required to navigate in realistic 3D environments following natural language instructions. One major bottleneck for existing VLN approaches is the lack of sufficient training…

计算机视觉与模式识别 · 计算机科学 2022-08-26 Shizhe Chen , Pierre-Louis Guhur , Makarand Tapaswi , Cordelia Schmid , Ivan Laptev

Vision-and-Language Navigation (VLN) requires agents to follow long-horizon instructions and navigate complex 3D environments. However, existing approaches face two major challenges: constructing an effective long-term memory bank and…

机器人学 · 计算机科学 2026-03-27 Zihao Xin , Wentong Li , Yixuan Jiang , Bin Wang , Runmin Cong , Jie Qin , Shengjun Huang

In this work, we reconceptualize autonomous driving as a generalized language problem and formulate the trajectory planning task as next waypoint prediction. We introduce Max-V1, a novel framework for one-stage end-to-end autonomous…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Sheng Yang , Tong Zhan , Guancheng Chen , Yanfeng Lu , Jian Wang

Existing aerial Vision-Language Navigation (VLN) methods predominantly adopt a detection-and-planning pipeline, which converts open-vocabulary detections into discrete textual scene graphs. These approaches are plagued by inadequate spatial…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Haoyu Tong , Xiangyu Dong , Xiaoguang Ma , Haoran Zhao , Yaoming Zhou , Chenghao Lin

Aerial navigation is a fundamental yet underexplored capability in embodied intelligence, enabling agents to operate in large-scale, unstructured environments where traditional navigation paradigms fall short. However, most existing…

机器人学 · 计算机科学 2025-08-25 Jianqiang Xiao , Yuexuan Sun , Yixin Shao , Boxi Gan , Rongqiang Liu , Yanjing Wu , Weili Guan , Xiang Deng

Unmanned Aerial Vehicle (UAV) Vision-and-Language Navigation (VLN) is vital for applications such as disaster response, logistics delivery, and urban inspection. However, existing methods often struggle with insufficient multimodal fusion,…

Vision-and-Language Navigation (VLN) requires agents to accurately perceive complex visual environments and reason over navigation instructions and histories. However, existing methods passively process redundant visual inputs and treat all…

机器人学 · 计算机科学 2026-03-17 Wei Xue , Mingcheng Li , Xuecheng Wu , Jingqun Tang , Dingkang Yang , Lihua Zhang

While large vision-language models (VLMs) show promise for object goal navigation, current methods still struggle with low success rates and inefficient localization of unseen objects--failures primarily attributed to weak temporal-spatial…

机器人学 · 计算机科学 2026-02-11 Zixuan Wang , Huang Fang , Shaoan Wang , Yuanfei Luo , Heng Dong , Wei Li , Yiming Gan

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Humans' innate ability to decompose scenes into objects allows for efficient understanding, predicting, and planning. In light of this, Object-Centric Learning (OCL) attempts to endow networks with similar capabilities, learning to…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Junhong Zou , Xiangyu Zhu , Zhaoxiang Zhang , Zhen Lei

Existing vision-and-language navigation (VLN) models primarily reason over past and current visual observations, while largely ignoring the future visual dynamics induced by actions. As a result, they often lack an effective understanding…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Haihong Hao , Lei Chen , Mingfei Han , Changlin Li , Dong An , Yuqiang Yang , Zhihui Li , Xiaojun Chang

Although large language models (LLMs) are introduced into vision-and-language navigation (VLN) to improve instruction comprehension and generalization, existing LLM- based VLN lacks the ability to selectively recall and use relevant priori…

人工智能 · 计算机科学 2026-03-10 Haozhou Li , Xiangyu Dong , Huiyan Jiang , Yaoming Zhou , Xiaoguang Ma

Despite extensive developments in motion planning of autonomous aerial vehicles (AAVs), existing frameworks faces the challenges of local minima and deadlock in complex dynamic environments, leading to increased collision risks. To address…

机器人学 · 计算机科学 2026-05-29 Junzhi Li , Teng Long , Jingliang Sun , Jianxin Zhong

An emerging paradigm in vision-and-language navigation (VLN) is the use of history-aware multi-modal transformer models. Given a language instruction, these models process observation and navigation history to predict the most appropriate…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Dongwoo Kang , Akhil Perincherry , Zachary Coalson , Aiden Gabriel , Stefan Lee , Sanghyun Hong

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding,…

机器人学 · 计算机科学 2026-03-19 Zihao Xin , Wentong Li , Yixuan Jiang , Ziyuan Huang , Bin Wang , Piji Li , Jianke Zhu , Jie Qin , Shengjun Huang