中文
相关论文

相关论文: UAV-VLN: End-to-End Vision Language guided Navigat…

200 篇论文

This paper proposes VLA-AN, an efficient and onboard Vision-Language-Action (VLA) framework dedicated to autonomous drone navigation in complex environments. VLA-AN addresses four major limitations of existing large aerial navigation…

机器人学 · 计算机科学 2025-12-22 Yuze Wu , Mo Zhu , Xingxing Li , Yuheng Du , Yuxin Fan , Wenjun Li , Zhichao Han , Xin Zhou , Fei Gao

Visual target navigation in unknown environments is a crucial problem in robotics. Despite extensive investigation of classical and learning-based approaches in the past, robots lack common-sense knowledge about household objects and…

机器人学 · 计算机科学 2023-12-27 Bangguo Yu , Hamidreza Kasaei , Ming Cao

While Vision-Language Models (VLMs) are set to transform robotic navigation, existing methods often underutilize their reasoning capabilities. To unlock the full potential of VLMs in robotics, we shift their role from passive observers to…

机器人学 · 计算机科学 2025-11-13 Mobin Habibpour , Fatemeh Afghah

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

机器人学 · 计算机科学 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

Vision-and-language navigation (VLN) is a challenging task that requires an agent to navigate in real-world environments by understanding natural language instructions and visual information received in real-time. Prior works have…

机器人学 · 计算机科学 2021-01-20 Ting Wang , Zongkai Wu , Donglin Wang

Recent embodied navigation approaches leveraging Vision-Language Models (VLMs) demonstrate strong generalization in versatile Vision-Language Navigation (VLN). However, reliable path planning in complex environments remains challenging due…

机器人学 · 计算机科学 2026-03-11 Jiahang Liu , Tianyu Xu , Jiawei Chen , Lu Yue , Jiazhao Zhang , Zhiyong Wang , Minghan Li , Qisheng Zhao , Anqi Li , Qi Su , Zhizheng Zhang , He Wang

Incremental decision making in real-world environments is one of the most challenging tasks in embodied artificial intelligence. One particularly demanding scenario is Vision and Language Navigation~(VLN) which requires visual and natural…

人工智能 · 计算机科学 2024-01-25 Raphael Schumann , Wanrong Zhu , Weixi Feng , Tsu-Jui Fu , Stefan Riezler , William Yang Wang

Vision-Language Models (VLMs), leveraging their powerful visual perception and reasoning capabilities, have been widely applied in Unmanned Aerial Vehicle (UAV) tasks. However, the spatial intelligence capabilities of existing VLMs in UAV…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Lingfeng Zhang , Yuchen Zhang , Hongsheng Li , Haoxiang Fu , Yingbo Tang , Hangjun Ye , Long Chen , Xiaojun Liang , Xiaoshuai Hao , Wenbo Ding

Visual language navigation (VLN) is an embodied task demanding a wide range of skills encompassing understanding, perception, and planning. For such a multifaceted challenge, previous VLN methods totally rely on one model's own thinking to…

机器人学 · 计算机科学 2023-09-21 Yuxing Long , Xiaoqi Li , Wenzhe Cai , Hao Dong

Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However,…

机器人学 · 计算机科学 2026-03-05 Hongyu Song , Rishabh Dev Yadav , Cheng Guo , Wei Pan

The ability to navigate robots with natural language instructions in an unknown environment is a crucial step for achieving embodied artificial intelligence (AI). With the improving performance of deep neural models proposed in the field of…

机器人学 · 计算机科学 2023-10-11 Guanqi Chen , Lei Yang , Guanhua Chen , Jia Pan

This paper presents a novel approach for the Vision-and-Language Navigation (VLN) task in continuous 3D environments, which requires an autonomous agent to follow natural language instructions in unseen environments. Existing end-to-end…

Autonomous drones capable of interpreting and executing high-level language instructions in unstructured environments remain a long-standing goal. Yet existing approaches are constrained by their dependence on hand-crafted skills, extensive…

机器人学 · 计算机科学 2026-05-19 Qianzhong Chen , Naixiang Gao , Suning Huang , JunEn Low , Timothy Chen , Jiankai Sun , Mac Schwager

While recent large vision-language models (VLMs) have improved generalization in vision-language navigation (VLN), existing methods typically rely on end-to-end pipelines that map vision-language inputs directly to short-horizon discrete…

Vision-and-Language Navigation (VLN) requires an agent to interpret natural language instructions and navigate complex environments. Current approaches often adopt a "black-box" paradigm, where a single Large Language Model (LLM) makes…

计算机视觉与模式识别 · 计算机科学 2025-09-11 Chenghao Liu , Zhimu Zhou , Jiachen Zhang , Minghao Zhang , Songfang Huang , Huiling Duan

Recent advances in Iterative Vision-and-Language Navigation (IVLN) introduce a more meaningful and practical paradigm of VLN by maintaining the agent's memory across tours of scenes. Although the long-term memory aligns better with the…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Ganlong Zhao , Guanbin Li , Weikai Chen , Yizhou Yu

Vision-and-Language Navigation (VLN) is a task where an agent navigates in an embodied indoor environment under human instructions. Previous works ignore the distribution of sample difficulty and we argue that this potentially degrade their…

机器学习 · 计算机科学 2021-11-16 Jiwen Zhang , Zhongyu Wei , Jianqing Fan , Jiajie Peng

Vision-Language Navigation (VLN) aims to empower robots with the ability to perform long-horizon navigation in unfamiliar environments based on complex linguistic instructions. Its success critically hinges on establishing an efficient…

机器人学 · 计算机科学 2026-03-04 Ling Luo , Qianqian Bai

Real-world navigation often involves dealing with unexpected obstructions such as closed doors, moved objects, and unpredictable entities. However, mainstream Vision-and-Language Navigation (VLN) tasks typically assume instructions…

机器人学 · 计算机科学 2024-08-01 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu

While Multimodal Large Language Models (MLLMs) have exhibited remarkable general intelligence across diverse domains, their potential in low-altitude applications dominated by Unmanned Aerial Vehicles (UAVs) remains largely underexplored.…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Shiqi Dai , Zizhi Ma , Zhicong Luo , Xuesong Yang , Yibin Huang , Wanyue Zhang , Chi Chen , Zonghao Guo , Wang Xu , Yufei Sun , Maosong Sun