中文
相关论文

相关论文: See, Point, Fly: A Learning-Free VLM Framework for…

200 篇论文

Vision-and-Language Navigation (VLN) refers to the task of enabling autonomous robots to navigate unfamiliar environments by following natural language instructions. While recent Large Vision-Language Models (LVLMs) have shown promise in…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Vebjørn Haug Kåsene , Pierre Lison

Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliable motion toward it. Existing systems remain limited in real…

机器人学 · 计算机科学 2026-03-19 Zhongyuang Liu , Min He , Shaonan Yu , Xinhang Xu , Muqing Cao , Jianping Li , Jianfei Yang , Lihua Xie

For intelligent quadcopter UAVs, a robust and reliable autonomous planning system is crucial. Most current trajectory planning methods for UAVs are suitable for static environments but struggle to handle dynamic obstacles, which can pose…

机器人学 · 计算机科学 2023-12-29 Jiageng Zhong , Ming Li , Yinliang Chen , Zihang Wei , Fan Yang , Haoran Shen

In the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle 'off the path' scenarios where an agent veers from a reference…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Sonia Raychaudhuri , Saim Wani , Shivansh Patel , Unnat Jain , Angel X. Chang

In this paper, we propose a training-free framework for vision-and-language navigation (VLN). Existing zero-shot VLN methods are mainly designed for discrete environments or involve unsupervised training in continuous simulator…

机器人学 · 计算机科学 2025-09-15 Hang Yin , Haoyu Wei , Xiuwei Xu , Wenxuan Guo , Jie Zhou , Jiwen Lu

Object Goal Navigation (ObjectNav) challenges robots to find objects in unseen environments, demanding sophisticated reasoning. While Vision-Language Models (VLMs) show potential, current ObjectNav methods often employ them superficially,…

机器人学 · 计算机科学 2025-06-23 Mobin Habibpour , Fatemeh Afghah

Navigating to a specified object in an unknown environment is a fundamental yet challenging capability of embodied intelligence. However, current methods struggle to balance decision frequency with intelligence, resulting in decisions…

We present VLMnav, an embodied framework to transform a Vision-Language Model (VLM) into an end-to-end navigation policy. In contrast to prior work, we do not rely on a separation between perception, planning, and control; instead, we use a…

机器人学 · 计算机科学 2024-11-11 Dylan Goetting , Himanshu Gaurav Singh , Antonio Loquercio

While recent large vision-language models (VLMs) have improved generalization in vision-language navigation (VLN), existing methods typically rely on end-to-end pipelines that map vision-language inputs directly to short-horizon discrete…

Aerial vision-and-language navigation (VLN), requiring drones to interpret natural language instructions and navigate complex urban environments, emerges as a critical embodied AI challenge that bridges human-robot interaction, 3D spatial…

机器人学 · 计算机科学 2025-12-29 Weichen Zhang , Chen Gao , Shiquan Yu , Ruiying Peng , Baining Zhao , Qian Zhang , Jinqiang Cui , Xinlei Chen , Yong Li

Object goal navigation is a fundamental task in embodied AI, where an agent is instructed to locate a target object in an unexplored environment. Traditional learning-based methods rely heavily on large-scale annotated data or require…

机器人学 · 计算机科学 2025-06-05 Arnab Debnath , Gregory J. Stein , Jana Kosecka

Natural language instructions for visual navigation often use scene descriptions (e.g., "bedroom") and object references (e.g., "green chairs") to provide a breadcrumb trail to a goal location. This work presents a transformer-based…

计算机视觉与模式识别 · 计算机科学 2021-10-28 Abhinav Moudgil , Arjun Majumdar , Harsh Agrawal , Stefan Lee , Dhruv Batra

This paper presents a novel approach for the Vision-and-Language Navigation (VLN) task in continuous 3D environments, which requires an autonomous agent to follow natural language instructions in unseen environments. Existing end-to-end…

Recent embodied navigation approaches leveraging Vision-Language Models (VLMs) demonstrate strong generalization in versatile Vision-Language Navigation (VLN). However, reliable path planning in complex environments remains challenging due…

机器人学 · 计算机科学 2026-03-11 Jiahang Liu , Tianyu Xu , Jiawei Chen , Lu Yue , Jiazhao Zhang , Zhiyong Wang , Minghan Li , Qisheng Zhao , Anqi Li , Qi Su , Zhizheng Zhang , He Wang

We present DyNaVLM, an end-to-end vision-language navigation framework using Vision-Language Models (VLM). In contrast to prior methods constrained by fixed angular or distance intervals, our system empowers agents to freely select…

机器人学 · 计算机科学 2025-06-19 Zihe Ji , Huangxuan Lin , Yue Gao

Vision-Language Navigation (VLN) requires an embodied agent to navigate complex environments by following natural language instructions, which typically demands tight fusion of visual and language modalities. Existing VLN methods often…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Daojie Peng , Fulong Ma , Jun Ma

Conventional approaches to vision-and-language navigation (VLN) are trained end-to-end but struggle to perform well in freely traversable environments. Inspired by the robotics community, we propose a modular approach to VLN using…

机器人学 · 计算机科学 2020-12-11 Kevin Chen , Junshen K. Chen , Jo Chuang , Marynel Vázquez , Silvio Savarese

With the rapid advancement of Large Language Models (LLMs), their capabilities in various automation domains, particularly Unmanned Aerial Vehicle (UAV) operations, have garnered increasing attention. Current research remains predominantly…

机器人学 · 计算机科学 2025-10-28 Liangqi Yuan , Chuhao Deng , Dong-Jun Han , Inseok Hwang , Sabine Brunswicker , Christopher G. Brinton

Although learning-based vision-and-language navigation (VLN) agents can learn spatial knowledge implicitly from large-scale training data, zero-shot VLN agents lack this process, relying primarily on local observations for navigation, which…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Jiwen Zhang , Zejun Li , Siyuan Wang , Xiangyu Shi , Zhongyu Wei , Qi Wu

Existing vision-and-language navigation (VLN) models primarily reason over past and current visual observations, while largely ignoring the future visual dynamics induced by actions. As a result, they often lack an effective understanding…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Haihong Hao , Lei Chen , Mingfei Han , Changlin Li , Dong An , Yuqiang Yang , Zhihui Li , Xiaojun Chang