中文
相关论文

相关论文: ReasonNavi: Human-Inspired Global Map Reasoning fo…

200 篇论文

Delivering intelligent and adaptive navigation assistance in augmented reality (AR) requires more than visual cues, as it demands systems capable of interpreting flexible user intent and reasoning over both spatial and semantic context.…

人机交互 · 计算机科学 2025-08-26 Hsuan-Kung Yang , Tsu-Ching Hsiao , Ryoichiro Oka , Ryuya Nishino , Satoko Tofukuji , Norimasa Kobori

Embodied navigation that adheres to social norms remains an open research challenge. Our SocialNav is a foundational model for socially-aware navigation with a hierarchical "brain-action" architecture, capable of understanding high-level…

With the rapid progress of foundation models and robotics, vision-language navigation (VLN) has emerged as a key task for embodied agents with broad practical applications. We address VLN in continuous environments, a particularly…

机器人学 · 计算机科学 2025-09-26 Boqi Li , Siyuan Li , Weiyi Wang , Anran Li , Zhong Cao , Henry X. Liu

Mobile agentic AI is extending autonomous capabilities to resource-constrained platforms such as edge robots and unmanned aerial vehicles (UAVs), where strict size, weight, power, and cost (SWAP-C) constraints and intermittent wireless…

分布式、并行与集群计算 · 计算机科学 2026-03-09 Guangyuan Liu , Changyuan Zhao , Yinqiu Liu , Dusit Niyato , Biplab Sikdar

Goal-conditioned policies for robotic navigation can be trained on large, unannotated datasets, providing for good generalization to real-world settings. However, particularly in vision-based settings where specifying goals requires an…

机器人学 · 计算机科学 2022-07-27 Dhruv Shah , Blazej Osinski , Brian Ichter , Sergey Levine

Autonomous navigation in unknown environments requires multi-scale spatial understanding that captures geometric details, topological connectivity, and global structure to support high-level decision making under partial observability.…

机器人学 · 计算机科学 2026-04-22 Kuankuan Sima , Longbin Tang , Zhenyu Yang , Haozhe Ma , Lin Zhao

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

While recent large vision-language models (VLMs) have improved generalization in vision-language navigation (VLN), existing methods typically rely on end-to-end pipelines that map vision-language inputs directly to short-horizon discrete…

Object goal navigation (ObjectNav) is a fundamental task in embodied AI, requiring an agent to locate a target object in previously unseen environments. This task is particularly challenging because it requires both perceptual and cognitive…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Yihan Cao , Jiazhao Zhang , Zhinan Yu , Shuzhen Liu , Zheng Qin , Qin Zou , Bo Du , Kai Xu

Embodied navigation in open, dynamic environments demands accurate foresight of how the world will evolve and how actions will unfold over time. We propose AstraNav-World, an end-to-end world model that jointly reasons about future visual…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Jintao Chen , Junjun Hu , Haochen Bai , Minghua Luo , Xinda Xue , Botao Ren , Chengyu Bai , Shichao Xie , Ziyi Chen , Fei Liu , Zedong Chu , Xiaolong Wu , Mu Xu , Shanghang Zhang

We deal with the navigation problem where the agent follows natural language instructions while observing the environment. Focusing on language understanding, we show the importance of spatial semantics in grounding navigation instructions…

计算与语言 · 计算机科学 2021-05-17 Yue Zhang , Quan Guo , Parisa Kordjamshidi

Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However,…

机器人学 · 计算机科学 2026-03-05 Hongyu Song , Rishabh Dev Yadav , Cheng Guo , Wei Pan

The realization of Artificial General Intelligence (AGI) necessitates Embodied AI agents capable of robust spatial perception, effective task planning, and adaptive execution in physical environments. However, current large language models…

How should an agent decide when and how to plan? A dominant approach builds agents as reactive policies with adaptive computation (e.g., chain-of-thought), trained end-to-end expecting planning to emerge implicitly. Without control over the…

Large Vision-Language Models (LVLMs) have demonstrated strong reasoning capabilities in geo-localization, yet they often struggle in real-world scenarios where visual cues are sparse, long-tailed, and highly ambiguous. Previous approaches,…

人工智能 · 计算机科学 2026-03-03 Furong Jia , Ling Dai , Wenjin Deng , Fan Zhang , Chen Hu , Daxin Jiang , Yu Liu

Embodied Visual Reasoning (EVR) seeks to follow complex, free-form instructions based on egocentric video, enabling semantic understanding and spatiotemporal reasoning in dynamic environments. Despite its promising potential, EVR encounters…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Kailing Li , Qi'ao Xu , Tianwen Qian , Yuqian Fu , Yang Jiao , Xiaoling Wang

We present a novel approach to automatically synthesize "wayfinding instructions" for an embodied robot agent. In contrast to prior approaches that are heavily reliant on human-annotated datasets designed exclusively for specific simulation…

机器人学 · 计算机科学 2024-04-03 Vishnu Sashank Dorbala , Sanjoy Chowdhury , Dinesh Manocha

Autonomous navigation guided by natural language instructions is essential for improving human-robot interaction and enabling complex operations in dynamic environments. While large language models (LLMs) are not inherently designed for…

机器人学 · 计算机科学 2024-12-04 Pranav Doma , Aliasghar Arab , Xuesu Xiao

We introduce HY-Embodied-0.5, a family of foundation models specifically designed for real-world embodied agents. To bridge the gap between general Vision-Language Models (VLMs) and the demands of embodied agents, our models are developed…

Zero-shot object navigation (ZSON) in unseen environments remains a challenging problem for household robots, requiring strong perceptual understanding and decision-making capabilities. While recent methods leverage metric maps and Large…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Qunchao Jin , Yilin Wu , Changhao Chen