English
Related papers

Related papers: CoNav: Collaborative Cross-Modal Reasoning for Emb…

200 papers

Navigating complex indoor environments requires a deep understanding of the space the robotic agent is acting into to correctly inform the navigation process of the agent towards the goal location. In recent learning-based navigation…

Robotics · Computer Science 2023-10-05 Marco Rosano , Antonino Furnari , Luigi Gulino , Corrado Santoro , Giovanni Maria Farinella

Embodied agents are expected to perform object navigation in dynamic, open-world environments. However, existing approaches typically rely on static trajectories and a fixed set of object categories during training, overlooking the…

Robotics · Computer Science 2026-04-07 Ming-Ming Yu , Fei Zhu , Wenzhuo Liu , Yirong Yang , Qunbo Wang , Wenjun Wu , Jing Liu

Autonomous navigation in unknown environments requires multi-scale spatial understanding that captures geometric details, topological connectivity, and global structure to support high-level decision making under partial observability.…

Robotics · Computer Science 2026-04-22 Kuankuan Sima , Longbin Tang , Zhenyu Yang , Haozhe Ma , Lin Zhao

Vision-Language Navigation (VLN) aims to empower robots with the ability to perform long-horizon navigation in unfamiliar environments based on complex linguistic instructions. Its success critically hinges on establishing an efficient…

Robotics · Computer Science 2026-03-04 Ling Luo , Qianqian Bai

Enabling robots to navigate open-world environments via natural language is critical for general-purpose autonomy. Yet, Vision-Language Navigation has relied on end-to-end policies trained on expensive, embodiment-specific robot data. While…

Robotics · Computer Science 2026-03-17 Jie Chen , Yuxin Cai , Yizhuo Wang , Ruofei Bai , Yuhong Cao , Jun Li , Yau Wei Yun , Guillaume Sartoretti

Vision-language navigation requires agents to reason and act under constraints of embodiment. While vision-language models (VLMs) demonstrate strong generalization, current benchmarks provide limited understanding of how embodiment -- i.e.,…

Robotics · Computer Science 2025-12-23 Tin Stribor Sohn , Maximilian Dillitzer , Jason J. Corso , Eric Sax

Mobile robots are increasingly required to navigate and interact within unknown and unstructured environments to meet human demands. Demand-driven navigation (DDN) enables robots to identify and locate objects based on implicit human…

Artificial Intelligence · Computer Science 2025-08-18 Yuehao Huang , Liang Liu , Shuangming Lei , Yukai Ma , Hao Su , Jianbiao Mei , Pengxiang Zhao , Yaqing Gu , Yong Liu , Jiajun Lv

UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous multi-step instructions over long horizons. Existing zero-shot methods remain limited, as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Dian Shao , Zhengzheng Xu , Peiyang Wang , Like Liu , Yule Wang , Jieqi Shi , Jing Huo

Embodied navigation that adheres to social norms remains an open research challenge. Our SocialNav is a foundational model for socially-aware navigation with a hierarchical "brain-action" architecture, capable of understanding high-level…

Large vision-language models (VLMs) show strong multimodal understanding but still struggle with 3D spatial reasoning, such as distance estimation, size comparison, and cross-view consistency. Existing 3D-aware methods either depend on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Ruosen Zhao , Zhikang Zhang , Jialei Xu , Jiahao Chang , Dong Chen , Lingyun Li , Weijian Sun , Zizhuang Wei

Generalizing local navigation policies across diverse robot morphologies is a critical challenge. Progress is often hindered by the need for costly and embodiment-specific data, the tight coupling of planning and control, and the…

Robotics · Computer Science 2025-10-24 Kai Yang , Tianlin Zhang , Zhengbo Wang , Zedong Chu , Xiaolong Wu , Yang Cai , Mu Xu

3D semantic occupancy prediction is a pivotal task in the field of autonomous driving. Recent approaches have made great advances in 3D semantic occupancy predictions on a single modality. However, multi-modal semantic occupancy prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Jingyi Pan , Zipeng Wang , Lin Wang

Multi-agent embodied systems hold promise for complex collaborative manipulation, yet face critical challenges in spatial coordination, temporal reasoning, and shared workspace awareness. Inspired by human collaboration where cognitive…

In audio-visual navigation (AVN) tasks, an embodied agent must autonomously localize a sound source in unknown and complex 3D environments based on audio-visual signals. Existing methods often rely on static modality fusion strategies and…

Artificial Intelligence · Computer Science 2025-09-23 Jia Li , Yinfeng Yu , Liejun Wang , Fuchun Sun , Wendong Zheng

In language-guided visual navigation, agents locate target objects in unseen environments using natural language instructions. For reliable navigation in unfamiliar scenes, agents should possess strong perception, planning, and prediction…

Robotics · Computer Science 2025-08-11 Yufeng Zhong , Chengjian Feng , Feng Yan , Fanfan Liu , Liming Zheng , Lin Ma

Embodied navigation is a fundamental capability of embodied intelligence, enabling robots to move and interact within physical environments. However, existing navigation tasks primarily focus on predefined object navigation or instruction…

Object goal navigation (ObjectNav) in unseen environments is a fundamental task for Embodied AI. Agents in existing works learn ObjectNav policies based on 2D maps, scene graphs, or image sequences. Considering this task happens in 3D…

Robotics · Computer Science 2023-04-03 Jiazhao Zhang , Liu Dai , Fanpeng Meng , Qingnan Fan , Xuelin Chen , Kai Xu , He Wang

Visual target navigation is a critical capability for autonomous robots operating in unknown environments, particularly in human-robot interaction scenarios. While classical and learning-based methods have shown promise, most existing…

Robotics · Computer Science 2025-05-07 Bangguo Yu , Qihao Yuan , Kailai Li , Hamidreza Kasaei , Ming Cao

Text-goal instance navigation (TGIN) asks an agent to resolve a single, free-form description into actions that reach the correct object instance among same-category distractors. We present \textit{Context-Nav}, which elevates long,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Won Shik Jang , Ue-Hwan Kim

Accurate positioning is known to be a fundamental requirement for the deployment of Connected Automated Vehicles (CAVs). To meet this need, a new emerging trend is represented by cooperative methods where vehicles fuse information coming…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Luca Barbieri , Bernardo Camajori Tedeschini , Mattia Brambilla , Monica Nicoli