English
Related papers

Related papers: PanoNav: Mapless Zero-Shot Object Navigation with …

200 papers

The advancement of robotics and autonomous navigation systems hinges on the ability to accurately predict terrain traversability. Traditional methods for generating datasets to train these prediction models often involve putting robots into…

Robotics · Computer Science 2025-10-21 Shreya Gummadi , Mateus V. Gasparino , Gianluca Capezzuto , Marcelo Becker , Girish Chowdhary

With the rapid progress of foundation models and robotics, vision-language navigation (VLN) has emerged as a key task for embodied agents with broad practical applications. We address VLN in continuous environments, a particularly…

Robotics · Computer Science 2025-09-26 Boqi Li , Siyuan Li , Weiyi Wang , Anran Li , Zhong Cao , Henry X. Liu

Zero-Shot Object Navigation (ZSON) requires agents to navigate to objects specified via open-ended natural language without predefined categories or prior environmental knowledge. While recent methods leverage foundation models or…

Robotics · Computer Science 2025-09-19 Ruimeng Liu , Xinhang Xu , Shenghai Yuan , Lihua Xie

Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However,…

Robotics · Computer Science 2026-03-05 Hongyu Song , Rishabh Dev Yadav , Cheng Guo , Wei Pan

Multimodal large laboratory models (MLLMs) still struggle with spatial understanding under the dominant perspective-image paradigm, which inherits the narrow field of view of human-like perception. For navigation, robotic search, and 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Changpeng Wang , Xin Lin , Junhan Liu , Yuheng Liu , Zhen Wang , Donglian Qi , Yunfeng Yan , Xi Chen

Zero-Shot Object Goal Navigation (ZS-OGN) enables robots or agents to navigate toward objects of unseen categories without object-specific training. Traditional approaches often leverage categorical semantic information for navigation…

Robotics · Computer Science 2024-11-01 Shuaihang Yuan , Hao Huang , Yu Hao , Congcong Wen , Anthony Tzes , Yi Fang

Recent open-vocabulary robot mapping methods enrich dense geometric maps with pre-trained visual-language features, achieving a high level of detail and guiding robots to find objects specified by open-vocabulary language queries. While the…

Robotics · Computer Science 2026-03-04 Fujing Xie , Sören Schwertfeger , Hermann Blum

Zero-Shot Object Navigation (ZSON) requires agents to autonomously locate and approach unseen objects in unfamiliar environments and has emerged as a particularly challenging task within the domain of Embodied AI. Existing datasets for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Ji Ma , Hongming Dai , Yao Mu , Pengying Wu , Hao Wang , Xiaowei Chi , Yang Fei , Shanghang Zhang , Chang Liu

Semantic reasoning and dynamic planning capabilities are crucial for an autonomous agent to perform complex navigation tasks in unknown environments. It requires a large amount of common-sense knowledge, that humans possess, to succeed in…

Robotics · Computer Science 2024-04-05 Abhinav Rajvanshi , Karan Sikka , Xiao Lin , Bhoram Lee , Han-Pang Chiu , Alvaro Velasquez

Zero-shot object-goal navigation (ZSON) is a challenging problem in robotics that requires a comprehensive understanding of both language and visual observations. Contextual cues from rooms and objects are critical, but their relative…

Robotics · Computer Science 2026-05-20 Taeyun Kim , Alvin Jinsung Choi , Dasol Hong , Hyun Myung

We present MG-Nav (Memory-Guided Navigation), a dual-scale framework for zero-shot visual navigation that unifies global memory-guided planning with local geometry-enhanced control. At its core is the Sparse Spatial Memory Graph (SMG), a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Bo Wang , Jiehong Lin , Chenzhi Liu , Xinting Hu , Yifei Yu , Tianjia Liu , Zhongrui Wang , Xiaojuan Qi

With the increasing presence of service robots and autonomous vehicles in human environments, navigation systems need to evolve beyond simple destination reach to incorporate social awareness. This paper introduces GSON, a novel group-based…

Robotics · Computer Science 2025-07-30 Shangyi Luo , Peng Sun , Ji Zhu , Yuhong Deng , Cunjun Yu , Anxing Xiao , Xueqian Wang

Rapid adaptation in unseen environments is essential for scalable real-world autonomy, yet existing approaches rely on exhaustive exploration or rigid navigation policies that fail to generalize. We present VLN-Zero, a two-phase…

Robotics · Computer Science 2025-09-24 Neel P. Bhatt , Yunhao Yang , Rohan Siva , Pranay Samineni , Daniel Milan , Zhangyang Wang , Ufuk Topcu

Visual Semantic Navigation (VSN) is a fundamental problem in robotics, where an agent must navigate toward a target object in an unknown environment, mainly using visual information. Most state-of-the-art VSN models are trained in…

Understanding how humans leverage semantic knowledge to navigate unfamiliar environments and decide where to explore next is pivotal for developing robots capable of human-like search behaviors. We introduce a zero-shot navigation approach,…

Robotics · Computer Science 2023-12-07 Naoki Yokoyama , Sehoon Ha , Dhruv Batra , Jiuguang Wang , Bernadette Bucher

Mobile robots operating in human-centered environments must generate not only collision-free paths but also trajectories that follow local behavioral conventions. Conventional costmap-based navigation emphasizes geometric feasibility and…

Robotics · Computer Science 2026-05-19 Dongjie Huo , Junhui Wang , Chao Gao , Yan Qiao , Dong Zhang , Guyue Zhou

Visual language navigation (VLN) is an embodied task demanding a wide range of skills encompassing understanding, perception, and planning. For such a multifaceted challenge, previous VLN methods totally rely on one model's own thinking to…

Robotics · Computer Science 2023-09-21 Yuxing Long , Xiaoqi Li , Wenzhe Cai , Hao Dong

Advances in open-vocabulary semantic mapping and object navigation have enabled robots to perform an informed search of their environment for an arbitrary object. However, such zero-shot object navigation is typically designed for simple…

Robotics · Computer Science 2026-03-31 Jesús Ortega-Peimbert , Finn Lukas Busch , Timon Homberger , Quantao Yang , Olov Andersson

The capability to efficiently search for objects in complex environments is fundamental for many real-world robot applications. Recent advances in open-vocabulary vision models have resulted in semantically-informed object navigation…

Robotics · Computer Science 2025-03-04 Finn Lukas Busch , Timon Homberger , Jesús Ortega-Peimbert , Quantao Yang , Olov Andersson

Autonomous navigation in unknown environments requires multi-scale spatial understanding that captures geometric details, topological connectivity, and global structure to support high-level decision making under partial observability.…

Robotics · Computer Science 2026-04-22 Kuankuan Sima , Longbin Tang , Zhenyu Yang , Haozhe Ma , Lin Zhao