English
Related papers

Related papers: Navigating to Objects in Unseen Environments by Di…

200 papers

This paper presents an architecture and methodology to empower a service robot to navigate an indoor environment with semantic decision making, given RGB ego view. This method leverages the knowledge of robot's actuation capability and that…

Robotics · Computer Science 2022-10-24 Snehasis Banerjee , Brojeshwar Bhowmick , Ruddra Dev Roychoudhury

Object Goal Navigation-requiring an agent to locate a specific object in an unseen environment-remains a core challenge in embodied AI. Although recent progress in Vision-Language Model (VLM)-based agents has demonstrated promising…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dujun Nie , Xianda Guo , Yiqun Duan , Ruijun Zhang , Long Chen

We propose a robotic learning system for autonomous exploration and navigation in unexplored environments. We are motivated by the idea that even an unseen environment may be familiar from previous experiences in similar environments. The…

Robotics · Computer Science 2022-11-24 Huangying Zhan , Hamid Rezatofighi , Ian Reid

Finding an object of a specific class in an unseen environment remains an unsolved navigation problem. Hence, we propose a hierarchical learning-based method for object navigation. The top-level is capable of high-level planning, and…

Artificial Intelligence · Computer Science 2022-11-17 Matthias Hutsebaut-Buysse , Kevin Mets , Tom De Schepper , Steven Latré

Zero-shot object navigation is a challenging task for home-assistance robots. This task emphasizes visual grounding, commonsense inference and locomotion abilities, where the first two are inherent in foundation models. But for the…

Robotics · Computer Science 2023-09-22 Wenzhe Cai , Siyuan Huang , Guangran Cheng , Yuxing Long , Peng Gao , Changyin Sun , Hao Dong

Object Goal Navigation (ObjectNav) challenges robots to find objects in unseen environments, demanding sophisticated reasoning. While Vision-Language Models (VLMs) show potential, current ObjectNav methods often employ them superficially,…

Robotics · Computer Science 2025-06-23 Mobin Habibpour , Fatemeh Afghah

Mapless navigation has emerged as a promising approach for enabling autonomous robots to navigate in environments where pre-existing maps may be inaccurate, outdated, or unavailable. In this work, we propose an image-based local…

Robotics · Computer Science 2023-10-24 Durgakant Pushp , Zheng Chen , Chaomin Luo , Jason M. Gregory , Lantao Liu

In visual semantic navigation, the robot navigates to a target object with egocentric visual observations and the class label of the target is given. It is a meaningful task inspiring a surge of relevant research. However, most of the…

Artificial Intelligence · Computer Science 2021-09-21 Xinzhu Liu , Di Guo , Huaping Liu , Fuchun Sun

This paper describes a framework for the object-goal navigation task, which requires a robot to find and move to the closest instance of a target object class from a random starting position. The framework uses a history of robot…

Object-goal navigation is a crucial engineering task for the community of embodied navigation; it involves navigating to an instance of a specified object category within unseen environments. Although extensive investigations have been…

Robotics · Computer Science 2025-03-20 Leyuan Sun , Asako Kanezaki , Guillaume Caron , Yusuke Yoshiyasu

Real world visual navigation requires robots to operate in unfamiliar, human-occupied dynamic environments. Navigation around humans is especially difficult because it requires anticipating their future motion, which can be quite…

Robotics · Computer Science 2021-02-16 Varun Tolani , Somil Bansal , Aleksandra Faust , Claire Tomlin

Goal-conditioned policies for robotic navigation can be trained on large, unannotated datasets, providing for good generalization to real-world settings. However, particularly in vision-based settings where specifying goals requires an…

Robotics · Computer Science 2022-07-27 Dhruv Shah , Blazej Osinski , Brian Ichter , Sergey Levine

Model-based control is a popular paradigm for robot navigation because it can leverage a known dynamics model to efficiently plan robust robot trajectories. However, it is challenging to use model-based methods in settings where the…

Robotics · Computer Science 2019-07-19 Somil Bansal , Varun Tolani , Saurabh Gupta , Jitendra Malik , Claire Tomlin

Object navigation (ObjectNav) in real-world environments is a complex problem that requires simultaneously addressing multiple challenges, including complex spatial structure, long-horizon planning and semantic understanding. Recent…

Robotics · Computer Science 2026-03-10 Haokun Zhu , Zongtai Li , Zihan Liu , Kevin Guo , Zhengzhi Lin , Yuxin Cai , Guofei Chen , Chen Lv , Wenshan Wang , Jean Oh , Ji Zhang

Indoor motion planning focuses on solving the problem of navigating an agent through a cluttered environment. To date, quite a lot of work has been done in this field, but these methods often fail to find the optimal balance between…

Robotics · Computer Science 2022-09-20 Shivam Sood , Jaskaran Singh Sodhi , Parv Maheshwari , Karan Uppal , Debashish Chakravarty

Semantic navigation requires an agent to navigate toward a specified target in an unseen environment. Employing an imaginative navigation strategy that predicts future scenes before taking action, can empower the agent to find target…

Robotics · Computer Science 2025-08-12 Yue Hu , Junzhe Wu , Ruihan Xu , Hang Liu , Avery Xi , Henry X. Liu , Ram Vasudevan , Maani Ghaffari

We propose a learning-based navigation system for reaching visually indicated goals and demonstrate this system on a real mobile robot platform. Learning provides an appealing alternative to conventional methods for robotic navigation:…

Robotics · Computer Science 2022-10-11 Dhruv Shah , Benjamin Eysenbach , Gregory Kahn , Nicholas Rhinehart , Sergey Levine

Humans can robustly follow a visual trajectory defined by a sequence of images (i.e. a video) regardless of substantial changes in the environment or the presence of obstacles. We aim at endowing similar visual navigation capabilities to…

Object goal navigation aims to steer an agent towards a target object based on observations of the agent. It is of pivotal importance to design effective visual representations of the observed scene in determining navigation actions. In…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Heming Du , Xin Yu , Liang Zheng

Can the intrinsic relation between an object and the room in which it is usually located help agents in the Visual Navigation Task? We study this question in the context of Object Navigation, a problem in which an agent has to reach an…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Tommaso Campari , Paolo Eccher , Luciano Serafini , Lamberto Ballan