English
Related papers

Related papers: Object Goal Navigation using Data Regularized Q-Le…

200 papers

This paper addresses the problem of object-goal navigation in autonomous inspections in real-world environments. Object-goal navigation is crucial to enable effective inspections in various settings, often requiring the robot to identify…

This paper studies the problem of image-goal navigation which involves navigating to the location indicated by a goal image in a novel previously unseen environment. To tackle this problem, we design topological representations for space…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Devendra Singh Chaplot , Ruslan Salakhutdinov , Abhinav Gupta , Saurabh Gupta

Object-goal navigation is a crucial engineering task for the community of embodied navigation; it involves navigating to an instance of a specified object category within unseen environments. Although extensive investigations have been…

Robotics · Computer Science 2025-03-20 Leyuan Sun , Asako Kanezaki , Guillaume Caron , Yusuke Yoshiyasu

Object-goal navigation requires mobile robots to efficiently locate targets with visual and spatial information, yet existing methods struggle with generalization in unseen environments. Heuristic approaches with naive metrics fail in…

Robotics · Computer Science 2025-07-22 Mengying Lin , Shugao Liu , Dingxi Zhang , Yaran Chen , Zhaoran Wang , Haoran Li , Dongbin Zhao

Object goal navigation is a fundamental task in embodied AI, where an agent is instructed to locate a target object in an unexplored environment. Traditional learning-based methods rely heavily on large-scale annotated data or require…

Robotics · Computer Science 2025-06-05 Arnab Debnath , Gregory J. Stein , Jana Kosecka

Learning to navigate in complex environments with dynamic elements is an important milestone in developing AI agents. In this work we formulate the navigation question as a reinforcement learning problem and show that data efficiency and…

Goal-conditioned policies for robotic navigation can be trained on large, unannotated datasets, providing for good generalization to real-world settings. However, particularly in vision-based settings where specifying goals requires an…

Robotics · Computer Science 2022-07-27 Dhruv Shah , Blazej Osinski , Brian Ichter , Sergey Levine

Two less addressed issues of deep reinforcement learning are (1) lack of generalization capability to new target goals, and (2) data inefficiency i.e., the model requires several (and often costly) episodes of trial and error to converge,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-19 Yuke Zhu , Roozbeh Mottaghi , Eric Kolve , Joseph J. Lim , Abhinav Gupta , Li Fei-Fei , Ali Farhadi

We study the problem of learning a navigation policy for a robot to actively search for an object of interest in an indoor environment solely from its visual inputs. While scene-driven visual navigation has been widely studied, prior…

Artificial Intelligence · Computer Science 2018-07-31 Xin Ye , Zhe Lin , Haoxiang Li , Shibin Zheng , Yezhou Yang

Image-goal navigation steers an agent to a target location specified by an image in unseen environments. Existing methods primarily handle this task by learning an end-to-end navigation policy, which compares the similarities of target and…

Robotics · Computer Science 2026-04-21 Pengna Li , Kangyi Wu , Shaoqing Xu , Fang Li , Lin Zhao , Long Chen , Zhi-Xin Yang , Nanning Zheng

We consider the problem of learning useful robotic skills from previously collected offline data without access to manually specified rewards or additional online exploration, a setting that is becoming increasingly important for scaling…

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

We present a target-driven navigation system to improve mapless visual navigation in indoor scenes. Our method takes a multi-view observation of a robot and a target as inputs at each time step to provide a sequence of actions that move the…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Xiaoxi Gong , Kai Xu , Dinesh Manocha , Jingxuan Dong , Jun Wang

Object goal visual navigation is a challenging task that aims to guide a robot to find the target object based on its visual observation, and the target is limited to the classes pre-defined in the training stage. However, in real…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Qianfan Zhao , Lu Zhang , Bin He , Hong Qiao , Zhiyong Liu

ObjectGoal Navigation (ObjectNav) is an embodied task wherein agents are to navigate to an object instance in an unseen environment. Prior works have shown that end-to-end ObjectNav agents that use vanilla visual and recurrent modules, e.g.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Joel Ye , Dhruv Batra , Abhishek Das , Erik Wijmans

We propose a learning-based navigation system for reaching visually indicated goals and demonstrate this system on a real mobile robot platform. Learning provides an appealing alternative to conventional methods for robotic navigation:…

Robotics · Computer Science 2022-10-11 Dhruv Shah , Benjamin Eysenbach , Gregory Kahn , Nicholas Rhinehart , Sergey Levine

Images are a convenient way to specify which particular object instance an embodied agent should navigate to. Solving this task requires semantic visual reasoning and exploration of unknown environments. We present a system that can perform…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jacob Krantz , Theophile Gervet , Karmesh Yadav , Austin Wang , Chris Paxton , Roozbeh Mottaghi , Dhruv Batra , Jitendra Malik , Stefan Lee , Devendra Singh Chaplot

We revisit the problem of Object-Goal Navigation (ObjectNav). In its simplest form, ObjectNav is defined as the task of navigating to an object, specified by its label, in an unexplored environment. In particular, the agent is initialized…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Dhruv Batra , Aaron Gokaslan , Aniruddha Kembhavi , Oleksandr Maksymets , Roozbeh Mottaghi , Manolis Savva , Alexander Toshev , Erik Wijmans

We present a robot navigation system that uses an imitation learning framework to successfully navigate in complex environments. Our framework takes a pre-built 3D scan of a real environment and trains an agent from pre-generated expert…

Robotics · Computer Science 2020-09-28 David Watkins-Valls , Jingxi Xu , Nicholas Waytowich , Peter Allen

Enabling robots to autonomously navigate complex environments is essential for real-world deployment. Prior methods approach this problem by having the robot maintain an internal map of the world, and then use a localization and planning…

Machine Learning · Computer Science 2018-05-21 Gregory Kahn , Adam Villaflor , Bosen Ding , Pieter Abbeel , Sergey Levine