English
Related papers

Related papers: What Matters in RL-Based Methods for Object-Goal N…

200 papers

Robotic systems that rely primarily on self-supervised learning have the potential to decrease the amount of human annotation and engineering effort required to learn control strategies. In the same way that prior robotic systems have…

Machine Learning · Computer Science 2025-06-11 Chongyi Zheng , Benjamin Eysenbach , Homer Walke , Patrick Yin , Kuan Fang , Ruslan Salakhutdinov , Sergey Levine

Solving robotic navigation tasks via reinforcement learning (RL) is challenging due to their sparse reward and long decision horizon nature. However, in many navigation tasks, high-level (HL) task representations, like a rough floor plan,…

Robotics · Computer Science 2021-11-08 Jan Wöhlke , Felix Schmitt , Herke van Hoof

Active perception describes a broad class of techniques that couple planning and perception systems to move the robot in a way to give the robot more information about the environment. In most robotic systems, perception is typically…

Reinforcement Learning (RL) has shown remarkable progress in simulation environments, yet its application to real-world robotic tasks remains limited due to challenges in exploration and generalization. To address these issues, we introduce…

Artificial Intelligence · Computer Science 2024-10-18 Amisha Bhaskar , Zahiruddin Mahammad , Sachin R Jadhav , Pratap Tokekar

Due to recent breakthroughs, reinforcement learning (RL) has demonstrated impressive performance in challenging sequential decision-making problems. However, an open question is how to make RL cope with partial observability which is…

Machine Learning · Computer Science 2021-04-23 Stephan Weigand , Pascal Klink , Jan Peters , Joni Pajarinen

Robots deployed in unstructured human environments must frequently execute long-horizon missions, such as find the mug, then the chair, then the printer, under strict operational constraints. While contemporary zero-shot Object Navigation…

Robotics · Computer Science 2026-05-19 Xi Lin , Jiayi Li , Kangyi Wu , Jiaqiao Tang , Qingrong He , Lin Zhao

For real-world deployments, it is critical to allow robots to navigate in complex environments autonomously. Traditional methods usually maintain an internal map of the environment, and then design several simple rules, in conjunction with…

Robotics · Computer Science 2021-04-16 Yuanyang Zhu , Zhi Wang , Chunlin Chen , Daoyi Dong

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

Training end-to-end policies from image data to directly predict navigation actions for robotic systems has proven inherently difficult. Existing approaches often suffer from either the sim-to-real gap during policy transfer or a limited…

Robotics · Computer Science 2026-03-17 Lazar Milikic , Manthan Patel , Jonas Frey

We solve active target tracking, one of the essential tasks in autonomous systems, using a deep reinforcement learning (RL) approach. In this problem, an autonomous agent is tasked with acquiring information about targets of interests using…

Machine Learning · Computer Science 2020-06-19 Heejin Jeong , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

Object goal navigation aims to navigate an agent to locations of a given object category in unseen environments. Classical methods explicitly build maps of environments and require extensive engineering while lacking semantic information…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Shizhe Chen , Thomas Chabal , Ivan Laptev , Cordelia Schmid

Manipulating objects is a hallmark of human intelligence, and an important task in domains such as robotics. In principle, Reinforcement Learning (RL) offers a general approach to learn object manipulation. In practice, however, domains…

Robotics · Computer Science 2024-04-02 Dan Haramati , Tal Daniel , Aviv Tamar

Autonomous object search is challenging for mobile robots operating in indoor environments due to partial observability, perceptual uncertainty, and the need to trade off exploration and navigation efficiency. Classical probabilistic…

Robotics · Computer Science 2026-03-27 João Castelo-Branco , José Santos-Victor , Alexandre Bernardino

Underwater target localization using range-only and single-beacon (ROSB) techniques with autonomous vehicles has been used recently to improve the limitations of more complex methods, such as long baseline and ultra-short baseline systems.…

Robotics · Computer Science 2023-01-18 Ivan Masmitja , Mario Martin , Kakani Katija , Spartacus Gomariz , Joan Navarro

Autonomous visual navigation is an essential element in robot autonomy. Reinforcement learning (RL) offers a promising policy training paradigm. However existing RL methods suffer from high sample complexity, poor sim-to-real transfer, and…

Robotics · Computer Science 2025-07-31 Qianzhong Chen , Jiankai Sun , Naixiang Gao , JunEn Low , Timothy Chen , Mac Schwager

In this paper, we present an autonomous navigation system for goal-driven exploration of unknown environments through deep reinforcement learning (DRL). Points of interest (POI) for possible navigation directions are obtained from the…

Robotics · Computer Science 2021-09-10 Reinis Cimurs , Il Hong Suh , Jin Han Lee

The advent of deep learning has inspired research into end-to-end learning for a variety of problem domains in robotics. For navigation, the resulting methods may not have the generalization properties desired let alone match the…

Robotics · Computer Science 2021-03-03 Haoxin Ma , Justin S. Smith , Patricio A. Vela

We present a single neural network architecture composed of task-agnostic components (ViTs, convolutions, and LSTMs) that achieves state-of-art results on both the ImageNav ("go to location in <this picture>") and ObjectNav ("find a chair")…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Karmesh Yadav , Arjun Majumdar , Ram Ramrakhya , Naoki Yokoyama , Alexei Baevski , Zsolt Kira , Oleksandr Maksymets , Dhruv Batra

Reinforcement learning can enable robots to navigate to distant goals while optimizing user-specified reward functions, including preferences for following lanes, staying on paved paths, or avoiding freshly mowed grass. However, online…

Robotics · Computer Science 2022-12-19 Dhruv Shah , Arjun Bhorkar , Hrish Leen , Ilya Kostrikov , Nick Rhinehart , Sergey Levine

This paper develops LongNav-R1, an end-to-end multi-turn reinforcement learning (RL) framework designed to optimize Visual-Language-Action (VLA) models for long-horizon navigation. Unlike existing single-turn paradigm, LongNav-R1…

Robotics · Computer Science 2026-02-16 Yue Hu , Avery Xi , Qixin Xiao , Seth Isaacson , Henry X. Liu , Ram Vasudevan , Maani Ghaffari