English
Related papers

Related papers: No RL, No Simulation: Learning to Navigate without…

200 papers

Efficiently adapting to new environments and changes in dynamics is critical for agents to successfully operate in the real world. Reinforcement learning (RL) based approaches typically rely on external reward feedback for adaptation.…

Machine Learning · Computer Science 2019-03-05 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Jie Tan , Chelsea Finn

We propose a learning-based navigation system for reaching visually indicated goals and demonstrate this system on a real mobile robot platform. Learning provides an appealing alternative to conventional methods for robotic navigation:…

Robotics · Computer Science 2022-10-11 Dhruv Shah , Benjamin Eysenbach , Gregory Kahn , Nicholas Rhinehart , Sergey Levine

Autonomous navigation consists in an agent being able to navigate without human intervention or supervision, it affects both high level planning and low level control. Navigation is at the crossroad of multiple disciplines, it combines…

Robotics · Computer Science 2020-11-24 Maxime Pietrantoni , Boris Chidlovskii , Tomi Silander

Learning effective visuomotor policies for robots purely from data is challenging, but also appealing since a learning-based system should not require manual tuning or calibration. In the case of a robot operating in a real environment the…

Robotics · Computer Science 2018-10-12 Homanga Bharadhwaj , Zihan Wang , Yoshua Bengio , Liam Paull

Reinforcement learning (RL), particularly in sparse reward settings, often requires prohibitively large numbers of interactions with the environment, thereby limiting its applicability to complex problems. To address this, several prior…

Machine Learning · Computer Science 2020-11-20 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

Robotic navigation in environments shared with other robots or humans remains challenging because the intentions of the surrounding agents are not directly observable and the environment conditions are continuously changing. Local…

Robotics · Computer Science 2021-03-01 Bruno Brito , Michael Everett , Jonathan P. How , Javier Alonso-Mora

Humans are known to construct cognitive maps of their everyday surroundings using a variety of perceptual inputs. As such, when a human is asked for directions to a particular location, their wayfinding capability in converting this…

Robotics · Computer Science 2020-11-03 Vishnu Sashank Dorbala , Arjun Srinivasan , Aniket Bera

Deep reinforcement learning (RL) has brought many successes for autonomous robot navigation. However, there still exists important limitations that prevent real-world use of RL-based navigation systems. For example, most learning approaches…

Robotics · Computer Science 2023-06-28 Zifan Xu , Bo Liu , Xuesu Xiao , Anirudh Nair , Peter Stone

Navigation is one of the most heavily studied problems in robotics, and is conventionally approached as a geometric mapping and planning problem. However, real-world navigation presents a complex set of physical challenges that defies…

Robotics · Computer Science 2022-12-14 Sergey Levine , Dhruv Shah

Agents navigating in 3D environments require some form of memory, which should hold a compact and actionable representation of the history of observations useful for decision taking and planning. In most end-to-end learning approaches the…

Robotics · Computer Science 2023-10-02 Guillaume Bono , Leonid Antsfeld , Assem Sadek , Gianluca Monaci , Christian Wolf

Maritime autonomous transportation has played a crucial role in the globalization of the world economy. Deep Reinforcement Learning (DRL) has been applied to automatic path planning to simulate vessel collision avoidance situations in open…

Artificial Intelligence · Computer Science 2021-06-29 Nader Zare , Bruno Brandoli , Mahtab Sarvmaili , Amilcar Soares , Stan Matwin

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

Supervised learning is widely used in training autonomous driving vehicle. However, it is trained with large amount of supervised labeled data. Reinforcement learning can be trained without abundant labeled data, but we cannot train it in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Nayun Xu , Bowen Tan , Bingyu Kong

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

Recent image-goal navigation (ImageNav) methods learn a perception-action policy by separately capturing semantic features of the goal and egocentric images, then passing them to a policy network. However, challenges remain: (1) Semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zheng Qin , Le Wang , Yabing Wang , Sanping Zhou , Gang Hua , Wei Tang

In reinforcement learning for visual navigation, it is common to develop a model for each new task, and train that model from scratch with task-specific interactions in 3D environments. However, this process is expensive; massive amounts of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Ziad Al-Halah , Santhosh K. Ramakrishnan , Kristen Grauman

Autonomous Surface Vehicles (ASVs) play a crucial role in maritime operations, yet their navigation in shallow-water environments remains challenging due to dynamic disturbances and depth constraints. Traditional navigation strategies…

There is an increasing demand for using Unmanned Aerial Vehicle (UAV), known as drones, in different applications such as packages delivery, traffic monitoring, search and rescue operations, and military combat engagements. In all of these…

Robotics · Computer Science 2022-08-29 Fadi AlMahamid , Katarina Grolinger

Images are a convenient way to specify which particular object instance an embodied agent should navigate to. Solving this task requires semantic visual reasoning and exploration of unknown environments. We present a system that can perform…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jacob Krantz , Theophile Gervet , Karmesh Yadav , Austin Wang , Chris Paxton , Roozbeh Mottaghi , Dhruv Batra , Jitendra Malik , Stefan Lee , Devendra Singh Chaplot

Autonomous navigation based on precise localization has been widely developed in both academic research and practical applications. The high demand for localization accuracy has been essential for safe robot planing and navigation while it…

Robotics · Computer Science 2019-06-07 Huifang Ma , Yue Wang , Li Tang , Sarath Kodagoda , Rong Xiong