English
Related papers

Related papers: MapExRL: Human-Inspired Indoor Exploration with Pr…

200 papers

The increasing demand for autonomous systems in complex and dynamic environments has driven significant research into intelligent path planning methodologies. For decades, graph-based search algorithms, linear programming techniques, and…

Autonomous robotic exploration of unknown and hazardous environments, a long-standing challenge, can be significantly improved by leveraging the advanced reasoning of Vision-Language Models (VLMs). We introduce a novel exploration pipeline…

Robotics · Computer Science 2026-05-25 Aarush Aitha , Avideh Zakhor

We consider the problem of indoor building-scale social navigation, where the robot must reach a point goal as quickly as possible without colliding with humans who are freely moving around. Factors such as varying crowd densities,…

Robotics · Computer Science 2025-06-04 Arnab Debnath , Gregory J. Stein , Jana Kosecka

At the heart of path-planning methods for autonomous robotic exploration is a heuristic which encourages exploring unknown regions of the environment. Such heuristics are typically computed using frontier-based or information-theoretic…

Robotics · Computer Science 2020-11-11 Di Deng , Runlin Duan , Jiahong Liu , Kuangjie Sheng , Kenji Shimada

This paper investigates exploration strategies of Deep Reinforcement Learning (DRL) methods to learn navigation policies for mobile robots. In particular, we augment the normal external reward for training DRL algorithms with intrinsic…

Robotics · Computer Science 2018-05-15 Oleksii Zhelo , Jingwei Zhang , Lei Tai , Ming Liu , Wolfram Burgard

Planning a path for a mobile robot typically requires building a map (e.g., an occupancy grid) of the environment as the robot moves around. While navigating in an unknown environment, the map built by the robot online may have many…

Robotics · Computer Science 2023-08-04 Vishnu Dutt Sharma , Jingxi Chen , Pratap Tokekar

Autonomous exploration is an essential capability for mobile robots, as the majority of their applications require the ability to efficiently collect information about their surroundings. In the literature, there are several approaches,…

Robotics · Computer Science 2022-06-27 Lorenzo Gentilini , Dario Mengoli , Lorenzo Marconi

Model-free continuous control for robot navigation tasks using Deep Reinforcement Learning (DRL) that relies on noisy policies for exploration is sensitive to the density of rewards. In practice, robots are usually deployed in cluttered…

Robotics · Computer Science 2023-02-24 Mingyu Cai , Erfan Aasi , Calin Belta , Cristian-Ioan Vasile

A variety of autonomous navigation algorithms exist that allow robots to move around in a safe and fast manner. However, many of these algorithms require parameter re-tuning when facing new environments. In this paper, we propose PTDRL, a…

Robotics · Computer Science 2023-06-21 Elias Goldsztejn , Tal Feiner , Ronen Brafman

In this paper, we present an autonomous navigation system for goal-driven exploration of unknown environments through deep reinforcement learning (DRL). Points of interest (POI) for possible navigation directions are obtained from the…

Robotics · Computer Science 2021-09-10 Reinis Cimurs , Il Hong Suh , Jin Han Lee

Many potential applications of reinforcement learning (RL) are stymied by the large numbers of samples required to learn an effective policy. This is especially true when applying RL to real-world control tasks, e.g. in the sciences or…

Machine Learning · Computer Science 2022-10-11 Viraj Mehta , Ian Char , Joseph Abbate , Rory Conlin , Mark D. Boyer , Stefano Ermon , Jeff Schneider , Willie Neiswanger

We address the problem of efficient 3-D exploration in indoor environments for micro aerial vehicles with limited sensing capabilities and payload/power constraints. We develop an indoor exploration framework that uses learning to predict…

Robotics · Computer Science 2023-08-15 Yuezhan Tao , Yuwei Wu , Beiming Li , Fernando Cladera , Alex Zhou , Dinesh Thakur , Vijay Kumar

Path planning in high-dimensional spaces poses significant challenges, particularly in achieving both time efficiency and a fair success rate. To address these issues, we introduce a novel path-planning algorithm, Zonal RL-RRT, that…

Robotics · Computer Science 2024-11-01 AmirMohammad Tahmasbi , MohammadSaleh Faghfoorian , Saeed Khodaygan , Aniket Bera

In this paper, we address the challenge of exploring unknown indoor aerial environments using autonomous aerial robots with Size Weight and Power (SWaP) constraints. The SWaP constraints induce limits on mission time requiring efficiency in…

Being able to explore unknown environments is a requirement for fully autonomous robots. Many learning-based methods have been proposed to learn an exploration strategy. In the frontier-based exploration, learning algorithms tend to learn…

Robotics · Computer Science 2021-06-18 Zhaoting Li , Tingguang Li , Jiankun Wang , Max Q. -H. Meng

Autonomous navigation is an essential capability of smart mobility for mobile robots. Traditional methods must have the environment map to plan a collision-free path in workspace. Deep reinforcement learning (DRL) is a promising technique…

Robotics · Computer Science 2019-04-23 Liulong Ma , Yanjie Liu , Jiao Chen , Dong Jin

Humans are expert explorers. Understanding the computational cognitive mechanisms that support this efficiency can advance the study of the human mind and enable more efficient exploration algorithms. We hypothesize that humans explore new…

Machine Learning · Computer Science 2022-03-21 Sugandha Sharma , Aidan Curtis , Marta Kryven , Josh Tenenbaum , Ila Fiete

Robot exploration aims at the reconstruction of unknown environments, and it is important to achieve it with shorter paths. Traditional methods focus on optimizing the visiting order of frontiers based on current observations, which may…

Robotics · Computer Science 2025-10-09 Kun Song , Gaoming Chen , Masayoshi Tomizuka , Wei Zhan , Zhenhua Xiong , Mingyu Ding

Many robotic exploration algorithms rely on graph structures for frontier-based exploration and dynamic path planning. However, these graphs grow rapidly, accumulating redundant information and impacting performance. We present a…

Robotics · Computer Science 2026-04-21 Adithya V. Sastry , Bibek Poudel , Weizi Li

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao