English
Related papers

Related papers: Learning-Augmented Model-Based Planning for Visual…

200 papers

This work presents an innovative solution for robotic odometry, path planning and exploration in wild unknown environments, focusing on digital modelling. The approach uses a minimum cost formulation with pseudo-randomly generated…

Robotics · Computer Science 2024-03-29 Naizhong Zhang. Yaoqiang Pan , Yangwen Jin , Peiqi Jin , Kewei Hu , Xiao Huang , Hanwen Kang

This paper presents a comprehensive overview of exploration strategies utilized in both 2D and 3D environments, focusing on autonomous multi-robot systems designed for building exploration and fire detection. We explore the limitations of…

Robotics · Computer Science 2024-11-26 Ankit Shaw

In this work we consider partially observable environments with sparse rewards. We present a self-supervised representation learning method for image-based observations, which arranges embeddings respecting temporal distance of…

Machine Learning · Computer Science 2020-10-07 Aleksandr Ermolov , Nicu Sebe

Exploration is a crucial and distinctive aspect of reinforcement learning (RL) that remains a fundamental open problem. Several methods have been proposed to tackle this challenge. Commonly used methods inject random noise directly into the…

Machine Learning · Computer Science 2024-11-06 Sebastian Griesbach , Carlo D'Eramo

In this paper we propose a planner for 3D exploration that is suitable for applications using state-of-the-art 3D sensors such as lidars, which produce large point clouds with each scan. The planner is based on the detection of a frontier -…

Robotics · Computer Science 2021-09-15 Ana Batinović , Tamara Petrović , Antun Ivanovic , Frano Petric , Stjepan Bogdan

Reinforcement Learning (RL) agents often struggle in sparse-reward environments where traditional exploration strategies fail to discover effective action sequences. Large Language Models (LLMs) possess procedural knowledge and reasoning…

Machine Learning · Computer Science 2025-10-13 Vaibhav Jain , Gerrit Grossmann

We study the problem of exploration in Reinforcement Learning and present a novel model-free solution. We adopt an information-theoretical viewpoint and start from the instance-specific lower bound of the number of samples that have to be…

Machine Learning · Computer Science 2024-07-02 Alessio Russo , Alexandre Proutiere

In this article, we introduce a novel strategy for robotic exploration in unknown environments using a semantic topometric map. As it will be presented, the semantic topometric map is generated by segmenting the grid map of the currently…

Robotics · Computer Science 2024-06-27 Scott Fredriksson , Akshit Saradagi , George Nikolakopoulos

We consider the exploration problem: an agent equipped with a depth sensor must map out a previously unknown environment using as few sensor measurements as possible. We propose an approach based on supervised learning of a greedy…

Machine Learning · Computer Science 2022-03-29 Louis Ly , Yen-Hsi Richard Tsai

We propose an exploration method that incorporates look-ahead search over basic learnt skills and their dynamics, and use it for reinforcement learning (RL) of manipulation policies . Our skills are multi-goal policies learned in isolation…

Robotics · Computer Science 2018-11-21 Arpit Agarwal , Katharina Muelling , Katerina Fragkiadaki

The autonomous exploration of environments by multi-robot systems is a critical task with broad applications in rescue missions, exploration endeavors, and beyond. Current approaches often rely on either greedy frontier selection or…

Robotics · Computer Science 2024-10-28 Gengyuan Cai , Luosong Guo , Xiangmao Chang

This paper considers the problem of efficient exploration of unseen environments, a key challenge in AI. We propose a `learning to explore' framework where we learn a policy from a distribution of environments. At test time, presented with…

Machine Learning · Computer Science 2019-10-30 Hanjun Dai , Yujia Li , Chenglong Wang , Rishabh Singh , Po-Sen Huang , Pushmeet Kohli

Exploration in reinforcement learning (RL) remains an open challenge. RL algorithms rely on observing rewards to train the agent, and if informative rewards are sparse the agent learns slowly or may not learn at all. To improve exploration…

Machine Learning · Computer Science 2024-11-12 Simone Parisi , Alireza Kazemipour , Michael Bowling

Dropped into an unknown environment, what should an agent do to quickly learn about the environment and how to accomplish diverse tasks within it? We address this question within the goal-conditioned reinforcement learning paradigm, by…

Machine Learning · Computer Science 2023-03-24 Edward S. Hu , Richard Chang , Oleh Rybkin , Dinesh Jayaraman

This paper deals with the problem of autonomous navigation of a mobile robot in an unknown 2D environment to fully explore the environment as efficiently as possible. We assume a terrestrial mobile robot equipped with a ranging sensor with…

Robotics · Computer Science 2020-07-21 Miroslav Kulich , Jiří Kubalík , Libor Přeučil

One of the gnarliest challenges in reinforcement learning (RL) is exploration that scales to vast domains, where novelty-, or coverage-seeking behaviour falls short. Goal-directed, purposeful behaviours are able to overcome this, but rely…

Machine Learning · Computer Science 2023-02-10 Akhil Bagaria , Ray Jiang , Ramana Kumar , Tom Schaul

We present a novel approach for efficient and reliable goal-directed long-horizon navigation for a multi-robot team in a structured, unknown environment by predicting statistics of unknown space. Building on recent work in…

Robotics · Computer Science 2023-03-30 Abhish Khanal , Gregory J. Stein

A hybrid map representation, which consists of a modified generalized Voronoi Diagram (GVD)-based topological map and a grid-based metric map, is proposed to facilitate a new frontier-driven exploration strategy. Exploration frontiers are…

Robotics · Computer Science 2020-04-21 Wenchao Gao , Matthew Booker , Jiadong Wang

We present a method for solving the coverage problem with the objective of autonomously exploring an unknown environment under mission time constraints. Here, the robot is tasked with planning a path over a horizon such that the accumulated…

In this paper, we address the problem of autonomous exploration of unknown environments with an aerial robot equipped with a sensory set that produces large point clouds, such as LiDARs. The main goal is to gradually explore an area while…

Robotics · Computer Science 2021-09-21 Ana Batinovic , Antun Ivanovic , Tamara Petrovic , Stjepan Bogdan