English
Related papers

Related papers: Analysis of Exploration vs. Exploitation in Adapti…

200 papers

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when…

Robotics · Computer Science 2022-10-25 Tim Schneider , Boris Belousov , Georgia Chalvatzaki , Diego Romeres , Devesh K. Jha , Jan Peters

Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be estimated using the classical notion of Value of…

Artificial Intelligence · Computer Science 2013-01-30 Richard Dearden , Nir Friedman , David Andre

In this work we study the problem of exploring surfaces and building compact 3D representations of the environment surrounding a robot through active perception. We propose an online probabilistic framework that merges visual and tactile…

Robotics · Computer Science 2018-02-14 Sergio Caccamo , Yasemin Bekiroglu , Carl Henrik Ek , Danica Kragic

Active perception approaches select future viewpoints by using some estimate of the information gain. An inaccurate estimate can be detrimental in critical situations, e.g., locating a person in distress. However the true information gained…

Robotics · Computer Science 2026-04-17 Siming He , Yuezhan Tao , Igor Spasojevic , Vijay Kumar , Pratik Chaudhari

Most of the existing robotic exploration schemes use occupancy grid representations and geometric targets known as frontiers. The occupancy grid representation relies on the assumption of independence between grid cells and ignores…

Robotics · Computer Science 2019-05-22 Maani Ghaffari Jadidi , Jaime Valls Miro , Gamini Dissanayake

This paper investigates the task-driven exploration of unknown environments with mobile sensors communicating compressed measurements. The sensors explore the area and transmit their compressed data to another robot, assisting it to reach…

Robotics · Computer Science 2025-08-19 Evangelos Psomiadis , Dipankar Maity , Panagiotis Tsiotras

Robots such as autonomous underwater vehicles (AUVs) and autonomous surface vehicles (ASVs) have been used for sensing and monitoring aquatic environments such as oceans and lakes. Environmental sampling is a challenging task because the…

Robotics · Computer Science 2018-03-29 Kai-Chieh Ma , Lantao Liu , Hordur K. Heidarsson , Gaurav S. Sukhatme

The performance of learning-based control techniques crucially depends on how effectively the system is explored. While most exploration techniques aim to achieve a globally accurate model, such approaches are generally unsuited for systems…

Machine Learning · Computer Science 2020-06-11 Alexandre Capone , Jonas Umlauft , Thomas Beckers , Armin Lederer , Sandra Hirche

Research into several aspects of robot-enabled reconnaissance of random fields is reported. The work has two major components: the underlying theory of information acquisition in the exploration of unknown fields and the results of…

Systems and Control · Computer Science 2011-07-28 Dimitar Baronov , John Baillieul

In this survey we present different approaches that allow an intelligent agent to explore autonomous its environment to gather information and learn multiple tasks. Different communities proposed different solutions, that are in many cases,…

Artificial Intelligence · Computer Science 2014-03-07 Manuel Lopes , Luis Montesano

Environments with controllable dynamics are usually understood in terms of explicit models. However, such models are not always available, but may sometimes be learned by exploring an environment. In this work, we investigate using an…

Machine Learning · Computer Science 2025-07-10 Peter N. Loxley , Friedrich T. Sommer

Efficient exploration of unknown environments is crucial for autonomous robots, especially in confined and large-scale scenarios with limited communication. To address this challenge, we propose a collaborative exploration framework for a…

Robotics · Computer Science 2025-09-10 Angelos Zacharia , Mihir Dharmadhikari , Kostas Alexis

The budgeted information gathering problem - where a robot with a fixed fuel budget is required to maximize the amount of information gathered from the world - appears in practice across a wide range of applications in autonomous…

Robotics · Computer Science 2016-11-15 Sanjiban Choudhury , Ashish Kapoor , Gireeja Ranade , Debadeepta Dey

We consider information filtering, in which we face a stream of items too voluminous to process by hand (e.g., scientific articles, blog posts, emails), and must rely on a computer system to automatically filter out irrelevant items. Such…

Optimization and Control · Mathematics 2015-02-10 Xiaoting Zhao , Peter I. Frazier

Exploration is a critical challenge in robotics, centered on understanding unknown environments. In this work, we focus on robots exploring structured indoor environments which are often predictable and composed of repeating patterns. Most…

The tradeoff between accuracy and speed is considered fundamental to individual and collective decision-making. In this paper, we focus on collective estimation as an example of collective decision-making. The task is to estimate the…

Multiagent Systems · Computer Science 2022-01-19 Mohsen Raoufi , Heiko Hamann , Pawel Romanczuk

The last decade has seen an explosion in data sources available for the monitoring and prediction of environmental phenomena. While several inferential methods have been developed that make predictions on the underlying process by combining…

Methodology · Statistics 2023-03-06 Eun-Hye Yoo , Andrew Zammit-Mangion , Michael G. Chipeta

Robotic science missions in remote environments, such as deep ocean and outer space, can involve studying phenomena that cannot directly be observed using on-board sensors but must be deduced by combining measurements of correlated…

Robotics · Computer Science 2017-12-29 Akash Arora , P. Michael Furlong , Robert Fitch , Salah Sukkarieh , Terrence Fong

We consider the problem of an autonomous agent equipped with multiple sensors, each with different sensing precision and energy costs. The agent's goal is to explore the environment and gather information subject to its resource constraints…

Robotics · Computer Science 2024-04-30 Joshua Ott , Edward Balaban , Mykel Kochenderfer

The need for efficient monitoring of spatio-temporal dynamics in large environmental applications, such as the water quality monitoring in rivers and lakes, motivates the use of robotic sensors in order to achieve sufficient spatial…

Robotics · Computer Science 2014-01-16 Amarjeet Singh , Andreas Krause , Carlos Guestrin , William J. Kaiser