English
Related papers

Related papers: Exploration in NetHack With Secret Discovery

200 papers

Using mobile robots for autonomous patrolling of environments to prevent intrusions is a topic of increasing practical relevance. One of the most challenging scientific issues is the problem of finding effective patrolling strategies that,…

Computer Science and Game Theory · Computer Science 2009-12-18 Nicola Basilico , Nicola Gatti , Francesco Amigoni

Autonomous exploration for mapping unknown large scale environments is a fundamental challenge in robotics, with efficiency in time, stability against map corruption and computational resources being crucial. This paper presents a novel…

Robotics · Computer Science 2025-07-01 Megha Maheshwari , Sadeigh Rabiee , He Yin , Martin Labrie , Hang Liu , Rajasimman Madhivanan

Distributed online optimization and game have been increasingly researched in the last decade, mostly motivated by its wide applications in sensor networks, robotics (e.g., distributed target tracking and formation control), smart grids,…

Machine Learning · Computer Science 2023-01-24 Xiuxian Li , Lihua Xie , Na Li

Exploration remains a key challenge in deep reinforcement learning (RL). Optimism in the face of uncertainty is a well-known heuristic with theoretical guarantees in the tabular setting, but how best to translate the principle to deep…

Machine Learning · Computer Science 2023-06-06 Brendan O'Donoghue

Pure exploration (aka active testing) is the fundamental task of sequentially gathering information to answer a query about a stochastic environment. Good algorithms make few mistakes and take few samples. Lower bounds (for multi-armed…

Machine Learning · Statistics 2019-06-26 Rémy Degenne , Wouter M. Koolen , Pierre Ménard

Pure exploration in multi-armed bandits has emerged as an important framework for modeling decision-making and search under uncertainty. In modern applications, however, one is often faced with a tremendously large number of options. Even…

Machine Learning · Computer Science 2022-11-22 Parth K. Thaker , Mohit Malu , Nikhil Rao , Gautam Dasarathy

We present an autonomous exploration system for efficient coverage of unknown environments. First, a rapid environment preprocessing method is introduced to provide environmental information for subsequent exploration planning. Then, the…

Robotics · Computer Science 2025-04-04 Shijun Long , Ying Li , Chenming Wu , Bin Xu , Wei Fan

Online learning algorithms, widely used to power search and content optimization on the web, must balance exploration and exploitation, potentially sacrificing the experience of current users in order to gain information that will lead to…

Machine Learning · Computer Science 2021-12-28 Manish Raghavan , Aleksandrs Slivkins , Jennifer Wortman Vaughan , Zhiwei Steven Wu

Many robotic tasks in real-world environments require physical interactions with an object such as pick up or push. For successful interactions, the robot needs to know the object's affordances, which are defined as the potential actions…

Robotics · Computer Science 2025-01-13 Paula Wulkop , Halil Umut Özdemir , Antonia Hüfner , Jen Jen Chung , Roland Siegwart , Lionel Ott

We study the problem of learning exploration-exploitation strategies that effectively adapt to dynamic environments, where the task may change over time. While RNN-based policies could in principle represent such strategies, in practice…

High sample complexity remains a barrier to the application of reinforcement learning (RL), particularly in multi-agent systems. A large body of work has demonstrated that exploration mechanisms based on the principle of optimism under…

Machine Learning · Computer Science 2021-08-02 Robert Loftin , Aadirupa Saha , Sam Devlin , Katja Hofmann

We consider a hide-and-seek game between a Hider and a Seeker over a finite set of locations. The Hider chooses one location to conceal a stationary treasure, while the Seeker visits the locations sequentially along a route. As the search…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Prajakta Surve , Shaunak D. Bopardikar , Daigo Shishika , Dipankar Maity , Michael Dorothy

Sparse reward environments are known to be challenging for reinforcement learning agents. In such environments, efficient and scalable exploration is crucial. Exploration is a means by which an agent gains information about the environment.…

Machine Learning · Computer Science 2023-10-11 Jacob Chmura , Hasham Burhani , Xiao Qi Shi

Path planning for robotic exploration is challenging, requiring reasoning over unknown spaces and anticipating future observations. Efficient exploration requires selecting budget-constrained paths that maximize information gain. Despite…

Robotics · Computer Science 2025-09-29 Narek Harutyunyan , Brady Moon , Seungchan Kim , Cherie Ho , Adam Hung , Sebastian Scherer

Exploration and mapping of unknown environments is a fundamental task in applications for autonomous robots. In this article, we present a complete framework for deploying MAVs in autonomous exploration missions in unknown subterranean…

We consider exploration tasks in which an autonomous mobile robot incrementally builds maps of initially unknown indoor environments. In such tasks, the robot makes a sequence of decisions on where to move next that, usually, are based on…

Robotics · Computer Science 2021-04-23 Matteo Luperto , Luca Fochetta , Francesco Amigoni

Balancing exploration and conservatism in the constrained setting is an important problem if we are to use reinforcement learning for meaningful tasks in the real world. In this paper, we propose a principled algorithm for safe exploration…

Artificial Intelligence · Computer Science 2023-04-24 Alexander W. Goodall , Francesco Belardinelli

This paper considers a problem of planning an attack in robotic football (RoboCup). The problem is reduced to finding a trajectory of the ball from its current position to the opponents goals. Heuristic search algorithm, i.e. A*, is used to…

Robotics · Computer Science 2020-08-05 Ivan Khokhlov , Vladimir Litvinenko , Ilya Ryakin , Konstantin Yakovlev

Autonomous exploration is a widely studied problem where a robot incrementally builds a map of a previously unknown environment. The robot selects the next locations to reach using an exploration strategy. To do so, the robot has to balance…

Robotics · Computer Science 2025-08-15 Matteo Luperto , Valerii Stakanov , Giacomo Boracchi , Nicola Basilico , Francesco Amigoni

Multi-robot autonomous exploration in an unknown environment is an important application in robotics.Traditional exploration methods only use information around frontier points or viewpoints, ignoring spatial information of unknown areas.…

Robotics · Computer Science 2025-03-18 Di Meng , Tianhao Zhao , Chaoyu Xue , Jun Wu , Qiuguo Zhu