English
Related papers

Related papers: On the Complexity of Exploration in Goal-Driven Na…

200 papers

In many real-world scenarios, an autonomous agent often encounters various tasks within a single complex environment. We propose to build a graph abstraction over the environment structure to accelerate the learning of these tasks. Here,…

Machine Learning · Computer Science 2019-07-02 Wenling Shang , Alex Trott , Stephan Zheng , Caiming Xiong , Richard Socher

For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a…

Robotics · Computer Science 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

Recent years have witnessed a tremendous improvement of deep reinforcement learning. However, a challenging problem is that an agent may suffer from inefficient exploration, particularly for on-policy methods. Previous exploration methods…

Machine Learning · Computer Science 2020-02-17 Ling Pan , Qingpeng Cai , Longbo Huang

The environment plays a critical role in multi-agent navigation by imposing spatial constraints, rules, and limitations that agents must navigate around. Traditional approaches treat the environment as fixed, without exploring its impact on…

Robotics · Computer Science 2026-04-09 Zhan Gao , Gabriele Fadini , Stelian Coros , Amanda Prorok

Due to the dynamic and unpredictable open-world setting, navigating complex environments in Minecraft poses significant challenges for multi-agent systems. Agents must interact with the environment and coordinate their actions with other…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhonghan Zhao , Kewei Chen , Dongxu Guo , Wenhao Chai , Tian Ye , Yanting Zhang , Gaoang Wang

Cognitive maps play a crucial role in facilitating flexible behaviour by representing spatial and conceptual relationships within an environment. The ability to learn and infer the underlying structure of the environment is crucial for…

Artificial Intelligence · Computer Science 2023-09-20 Daria de Tinguy , Toon Van de Maele , Tim Verbelen , Bart Dhoedt

Existing object-search approaches enable robots to search through free pathways, however, robots operating in unstructured human-centered environments frequently also have to manipulate the environment to their needs. In this work, we…

Robotics · Computer Science 2023-11-07 Fabian Schmalstieg , Daniel Honerkamp , Tim Welschehold , Abhinav Valada

Traditional approaches to the design of multi-agent navigation algorithms consider the environment as a fixed constraint, despite the influence of spatial constraints on agents' performance. Yet hand-designing conducive environment layouts…

Systems and Control · Electrical Eng. & Systems 2023-05-22 Zhan Gao , Amanda Prorok

Efficient robotic extraterrestrial exploration requires robots with diverse capabilities, ranging from scientific measurement tools to advanced locomotion. A robotic team enables the distribution of tasks over multiple specialized…

Robotics · Computer Science 2026-04-02 Matthias Rubio , Julia Richter , Hendrik Kolvenbach , Marco Hutter

This paper considers the problem of efficient exploration of unseen environments, a key challenge in AI. We propose a `learning to explore' framework where we learn a policy from a distribution of environments. At test time, presented with…

Machine Learning · Computer Science 2019-10-30 Hanjun Dai , Yujia Li , Chenglong Wang , Rishabh Singh , Po-Sen Huang , Pushmeet Kohli

Robotic exploration of unknown environments is fundamentally a problem of decision making under uncertainty where the robot must account for uncertainty in sensor measurements, localization, action execution, as well as many other factors.…

Moving an autonomous agent through an unknown environment is one of the crucial problems for robotics and network analysis. Therefore, it received a lot of attention in the last decades and was analyzed in many different settings. The graph…

Computational Complexity · Computer Science 2018-04-23 Hans-Joachim Böckenhauer , Janosch Fuchs , Walter Unger

Ad hoc teamwork is the challenging problem of designing an autonomous agent which can adapt quickly to collaborate with teammates without prior coordination mechanisms, including joint training. Prior work in this area has focused on closed…

Machine Learning · Computer Science 2021-06-10 Arrasy Rahman , Niklas Höpner , Filippos Christianos , Stefano V. Albrecht

Intelligent agents need to select long sequences of actions to solve complex tasks. While humans easily break down tasks into subgoals and reach them through millions of muscle commands, current artificial intelligence is limited to tasks…

Artificial Intelligence · Computer Science 2022-06-10 Danijar Hafner , Kuang-Huei Lee , Ian Fischer , Pieter Abbeel

We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Sriram Narayanan , Dinesh Jayaraman , Manmohan Chandraker

Motivated by the increasing appeal of robots in information-gathering missions, we study multi-agent path planning problems in which the agents must remain interconnected. We model an area by a topological graph specifying the movement and…

Artificial Intelligence · Computer Science 2019-03-12 Tristan Charrier , Arthur Queffelec , Ocan Sankur , François Schwarzentruber

Object navigation is defined as navigating to an object of a given label in a complex, unexplored environment. In its general form, this problem poses several challenges for Robotics: semantic exploration of unknown environments in search…

Robotics · Computer Science 2020-07-31 Ayzaan Wahid , Austin Stone , Kevin Chen , Brian Ichter , Alexander Toshev

Simulation is a powerful tool to study the behavior of physical, environmental, and social systems under different conditions. Evacuation simulation can be used to estimate the required time for people to exit a building or evacuate…

Physics and Society · Physics 2021-03-23 Fardad Haghpanah , Judith Mitrani-Reiser , Benjamin W. Schafer

We consider the following problem - a group of mobile agents perform some task on a terrain modeled as a graph. In a given moment of time an adversary gets an access to the graph and positions of the agents. Shortly before adversary's…

Multiagent Systems · Computer Science 2016-11-15 Karol Gotfryd , Marek Klonowski , Dominik Pająk

We study cooperative multi-agent reinforcement learning in the setting of reward-free exploration, where multiple agents jointly explore an unknown MDP in order to learn its dynamics (without observing rewards). We focus on a tabular…

Machine Learning · Computer Science 2026-05-14 Idan Barnea , Orin Levy , Yishay Mansour