English
Related papers

Related papers: Open-ended search for environments and adapted age…

200 papers

In this paper, we consider the problem of exploring unknown environments with autonomous agents. We model the environment as a graph with edge weights and analyze the task of visiting all vertices of the graph at least once. The hardness of…

Computational Complexity · Computer Science 2016-11-04 Hans-Joachim Böckenhauer , Janosch Fuchs , Ulla Karhumäki , Walter Unger

Consider a small group of mobile agents whose goal is to locate a certain cell in a two-dimensional infinite grid. The agents operate in an asynchronous environment, where in each discrete time step, an arbitrary subset of the agents…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-09 Sebastian Brandt , Jara Uitto , Roger Wattenhofer

Recent works have proven that intricate cooperative behaviors can emerge in agents trained using meta reinforcement learning on open ended task distributions using self-play. While the results are impressive, we argue that self-play and…

Multiagent Systems · Computer Science 2024-05-08 Richard Bornemann , Gautier Hamon , Eleni Nisioti , Clément Moulin-Frier

Many challenges remain before AI agents can be deployed in real-world environments. However, one virtue of such environments is that they are inherently multi-agent and contain human experts. Using advanced social intelligence in such an…

Machine Learning · Computer Science 2025-08-22 Eric Ye , Ren Tao , Natasha Jaques

Quality-Diversity algorithms, such as MAP-Elites, are a branch of Evolutionary Computation generating collections of diverse and high-performing solutions, that have been successfully applied to a variety of domains and particularly in…

Neural and Evolutionary Computing · Computer Science 2023-03-08 Maxence Faldor , Félix Chalumeau , Manon Flageat , Antoine Cully

Developing autonomous agents that quickly explore an environment and adapt their behavior online is a canonical challenge in robotics and machine learning. While humans are able to achieve such fast online exploration and adaptation, often…

Machine Learning · Computer Science 2025-07-15 Andrew Wagenmaker , Zhiyuan Zhou , Sergey Levine

Lifelong mapping is crucial for the long-term deployment of robots in dynamic environments. In this paper, we present ELite, an ephemerality-aided LiDAR-based lifelong mapping framework which can seamlessly align multiple session data,…

Robotics · Computer Science 2025-03-04 Hyeonjae Gil , Dongjae Lee , Giseop Kim , Ayoung Kim

Building agents that can explore their environments intelligently is a challenging open problem. In this paper, we make a step towards understanding how a hierarchical design of the agent's policy can affect its exploration capabilities.…

Machine Learning · Computer Science 2018-11-19 Maruan Al-Shedivat , Lisa Lee , Ruslan Salakhutdinov , Eric Xing

It has been a long-standing dream to design artificial agents that explore their environment efficiently via intrinsic motivation, similar to how children perform curious free play. Despite recent advances in intrinsically motivated…

Machine Learning · Computer Science 2022-11-29 Cansu Sancaktar , Sebastian Blaes , Georg Martius

Can we build an artificial system that would be able to generate endless surprises if ran "forever" in Minecraft? While there is not a single path toward solving that grand challenge, this article presents what we believe to be some working…

Artificial Intelligence · Computer Science 2023-12-04 Mayalen Etcheverry , Bert Wang-Chak Chan , Clément Moulin-Frier , Pierre-Yves Oudeyer

Infants are experts at playing, with an amazing ability to generate novel structured behaviors in unstructured environments that lack clear extrinsic reward signals. We seek to mathematically formalize these abilities using a neural network…

Machine Learning · Computer Science 2018-11-01 Nick Haber , Damian Mrowca , Li Fei-Fei , Daniel L. K. Yamins

Current interactive LLM agents rely on goal-conditioned stepwise planning, where environmental understanding is acquired reactively during execution rather than established beforehand. This temporal inversion leads to Delayed Environmental…

Artificial Intelligence · Computer Science 2026-05-14 Yuxin Liu , Ziang Ye , Yueqing Sun , Mingye Zhu , Jinwei Xiao , Zhuowen Han , Qi GU , Xunliang Cai , Lei Zhang

Soft robotics has emerged as the standard solution for grasping deformable objects, and has proven invaluable for mobile robotic exploration in extreme environments. However, despite this growth, there are no widely adopted computational…

Robotics · Computer Science 2024-07-11 Yue Xie , Josh Pinskier , Lois Liow , David Howard , Fumiya Iida

Quality Diversity (QD) has shown great success in discovering high-performing, diverse policies for robot skill learning. While current benchmarks have led to the development of powerful QD methods, we argue that new paradigms must be…

Robotics · Computer Science 2024-07-26 Sumeet Batra , Bryon Tjanaka , Stefanos Nikolaidis , Gaurav Sukhatme

Reinforcement learning allows solving complex tasks, however, the learning tends to be task-specific and the sample efficiency remains a challenge. We present Plan2Explore, a self-supervised reinforcement learning agent that tackles both…

Machine Learning · Computer Science 2020-07-02 Ramanan Sekar , Oleh Rybkin , Kostas Daniilidis , Pieter Abbeel , Danijar Hafner , Deepak Pathak

Open-ended worlds are those in which there are no pre-specified goals or environmental reward signal. As a consequence, an agent must know how to perform a multitude of tasks. However, when a new task is presented to an agent, we expect it…

Computation and Language · Computer Science 2024-05-13 Christopher Z. Cui , Xiangyu Peng , Mark O. Riedl

Humans rely on the synergistic control of head (cephalomotor) and eye (oculomotor) to efficiently search for visual information in 360{\deg}. However, prior approaches to visual search are limited to a static image, neglecting the physical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Heyang Yu , Yinan Han , Xiangyu Zhang , Baiqiao Yin , Bowen Chang , Xiangyu Han , Xinhao Liu , Jing Zhang , Marco Pavone , Chen Feng , Saining Xie , Yiming Li

We are in the midst of large-scale industrial and academic efforts to automate the processes of scientific, technological and creative production through AI-driven assistants. Historically, a fundamental property of these processes in their…

Artificial Intelligence · Computer Science 2026-05-28 Sam Earle , Kai Arulkumaran , Andrew Dai , Akarsh Kumar , Julian Togelius , Sebastian Risi

Assisted by neural networks, reinforcement learning agents have been able to solve increasingly complex tasks over the last years. The simulation environment in which the agents interact is an essential component in any reinforcement…

Machine Learning · Computer Science 2018-09-03 Aqeel Labash , Ardi Tampuu , Tambet Matiisen , Jaan Aru , Raul Vicente

Cognitive maps play a crucial role in facilitating flexible behaviour by representing spatial and conceptual relationships within an environment. The ability to learn and infer the underlying structure of the environment is crucial for…

Artificial Intelligence · Computer Science 2023-06-26 Daria de Tinguy , Toon Van de Maele , Tim Verbelen , Bart Dhoedt