English
Related papers

Related papers: From Curiosity to Competence: How World Models Int…

200 papers

In many real-world scenarios, rewards extrinsic to the agent are extremely sparse, or absent altogether. In such cases, curiosity can serve as an intrinsic reward signal to enable the agent to explore its environment and learn skills that…

Machine Learning · Computer Science 2017-05-16 Deepak Pathak , Pulkit Agrawal , Alexei A. Efros , Trevor Darrell

Most modern systems strive to learn from interactions with users, and many engage in exploration: making potentially suboptimal choices for the sake of acquiring new information. We initiate a study of the interplay between exploration and…

Computer Science and Game Theory · Computer Science 2017-11-21 Yishay Mansour , Aleksandrs Slivkins , Zhiwei Steven Wu

Autonomous exploration in complex multi-agent reinforcement learning (MARL) with sparse rewards critically depends on providing agents with effective intrinsic motivation. While artificial curiosity offers a powerful self-supervised signal,…

Machine Learning · Computer Science 2026-02-24 Yiyuan Pan , Zhe Liu , Hesheng Wang

The premise of the Multi-disciplinary Conference on Reinforcement Learning and Decision Making is that multiple disciplines share an interest in goal-directed decision making over time. The idea of this paper is to sharpen and deepen this…

Artificial Intelligence · Computer Science 2022-06-07 Richard S. Sutton

Exploration is one of the core challenges in reinforcement learning. A common formulation of curiosity-driven exploration uses the difference between the real future and the future predicted by a learned model. However, predicting the…

Machine Learning · Computer Science 2021-01-19 Victoria Dean , Shubham Tulsiani , Abhinav Gupta

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

Robotics · Computer Science 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur

Scientific literature till date can be thought of as a partially revealed landscape, where scholars continue to unveil hidden knowledge by exploring novel research topics. How do scholars explore the scientific landscape , i.e., choose…

Social and Information Networks · Computer Science 2015-03-11 Qiu Fang Ying , Srinivasan Venkatramanan , Dah Ming Chiu

Computer-aided design of molecules has the potential to disrupt the field of drug and material discovery. Machine learning, and deep learning, in particular, have been topics where the field has been developing at a rapid pace.…

Machine Learning · Computer Science 2022-08-08 Luca A. Thiede , Mario Krenn , AkshatKumar Nigam , Alan Aspuru-Guzik

The exploration-exploitation trade-off is central to the description of adaptive behaviour in fields ranging from machine learning, to biology, to economics. While many approaches have been taken, one approach to solving this trade-off has…

Machine Learning · Computer Science 2021-11-29 Beren Millidge , Anil Seth , Christopher Buckley

World models are self-supervised predictive models of how the world evolves. Humans learn world models by curiously exploring their environment, in the process acquiring compact abstractions of high bandwidth sensory inputs, the ability to…

Machine Learning · Computer Science 2020-07-16 Kuno Kim , Megumi Sano , Julian De Freitas , Nick Haber , Daniel Yamins

Exploration algorithms for reinforcement learning typically replace or augment the reward function with an additional ``intrinsic'' reward that trains the agent to seek previously unseen states of the environment. Here, we consider an…

Machine Learning · Computer Science 2025-09-30 Kevin McKee , Eric Alt , Andrew Grebenisan , Mick van Gelderen , Gary Miguel

Reinforcement learners are agents that learn to pick actions that lead to high reward. Ideally, the value of a reinforcement learner's policy approaches optimality--where the optimal informed policy is the one which maximizes reward.…

Machine Learning · Computer Science 2021-05-27 Michael K. Cohen , Elliot Catt , Marcus Hutter

Developing autonomous agents that quickly explore an environment and adapt their behavior online is a canonical challenge in robotics and machine learning. While humans are able to achieve such fast online exploration and adaptation, often…

Machine Learning · Computer Science 2025-07-15 Andrew Wagenmaker , Zhiyuan Zhou , Sergey Levine

Reinforcement Learning (RL) is known to be often unsuccessful in environments with sparse extrinsic rewards. A possible countermeasure is to endow RL agents with an intrinsic reward function, or 'intrinsic motivation', which rewards the…

Artificial Intelligence · Computer Science 2021-07-16 Francesco Massari , Martin Biehl , Lisa Meeden , Ryota Kanai

We develop a general problem setting for training and testing the ability of agents to gather information efficiently. Specifically, we present a collection of tasks in which success requires searching through a partially-observed…

Machine Learning · Computer Science 2016-12-09 Philip Bachman , Alessandro Sordoni , Adam Trischler

Adapting quickly to dynamic, uncertain environments-often called "open worlds"-remains a major challenge in robotics. Traditional Task and Motion Planning (TAMP) approaches struggle to cope with unforeseen changes, are data-inefficient when…

Robotics · Computer Science 2025-03-10 Pierrick Lorang , Hong Lu , Matthias Scheutz

Human learning and intelligence work differently from the supervised pattern recognition approach adopted in most deep learning architectures. Humans seem to learn rich representations by exploration and imitation, build causal models of…

Artificial Intelligence · Computer Science 2021-10-28 Martin Stetter , Elmar W. Lang

Embodied agents operating in human spaces must be able to master how their environment works: what objects can the agent use, and how can it use them? We introduce a reinforcement learning approach for exploration for interaction, whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Tushar Nagarajan , Kristen Grauman

Psychological curiosity plays a significant role in human intelligence to enhance learning through exploration and information acquisition. In the Artificial Intelligence (AI) community, artificial curiosity provides a natural intrinsic…

Artificial Intelligence · Computer Science 2022-01-21 Chenyu Sun , Hangwei Qian , Chunyan Miao

Active inference helps us simulate adaptive behavior and decision-making in biological and artificial agents. Building on our previous work exploring the relationship between active inference, well-being, resilience, and sustainability, we…

Artificial Intelligence · Computer Science 2024-06-13 Mahault Albarracin , Ines Hipolito , Maria Raffa , Paul Kinghorn