English
Related papers

Related papers: Curiosity creates Diversity in Policy Search

200 papers

Most theories of behavior posit that agents tend to maximize some form of reward or utility. However, animals very often move with curiosity and seem to be motivated in a reward-free manner. Here we abandon the idea of reward maximization,…

Artificial Intelligence · Computer Science 2024-02-27 Jorge Ramírez-Ruiz , Dmytro Grytskyy , Chiara Mastrogiuseppe , Yamen Habib , Rubén Moreno-Bote

In order to compute near-optimal policies with policy-gradient algorithms, it is common in practice to include intrinsic exploration terms in the learning objective. Although the effectiveness of these terms is usually justified by an…

Machine Learning · Computer Science 2025-08-21 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

Causal understanding is important in many disciplines of science and engineering, where we seek to understand how different factors in the system causally affect an experiment or situation and pave a pathway towards creating effective or…

Robotics · Computer Science 2025-05-14 Miguel Arana-Catania , Weisi Guo

Although most theories posit that natural behavior can be explained as maximizing some form of extrinsic reward, often called utility, some behaviors appear to be reward independent. For instance, spontaneous motor babbling in human…

Neurons and Cognition · Quantitative Biology 2026-01-16 Rubén Moreno-Bote , Ralf Haefner , Jordi Galiano-Landeira , Tianming Yang , Pedro Maldonado

The main objective of this paper is to outline a theoretical framework to analyse how humans' decision-making strategies under uncertainty manage the trade-off between information gathering (exploration) and reward seeking (exploitation). A…

Artificial Intelligence · Computer Science 2021-02-16 Antonio Candelieri , Andrea Ponti , Francesco Archetti

Selection shapes all kinds of behaviors, including how we make decisions under uncertainty. The risk attitude reflected from it should be simple, flexible, yet consistent. In this paper we engaged evolutionary dynamics to find the decision…

Theoretical Economics · Economics 2022-06-22 Songjia Fan , Yi Tao , Cong Li

In Reinforcement Learning (RL), artificial agents are trained to maximize numerical rewards by performing tasks. Exploration is essential in RL because agents must discover information before exploiting it. Two rewards encouraging efficient…

Machine Learning · Computer Science 2024-05-14 Theodore Jerome Tinker , Kenji Doya , Jun Tani

In this paper, we study the task of embodied interactive learning for object detection. Given a set of environments (and some labeling budget), our goal is to learn an object detector by having an agent select what data to obtain labels…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Devendra Singh Chaplot , Helen Jiang , Saurabh Gupta , Abhinav Gupta

Finding different solutions to the same problem is a key aspect of intelligence associated with creativity and adaptation to novel situations. In reinforcement learning, a set of diverse policies can be useful for exploration, transfer,…

Artificial Intelligence · Computer Science 2022-01-05 Tom Zahavy , Brendan O'Donoghue , Andre Barreto , Volodymyr Mnih , Sebastian Flennerhag , Satinder Singh

We consider an agent's uncertainty about its environment and the problem of generalizing this uncertainty across observations. Specifically, we focus on the problem of exploration in non-tabular reinforcement learning. Drawing inspiration…

Artificial Intelligence · Computer Science 2018-07-11 Marc G. Bellemare , Sriram Srinivasan , Georg Ostrovski , Tom Schaul , David Saxton , Remi Munos

An evolution strategy (ES) variant based on a simplification of a natural evolution strategy recently attracted attention because it performs surprisingly well in challenging deep reinforcement learning domains. It searches for neural…

Neural and Evolutionary Computing · Computer Science 2018-05-03 Joel Lehman , Jay Chen , Jeff Clune , Kenneth O. Stanley

Traditional exploration methods in RL require agents to perform random actions to find rewards. But these approaches struggle on sparse-reward domains like Montezuma's Revenge where the probability that any random action sequence leads to…

Artificial Intelligence · Computer Science 2018-11-27 Christopher Stanton , Jeff Clune

Quality-Diversity is a family of evolutionary algorithms that generate diverse, high-performing solutions through local competition principles inspired by natural evolution. While research has focused on improving specific aspects of…

Neural and Evolutionary Computing · Computer Science 2025-02-04 Ryan Bahlous-Boldi , Maxence Faldor , Luca Grillotti , Hannah Janmohamed , Lisa Coiffard , Lee Spector , Antoine Cully

Exploring in environments with high-dimensional observations is hard. One promising approach for exploration is to use intrinsic rewards, which often boils down to estimating "novelty" of states, transitions, or trajectories with deep…

Machine Learning · Computer Science 2023-05-17 Toru Lin , Allan Jabri

Infants explore their complex physical and social environment in an organized way. To gain insight into what intrinsic motivations may help structure this exploration, we create a virtual infant agent and place it in a…

Machine Learning · Computer Science 2023-05-24 Chris Doyle , Sarah Shader , Michelle Lau , Megumi Sano , Daniel L. K. Yamins , Nick Haber

Rewards are sparse in the real world and most of today's reinforcement learning algorithms struggle with such sparsity. One solution to this problem is to allow the agent to create rewards for itself - thus making rewards dense and more…

This paper investigates exploration strategies of Deep Reinforcement Learning (DRL) methods to learn navigation policies for mobile robots. In particular, we augment the normal external reward for training DRL algorithms with intrinsic…

Robotics · Computer Science 2018-05-15 Oleksii Zhelo , Jingwei Zhang , Lei Tai , Ming Liu , Wolfram Burgard

The study of exploration in the domain of decision making has a long history but remains actively debated. From the vast literature that addressed this topic for decades under various points of view (e.g., developmental psychology,…

Machine Learning · Computer Science 2021-01-14 Léonard Hussenot , Robert Dadashi , Matthieu Geist , Olivier Pietquin

Evolution strategies (ES) are a family of black-box optimization algorithms able to train deep neural networks roughly as well as Q-learning and policy gradient methods on challenging deep reinforcement learning (RL) problems, but are much…

Artificial Intelligence · Computer Science 2018-10-31 Edoardo Conti , Vashisht Madhavan , Felipe Petroski Such , Joel Lehman , Kenneth O. Stanley , Jeff Clune

Recent advances in Large Language Models (LLMs) have expanded their role in human interaction, yet curiosity -- a central driver of inquiry -- remains underexplored in these systems, particularly across cultural contexts. In this work, we…

Computation and Language · Computer Science 2025-10-21 Angana Borah , Zhijing Jin , Rada Mihalcea