English
Related papers

Related papers: Curiosity-Driven Exploration via Latent Bayesian S…

200 papers

In this work, we address the challenge of data-efficient exploration in reinforcement learning by examining existing principled, information-theoretic approaches to intrinsic motivation. Specifically, we focus on a class of exploration…

Machine Learning · Computer Science 2025-07-04 Alberto Caron , Chris Hicks , Vasilios Mavroudis

Although there are many approaches to implement intrinsically motivated artificial agents, the combined usage of multiple intrinsic drives remains still a relatively unexplored research area. Specifically, we hypothesize that a mechanism…

Artificial Intelligence · Computer Science 2018-06-19 Ildefons Magrans de Abril , Ryota Kanai

This paper introduces a probabilistic framework to estimate parameters of an acquisition function given observed human behavior that can be modeled as a collection of sample paths from a Bayesian optimization procedure. The methodology…

Human-Computer Interaction · Computer Science 2022-02-04 Nathan Sandholtz , Yohsuke Miyamoto , Luke Bornn , Maurice Smith

Humans and animals explore their environment and acquire useful skills even in the absence of clear goals, exhibiting intrinsic motivation. The study of intrinsic motivation in artificial agents is concerned with the following question:…

Machine Learning · Computer Science 2021-12-08 Nicholas Rhinehart , Jenny Wang , Glen Berseth , John D. Co-Reyes , Danijar Hafner , Chelsea Finn , Sergey Levine

Two key challenges within Reinforcement Learning involve improving (a) agent learning within environments with sparse extrinsic rewards and (b) the explainability of agent actions. We describe a curious subgoal focused agent to address both…

Machine Learning · Computer Science 2021-04-20 Connor van Rossum , Candice Feinberg , Adam Abu Shumays , Kyle Baxter , Benedek Bartha

Exploration in environments with sparse rewards is difficult for artificial agents. Curiosity driven learning -- using feed-forward prediction errors as intrinsic rewards -- has achieved some success in these scenarios, but fails when faced…

Machine Learning · Computer Science 2024-07-08 Augustine N. Mavor-Parker , Kimberly A. Young , Caswell Barry , Lewis D. Griffin

We propose a curiosity reward based on information theory principles and consistent with the animal instinct to maintain certain critical parameters within a bounded range. Our experimental validation shows the added value of the additional…

Artificial Intelligence · Computer Science 2018-02-08 Ildefons Magrans de Abril , Ryota Kanai

Computer experiments are often performed to allow modeling of a response surface of a physical experiment that can be too costly or difficult to run except using a simulator. Running the experiment over a dense grid can be prohibitively…

Applications · Statistics 2009-05-25 Robert B. Gramacy , Herbert K. H. Lee

Many engineering and scientific workflows rely on expensive black-box evaluations, requiring sequential decisions that must both improve task performance and reduce uncertainty. Bayesian optimization (BO) and Bayesian experimental design…

Machine Learning · Computer Science 2026-05-14 Yingke Li , Anjali Parashar , Enlu Zhou , Chuchu Fan

Animals exhibit an innate ability to learn regularities of the world through interaction. By performing experiments in their environment, they are able to discern the causal factors of variation and infer how they affect the world's…

Machine Learning · Computer Science 2021-08-10 Sumedh A. Sontakke , Arash Mehrjou , Laurent Itti , Bernhard Schölkopf

We present a rational analysis of curiosity, proposing that people's curiosity is driven by seeking stimuli that maximize their ability to make appropriate responses in the future. This perspective offers a way to unify previous theories of…

Artificial Intelligence · Computer Science 2020-08-04 Rachit Dubey , Thomas L. Griffiths

Although exploratory behaviors are ubiquitous in the animal kingdom, their computational underpinnings are still largely unknown. Behavioral Psychology has identified learning as a primary drive underlying many exploratory behaviors.…

Machine Learning · Computer Science 2011-12-14 Daniel Y. Little , Friedrich T. Sommer

Autonomous exploration in complex multi-agent reinforcement learning (MARL) with sparse rewards critically depends on providing agents with effective intrinsic motivation. While artificial curiosity offers a powerful self-supervised signal,…

Machine Learning · Computer Science 2026-02-24 Yiyuan Pan , Zhe Liu , Hesheng Wang

An autonomous experimentation platform in manufacturing is supposedly capable of conducting a sequential search for finding suitable manufacturing conditions by itself or even for discovering new materials with minimal human intervention.…

Machine Learning · Computer Science 2024-10-03 Imtiaz Ahmed , Satish Bukkapatnam , Bhaskar Botcha , Yu Ding

Typical models of learning assume incremental estimation of continuously-varying decision variables like expected rewards. However, this class of models fails to capture more idiosyncratic, discrete heuristics and strategies that people and…

Machine Learning · Computer Science 2024-02-27 Carlos G. Correa , Thomas L. Griffiths , Nathaniel D. Daw

Intrinsically motivated goal exploration processes enable agents to autonomously sample goals to explore efficiently complex environments with high-dimensional continuous actions. They have been applied successfully to real world robots to…

Machine Learning · Computer Science 2018-11-06 Adrien Laversanne-Finot , Alexandre Péré , Pierre-Yves Oudeyer

Learning in sparse reward settings remains a challenge in Reinforcement Learning, which is often addressed by using intrinsic rewards. One promising strategy is inspired by human curiosity, requiring the agent to learn to predict the…

Machine Learning · Computer Science 2018-10-02 Gino Brunner , Manuel Fritsche , Oliver Richter , Roger Wattenhofer

It has been a long-standing dream to design artificial agents that explore their environment efficiently via intrinsic motivation, similar to how children perform curious free play. Despite recent advances in intrinsically motivated…

Machine Learning · Computer Science 2022-11-29 Cansu Sancaktar , Sebastian Blaes , Georg Martius

Exploration in environments with continuous control and sparse rewards remains a key challenge in reinforcement learning (RL). Recently, surprise has been used as an intrinsic reward that encourages systematic and efficient exploration. We…

Machine Learning · Computer Science 2019-11-01 Haitao Xu , Brendan McCane , Lech Szymanski

Biological agents have meaningful interactions with their environment despite the absence of immediate reward signals. In such instances, the agent can learn preferred modes of behaviour that lead to predictable states -- necessary for…

Artificial Intelligence · Computer Science 2021-07-20 Noor Sajid , Panagiotis Tigas , Alexey Zakharov , Zafeirios Fountas , Karl Friston