English
Related papers

Related papers: Curiosity creates Diversity in Policy Search

200 papers

Sparsity of rewards while applying a deep reinforcement learning method negatively affects its sample-efficiency. A viable solution to deal with the sparsity of rewards is to learn via intrinsic motivation which advocates for adding an…

Artificial Intelligence · Computer Science 2023-02-22 Jiong Li , Pratik Gajane

Although there are many approaches to implement intrinsically motivated artificial agents, the combined usage of multiple intrinsic drives remains still a relatively unexplored research area. Specifically, we hypothesize that a mechanism…

Artificial Intelligence · Computer Science 2018-06-19 Ildefons Magrans de Abril , Ryota Kanai

Animals exhibit an innate ability to learn regularities of the world through interaction. By performing experiments in their environment, they are able to discern the causal factors of variation and infer how they affect the world's…

Machine Learning · Computer Science 2021-08-10 Sumedh A. Sontakke , Arash Mehrjou , Laurent Itti , Bernhard Schölkopf

During virtual navigation, users exhibit varied interaction and navigation behaviors influenced by several factors. Existing theories and models have been developed to explain and predict these diverse patterns. While users often experience…

Human-Computer Interaction · Computer Science 2025-08-22 Tangyao Li , Yuyang Wang

Behavior domination is proposed as a tool for understanding and harnessing the power of evolutionary systems to discover and exploit useful stepping stones. Novelty search has shown promise in overcoming deception by collecting diverse…

Neural and Evolutionary Computing · Computer Science 2017-04-20 Elliot Meyerson , Risto Miikkulainen

To handle the sparsity of the extrinsic rewards in reinforcement learning, researchers have proposed intrinsic reward which enables the agent to learn the skills that might come in handy for pursuing the rewards in the future, such as…

Machine Learning · Computer Science 2022-05-31 Chao Chen , Zijian Gao , Kele Xu , Sen Yang , Yiying Li , Bo Ding , Dawei Feng , Huaimin Wang

Learning in environments with sparse rewards remains a fundamental challenge in reinforcement learning. Artificial curiosity addresses this limitation through intrinsic rewards to guide exploration, however, the precise formulation of these…

Machine Learning · Computer Science 2026-04-20 Alexander Nedergaard , Pablo A. Morales

Exploration in high-dimensional, continuous spaces with sparse rewards is an open problem in reinforcement learning. Artificial curiosity algorithms address this by creating rewards that lead to exploration. Given a reinforcement learning…

Machine Learning · Computer Science 2023-11-08 Alexander Nedergaard , Matthew Cook

Consider the problem of exploration in sparse-reward or reward-free environments, such as in Montezuma's Revenge. In the curiosity-driven paradigm, the agent is rewarded for how much each realized outcome differs from their predicted…

Machine Learning · Statistics 2023-07-21 Daniel Jarrett , Corentin Tallec , Florent Altché , Thomas Mesnard , Rémi Munos , Michal Valko

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic"…

Machine Learning · Computer Science 2020-07-16 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

Dealing with sparse rewards is a longstanding challenge in reinforcement learning. The recent use of hindsight methods have achieved success on a variety of sparse-reward tasks, but they fail on complex tasks such as stacking multiple…

Machine Learning · Computer Science 2019-06-11 John B. Lanier , Stephen McAleer , Pierre Baldi

In environments with sparse rewards, finding a good inductive bias for exploration is crucial to the agent's success. However, there are two competing goals: novelty search and systematic exploration. While existing approaches such as…

Machine Learning · Computer Science 2023-08-31 Stefan Sylvius Wagner , Peter Arndt , Jan Robine , Stefan Harmeling

Reinforcement Learning enables to train an agent via interaction with the environment. However, in the majority of real-world scenarios, the extrinsic feedback is sparse or not sufficient, thus intrinsic reward formulations are needed to…

Machine Learning · Computer Science 2022-06-07 Patrik Reizinger , Márton Szemenyei

Curiosity is the strong desire to learn or know more about something or someone. Since learning is often a social endeavor, social dynamics in collaborative learning may inevitably influence curiosity. There is a scarcity of research,…

Human-Computer Interaction · Computer Science 2017-10-24 Tanmay Sinha , Zhen Bai , Justine Cassell

Exploration is a fundamental aspect of reinforcement learning (RL), and its effectiveness is a deciding factor in the performance of RL algorithms, especially when facing sparse extrinsic rewards. Recent studies have shown the effectiveness…

Machine Learning · Computer Science 2023-05-19 Shanchuan Wan , Yujin Tang , Yingtao Tian , Tomoyuki Kaneko

Exploration is a prerequisite for learning useful behaviors in sparse-reward, long-horizon tasks, particularly within 3D environments. Curiosity-driven reinforcement learning addresses this via intrinsic rewards derived from the mismatch…

Machine Learning · Computer Science 2026-05-22 Lily Goli , Justin Kerr , Daniele Reda , Alec Jacobson , Andrea Tagliasacchi , Angjoo Kanazawa

Curiosity is a vital metacognitive skill in educational contexts, leading to creativity, and a love of learning. And while many school systems increasingly undercut curiosity by teaching to the test, teachers are increasingly interested in…

Machine Learning · Computer Science 2022-04-04 Tanmay Sinha , Zhen Bai , Justine Cassell

We study the similarity search problem which aims to find the similar query results according to a set of given data and a query string. To balance the result number and result quality, we combine query result diversity with query…

Databases · Computer Science 2017-02-24 Ruoxi Shi , Hongzhi Wang , Tao Wang , Yutai Hou , Yiwen Tang

We present Reward-Switching Policy Optimization (RSPO), a paradigm to discover diverse strategies in complex RL environments by iteratively finding novel policies that are both locally optimal and sufficiently different from existing ones.…

Machine Learning · Computer Science 2022-05-04 Zihan Zhou , Wei Fu , Bingliang Zhang , Yi Wu

Imitation learning (IL) has shown promise in various applications (e.g. robot locomotion) but is often limited to learning a single expert policy, constraining behavior diversity and robustness in unpredictable real-world scenarios. To…

Machine Learning · Computer Science 2025-08-15 Zhenglin Wan , Xingrui Yu , David Mark Bossens , Yueming Lyu , Qing Guo , Flint Xiaofeng Fan , Yew Soon Ong , Ivor Tsang