English
Related papers

Related papers: Large-Scale Study of Curiosity-Driven Learning

200 papers

Reward engineering and designing an incentive reward function are non-trivial tasks to train agents in complex environments. Furthermore, an inaccurate reward function may lead to a biased behaviour which is far from an efficient and…

Robotics · Computer Science 2021-05-04 Saeed Tafazzol , Erfan Fathi , Mahdi Rezaei , Ehsan Asali

What are the functions of curiosity? What are the mechanisms of curiosity-driven learning? We approach these questions about the living using concepts and tools from machine learning and developmental robotics. We argue that…

Artificial Intelligence · Computer Science 2018-06-19 Pierre-Yves Oudeyer

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

Machine Learning · Computer Science 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel

We consider an agent's uncertainty about its environment and the problem of generalizing this uncertainty across observations. Specifically, we focus on the problem of exploration in non-tabular reinforcement learning. Drawing inspiration…

Artificial Intelligence · Computer Science 2018-07-11 Marc G. Bellemare , Sriram Srinivasan , Georg Ostrovski , Tom Schaul , David Saxton , Remi Munos

Causal understanding is important in many disciplines of science and engineering, where we seek to understand how different factors in the system causally affect an experiment or situation and pave a pathway towards creating effective or…

Robotics · Computer Science 2025-05-14 Miguel Arana-Catania , Weisi Guo

Curiosity-based reward schemes can present powerful exploration mechanisms which facilitate the discovery of solutions for complex, sparse or long-horizon tasks. However, as the agent learns to reach previously unexplored spaces and the…

The design of recommendations strategies in the adaptive learning system focuses on utilizing currently available information to provide individual-specific learning instructions for learners. As a critical motivate for human behaviors,…

Computers and Society · Computer Science 2019-10-29 Ruijian Han , Kani Chen , Chunxi Tan

To solve complex real-world problems with reinforcement learning, we cannot rely on manually specified reward functions. Instead, we can have humans communicate an objective to the agent directly. In this work, we combine two approaches to…

Machine Learning · Computer Science 2018-11-16 Borja Ibarz , Jan Leike , Tobias Pohlen , Geoffrey Irving , Shane Legg , Dario Amodei

Exploration of indoor environments has recently experienced a significant interest, also thanks to the introduction of deep neural agents built in a hierarchical fashion and trained with Deep Reinforcement Learning (DRL) on simulated…

Sparsity of rewards while applying a deep reinforcement learning method negatively affects its sample-efficiency. A viable solution to deal with the sparsity of rewards is to learn via intrinsic motivation which advocates for adding an…

Artificial Intelligence · Computer Science 2023-02-22 Jiong Li , Pratik Gajane

This paper investigates exploration strategies of Deep Reinforcement Learning (DRL) methods to learn navigation policies for mobile robots. In particular, we augment the normal external reward for training DRL algorithms with intrinsic…

Robotics · Computer Science 2018-05-15 Oleksii Zhelo , Jingwei Zhang , Lei Tai , Ming Liu , Wolfram Burgard

Exploration is a prerequisite for learning useful behaviors in sparse-reward, long-horizon tasks, particularly within 3D environments. Curiosity-driven reinforcement learning addresses this via intrinsic rewards derived from the mismatch…

Machine Learning · Computer Science 2026-05-22 Lily Goli , Justin Kerr , Daniele Reda , Alec Jacobson , Andrea Tagliasacchi , Angjoo Kanazawa

In the last decade, deep learning has achieved great success in machine learning tasks where the input data is represented with different levels of abstractions. Driven by the recent research in reinforcement learning using deep neural…

Machine Learning · Computer Science 2022-05-18 Dejan Markovikj

We present a new computing model for intrinsic rewards in reinforcement learning that addresses the limitations of existing surprise-driven explorations. The reward is the novelty of the surprise rather than the surprise norm. We estimate…

Machine Learning · Computer Science 2024-02-01 Hung Le , Kien Do , Dung Nguyen , Svetha Venkatesh

Deep reinforcement learning agents have achieved state-of-the-art results by directly maximising cumulative reward. However, environments contain a much wider variety of possible training signals. In this paper, we introduce an agent that…

We propose regularity as a novel reward signal for intrinsically-motivated reinforcement learning. Taking inspiration from child development, we postulate that striving for structure and order helps guide exploration towards a subspace of…

Machine Learning · Computer Science 2023-12-05 Cansu Sancaktar , Justus Piater , Georg Martius

Extrinsic rewards can effectively guide reinforcement learning (RL) agents in specific tasks. However, extrinsic rewards frequently fall short in complex environments due to the significant human effort needed for their design and…

Machine Learning · Computer Science 2025-04-28 Mingqi Yuan , Roger Creus Castanyer , Bo Li , Xin Jin , Wenjun Zeng , Glen Berseth

In environments with sparse rewards, finding a good inductive bias for exploration is crucial to the agent's success. However, there are two competing goals: novelty search and systematic exploration. While existing approaches such as…

Machine Learning · Computer Science 2023-08-31 Stefan Sylvius Wagner , Peter Arndt , Jan Robine , Stefan Harmeling

Positive affect has been linked to increased interest, curiosity and satisfaction in human learning. In reinforcement learning, extrinsic rewards are often sparse and difficult to define, intrinsically motivated learning can help address…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Dean Zadok , Daniel McDuff , Ashish Kapoor

This paper introduces a novel combination of scheduling control on a flexible robot manufacturing cell with curiosity based reinforcement learning. Reinforcement learning has proved to be highly successful in solving tasks like robotics and…

Robotics · Computer Science 2020-11-18 Mohammed Sharafath Abdul Hameed , Md Muzahid Khan , Andreas Schwung