English
Related papers

Related papers: Surprise-Based Intrinsic Motivation for Deep Reinf…

200 papers

Both entropy-minimizing and entropy-maximizing (curiosity) objectives for unsupervised reinforcement learning (RL) have been shown to be effective in different environments, depending on the environment's level of natural entropy. However,…

Machine Learning · Computer Science 2024-08-19 Adriana Hugessen , Roger Creus Castanyer , Faisal Mohamed , Glen Berseth

Efficient exploration remains a challenging research problem in reinforcement learning, especially when an environment contains large state spaces, deceptive local optima, or sparse rewards. To tackle this problem, we present a…

Artificial Intelligence · Computer Science 2018-10-30 Zhang-Wei Hong , Tzu-Yun Shann , Shih-Yang Su , Yi-Hsiang Chang , Chun-Yi Lee

Exploration in environments with continuous control and sparse rewards remains a key challenge in reinforcement learning (RL). Recently, surprise has been used as an intrinsic reward that encourages systematic and efficient exploration. We…

Machine Learning · Computer Science 2019-11-01 Haitao Xu , Brendan McCane , Lech Szymanski

One of the bottlenecks preventing Deep Reinforcement Learning algorithms (DRL) from real-world applications is how to explore the environment and collect informative transitions efficiently. The present paper describes bounded exploration,…

Machine Learning · Computer Science 2024-12-10 Ting Qiao , Henry Williams , David Valencia , Bruce MacDonald

Imitation learning in a high-dimensional environment is challenging. Most inverse reinforcement learning (IRL) methods fail to outperform the demonstrator in such a high-dimensional environment, e.g., Atari domain. To address this…

Machine Learning · Computer Science 2020-09-14 Xingrui Yu , Yueming Lyu , Ivor W. Tsang

Deep reinforcement learning methods exhibit impressive performance on a range of tasks but still struggle on hard exploration tasks in large environments with sparse rewards. To address this, intrinsic rewards can be generated using forward…

Artificial Intelligence · Computer Science 2023-10-27 Jaedong Hwang , Zhang-Wei Hong , Eric Chen , Akhilan Boopathy , Pulkit Agrawal , Ila Fiete

Efficient exploration remains a major challenge for reinforcement learning. One reason is that the variability of the returns often depends on the current state and action, and is therefore heteroscedastic. Classical exploration strategies…

Machine Learning · Computer Science 2019-03-26 Nikolay Nikolov , Johannes Kirschner , Felix Berkenkamp , Andreas Krause

Learning in environments with sparse rewards remains a fundamental challenge in reinforcement learning. Artificial curiosity addresses this limitation through intrinsic rewards to guide exploration, however, the precise formulation of these…

Machine Learning · Computer Science 2026-04-20 Alexander Nedergaard , Pablo A. Morales

The exploration \& exploitation dilemma poses significant challenges in reinforcement learning (RL). Recently, curiosity-based exploration methods achieved great success in tackling hard-exploration problems. However, they necessitate…

Machine Learning · Computer Science 2024-12-06 Yiran Wang , Chenshu Liu , Yunfan Li , Sanae Amani , Bolei Zhou , Lin F. Yang

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

Machine Learning · Computer Science 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

This paper introduces a novel method of adding intrinsic bonuses to task-oriented reward function in order to efficiently facilitate reinforcement learning search. While various bonuses have been designed to date, they are analogous to the…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi

Reinforcement learning has been shown to be highly successful at many challenging tasks. However, success heavily relies on well-shaped rewards. Intrinsically motivated RL attempts to remove this constraint by defining an intrinsic reward…

Machine Learning · Computer Science 2021-03-16 Rui Zhao , Yang Gao , Pieter Abbeel , Volker Tresp , Wei Xu

While learning in an unknown Markov Decision Process (MDP), an agent should trade off exploration to discover new information about the MDP, and exploitation of the current knowledge to maximize the reward. Although the agent will…

Machine Learning · Computer Science 2020-07-16 Evrard Garcelon , Mohammad Ghavamzadeh , Alessandro Lazaric , Matteo Pirotta

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

Robotics · Computer Science 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur

In this work, we address the challenge of data-efficient exploration in reinforcement learning by examining existing principled, information-theoretic approaches to intrinsic motivation. Specifically, we focus on a class of exploration…

Machine Learning · Computer Science 2025-07-04 Alberto Caron , Chris Hicks , Vasilios Mavroudis

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

Artificial Intelligence · Computer Science 2025-12-05 Shuyuan Zhang

The human intrinsic desire to pursue knowledge, also known as curiosity, is considered essential in the process of skill acquisition. With the aid of artificial curiosity, we could equip current techniques for control, such as Reinforcement…

Machine Learning · Computer Science 2022-02-24 Pietro Mazzaglia , Ozan Catal , Tim Verbelen , Bart Dhoedt

Inferential decision-making algorithms typically assume that an underlying probabilistic model of decision alternatives and outcomes may be learned a priori or online. Furthermore, when applied to robots in real-world settings they often…

Robotics · Computer Science 2023-09-15 Yucheng Chen , Pingping Zhu , Anthony Alers , Tobias Egner , Marc A. Sommer , Silvia Ferrari

The objective of a reinforcement learning agent is to discover better actions through exploration. However, typical exploration techniques aim to maximize rewards, often incurring high costs in both exploration and learning processes. We…

Machine Learning · Computer Science 2024-12-24 Akane Tsuboya , Yu Kono , Tatsuji Takahashi

In order to provide adaptive and user-friendly solutions to robotic manipulation, it is important that the agent can learn to accomplish tasks even if they are only provided with very sparse instruction signals. To address the issues…

Robotics · Computer Science 2021-06-18 Siyu Dai , Wei Xu , Andreas Hofmann , Brian Williams