English
Related papers

Related papers: CIM: Constrained Intrinsic Motivation for Sparse-R…

200 papers

Recently, there has been a great deal of research in emergent communication on artificial agents interacting in simulated environments. Recent studies have revealed that, in general, emergent languages do not follow the compositionality…

Computation and Language · Computer Science 2023-01-30 Rishi Hazra , Sonu Dixit , Sayambhu Sen

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

Computation and Language · Computer Science 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

Exploration in complex domains is a key challenge in reinforcement learning, especially for tasks with very sparse rewards. Recent successes in deep reinforcement learning have been achieved mostly using simple heuristic exploration…

Machine Learning · Computer Science 2017-03-07 Joshua Achiam , Shankar Sastry

There is a growing interest and literature on intrinsic motivations and open-ended learning in both cognitive robotics and machine learning on one side, and in psychology and neuroscience on the other. This paper aims to review some…

Artificial Intelligence · Computer Science 2020-01-01 Gianluca Baldassarre

State-of-the-art reinforcement learning (RL) algorithms typically use random sampling (e.g., $\epsilon$-greedy) for exploration, but this method fails on hard exploration tasks like Montezuma's Revenge. To address the challenge of…

Machine Learning · Computer Science 2022-11-21 Eric Chen , Zhang-Wei Hong , Joni Pajarinen , Pulkit Agrawal

In the absence of external rewards, agents can still learn useful behaviors by identifying and mastering a set of diverse skills within their environment. Existing skill learning methods use mutual information objectives to incentivize each…

Artificial Intelligence · Computer Science 2020-12-15 Kate Baumli , David Warde-Farley , Steven Hansen , Volodymyr Mnih

Reinforcement Learning (RL) is known to be often unsuccessful in environments with sparse extrinsic rewards. A possible countermeasure is to endow RL agents with an intrinsic reward function, or 'intrinsic motivation', which rewards the…

Artificial Intelligence · Computer Science 2021-07-16 Francesco Massari , Martin Biehl , Lisa Meeden , Ryota Kanai

Sparse rewards are double-edged training signals in reinforcement learning: easy to design but hard to optimize. Intrinsic motivation guidances have thus been developed toward alleviating the resulting exploration problem. They usually…

Machine Learning · Computer Science 2021-06-01 Mathieu Seurin , Florian Strub , Philippe Preux , Olivier Pietquin

Conversational Recommender Systems (CRS) actively elicit user preferences to generate adaptive recommendations. Mainstream reinforcement learning-based CRS solutions heavily rely on handcrafted reward functions, which may not be aligned…

Information Retrieval · Computer Science 2023-11-01 Zhendong Chu , Nan Wang , Hongning Wang

This work re-examines the commonly held assumption that the frequency of rewards is a reliable measure of task difficulty in reinforcement learning. We identify and formalize a structural challenge that undermines the effectiveness of…

Machine Learning · Computer Science 2025-07-03 Yannick Molinghen , Tom Lenaerts

Reinforcement learning with human feedback for aligning large language models (LLMs) trains a reward model typically using ranking loss with comparison pairs.However, the training procedure suffers from an inherent problem: the uncontrolled…

Computation and Language · Computer Science 2024-09-19 Hang Zhou , Chenglong Wang , Yimin Hu , Tong Xiao , Chunliang Zhang , Jingbo Zhu

We present a novel intrinsically motivated agent that learns how to control the environment in the fastest possible manner by optimizing learning progress. It learns what can be controlled, how to allocate time and attention, and the…

Machine Learning · Computer Science 2020-01-10 Sebastian Blaes , Marin Vlastelica Pogančić , Jia-Jie Zhu , Georg Martius

Current reinforcement learning algorithms struggle in sparse and complex environments, most notably in long-horizon manipulation tasks entailing a plethora of different sequences. In this work, we propose the Intrinsically Guided…

Robotics · Computer Science 2024-03-08 Eleftherios Triantafyllidis , Filippos Christianos , Zhibin Li

The study of exploration in the domain of decision making has a long history but remains actively debated. From the vast literature that addressed this topic for decades under various points of view (e.g., developmental psychology,…

Machine Learning · Computer Science 2021-01-14 Léonard Hussenot , Robert Dadashi , Matthieu Geist , Olivier Pietquin

Efficient exploration in multi-agent reinforcement learning (MARL) is a challenging problem when receiving only a team reward, especially in environments with sparse rewards. A powerful method to mitigate this issue involves crafting dense…

Machine Learning · Computer Science 2025-07-28 Xuefei Wu , Xiao Yin , Yuanyang Zhu , Chunlin Chen

In this paper we address the challenge of exploration in deep reinforcement learning for robotic manipulation tasks. In sparse goal settings, an agent does not receive any positive feedback until randomly achieving the goal, which becomes…

Robotics · Computer Science 2021-02-23 Nikola Vulin , Sammy Christen , Stefan Stevsic , Otmar Hilliges

Exploring in environments with high-dimensional observations is hard. One promising approach for exploration is to use intrinsic rewards, which often boils down to estimating "novelty" of states, transitions, or trajectories with deep…

Machine Learning · Computer Science 2023-05-17 Toru Lin , Allan Jabri

When deploying machine learning solutions, they must satisfy multiple requirements beyond accuracy, such as fairness, robustness, or safety. These requirements are imposed during training either implicitly, using penalties, or explicitly,…

Machine Learning · Computer Science 2024-01-12 Ignacio Hounie , Alejandro Ribeiro , Luiz F. O. Chamon

In the early stages of human life, babies develop their skills by exploring different scenarios motivated by their inherent satisfaction rather than by extrinsic rewards from the environment. This behavior, referred to as intrinsic…

Machine Learning · Computer Science 2022-02-25 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

Robotics · Computer Science 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur