English
Related papers

Related papers: Mega-Reward: Achieving Human-Level Play without Ex…

200 papers

"Intrinsic motivation" refers to the capacity for intelligent systems to be motivated endogenously, i.e. by features of agential architecture itself rather than by learned associations between action and reward. This paper views active…

Neurons and Cognition · Quantitative Biology 2025-02-14 Alex B. Kiefer

Infants often exhibit goal-directed behaviors, such as reaching for a sensory stimulus, even when no external reward criterion is provided. These intrinsically motivated behaviors facilitate spontaneous exploration and learning of the body…

Artificial Intelligence · Computer Science 2025-11-12 Dongmin Kim , Hoshinori Kanazawa , Naoto Yoshida , Yasuo Kuniyoshi

Mechanism design is a well-established game-theoretic paradigm for designing games to achieve desired outcomes. This paper addresses a closely related but distinct concept, equilibrium design. Unlike mechanism design, the designer's…

Computer Science and Game Theory · Computer Science 2024-08-20 Muhammad Najib , Giuseppe Perelli

Large Language Models have demonstrated outstanding performance across various downstream tasks and have been widely applied in multiple scenarios. Human-annotated preference data is used for training to further improve LLMs' performance,…

Computation and Language · Computer Science 2025-03-06 Shimao Zhang , Xiao Liu , Xin Zhang , Junxiao Liu , Zheheng Luo , Shujian Huang , Yeyun Gong

In many real-world scenarios, rewards extrinsic to the agent are extremely sparse, or absent altogether. In such cases, curiosity can serve as an intrinsic reward signal to enable the agent to explore its environment and learn skills that…

Machine Learning · Computer Science 2017-05-16 Deepak Pathak , Pulkit Agrawal , Alexei A. Efros , Trevor Darrell

We study the role of intrinsic motivation as an exploration bias for reinforcement learning in sparse-reward synergistic tasks, which are tasks where multiple agents must work together to achieve a goal they could not individually. Our key…

Machine Learning · Computer Science 2020-02-14 Rohan Chitnis , Shubham Tulsiani , Saurabh Gupta , Abhinav Gupta

Efficient exploration is a challenging topic in reinforcement learning, especially for sparse reward tasks. To deal with the reward sparsity, people commonly apply intrinsic rewards to motivate agents to explore the state space efficiently.…

Machine Learning · Computer Science 2023-08-29 Yao Fu , Run Peng , Honglak Lee

Efficient exploration in multi-agent reinforcement learning (MARL) is a challenging problem when receiving only a team reward, especially in environments with sparse rewards. A powerful method to mitigate this issue involves crafting dense…

Machine Learning · Computer Science 2025-07-28 Xuefei Wu , Xiao Yin , Yuanyang Zhu , Chunlin Chen

Empowerment is an information-theoretic method that can be used to intrinsically motivate learning agents. It attempts to maximize an agent's control over the environment by encouraging visiting states with a large number of reachable next…

Machine Learning · Computer Science 2020-01-09 Felix Leibfried , Sergio Pascual-Diaz , Jordi Grau-Moya

In environments with sparse rewards, finding a good inductive bias for exploration is crucial to the agent's success. However, there are two competing goals: novelty search and systematic exploration. While existing approaches such as…

Machine Learning · Computer Science 2023-08-31 Stefan Sylvius Wagner , Peter Arndt , Jan Robine , Stefan Harmeling

This paper introduces a novel method of adding intrinsic bonuses to task-oriented reward function in order to efficiently facilitate reinforcement learning search. While various bonuses have been designed to date, they are analogous to the…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi

Humans are spectacular reinforcement learners, constantly learning from and adjusting to experience and feedback. Unfortunately, this doesn't necessarily mean humans are fast learners. When tasks are challenging, learning can become…

Machine Learning · Computer Science 2022-12-16 Mark A. Rucker , Layne T. Watson , Matthew S. Gerber , Laura E. Barnes

Conversational Recommender Systems (CRS) actively elicit user preferences to generate adaptive recommendations. Mainstream reinforcement learning-based CRS solutions heavily rely on handcrafted reward functions, which may not be aligned…

Information Retrieval · Computer Science 2023-11-01 Zhendong Chu , Nan Wang , Hongning Wang

Recently there has been a proliferation of intrinsic motivation (IM) reward-shaping methods to learn in complex and sparse-reward environments. These methods can often inadvertently change the set of optimal policies in an environment,…

Machine Learning · Computer Science 2024-02-13 Grant C. Forbes , Nitish Gupta , Leonardo Villalobos-Arias , Colin M. Potts , Arnav Jhala , David L. Roberts

Model-based reinforcement learning is a promising learning strategy for practical robotic applications due to its improved data-efficiency versus model-free counterparts. However, current state-of-the-art model-based methods rely on shaped…

Machine Learning · Computer Science 2023-08-10 Robert McCarthy , Qiang Wang , Stephen J. Redmond

Exploration is essential in reinforcement learning, particularly in environments where external rewards are sparse. Here we focus on exploration with intrinsic rewards, where the agent transiently augments the external rewards with…

Machine Learning · Computer Science 2024-01-26 Changmin Yu , Neil Burgess , Maneesh Sahani , Samuel J. Gershman

Driving behavior modeling is of great importance for designing safe, smart, and personalized autonomous driving systems. In this paper, an internal reward function-based driving model that emulates the human's decision-making mechanism is…

Robotics · Computer Science 2021-07-21 Zhiyu Huang , Jingda Wu , Chen Lv

Reward models play a critical role in guiding large language models toward outputs that align with human expectations. However, an open challenge remains in effectively utilizing test-time compute to enhance reward model performance. In…

Computation and Language · Computer Science 2025-05-21 Jiaxin Guo , Zewen Chi , Li Dong , Qingxiu Dong , Xun Wu , Shaohan Huang , Furu Wei

This paper investigates the use of intrinsic reward to guide exploration in multi-agent reinforcement learning. We discuss the challenges in applying intrinsic reward to multiple collaborative agents and demonstrate how unreliable reward…

Artificial Intelligence · Computer Science 2019-06-06 Wendelin Böhmer , Tabish Rashid , Shimon Whiteson

Reinforcement learning agents learn from rewards, but humans can uniquely assign value to novel, abstract outcomes in a goal-dependent manner. However, this flexibility is cognitively costly, making learning less efficient. Here, we propose…

Neurons and Cognition · Quantitative Biology 2025-09-11 Gaia Molinaro , Anne G. E. Collins