English
Related papers

Related papers: Automatic Intrinsic Reward Shaping for Exploration…

200 papers

Reinforcement learning for embodied agents is a challenging problem. The accumulated reward to be optimized is often a very rugged function, and gradient methods are impaired by many local optimizers. We demonstrate, in an experimental…

Artificial Intelligence · Computer Science 2016-06-01 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

Episodic rewards present a significant challenge in reinforcement learning. While intrinsic reward methods have demonstrated effectiveness in single-agent rein-forcement learning scenarios, their application to multi-agent reinforcement…

Artificial Intelligence · Computer Science 2025-11-24 Kesheng Chen , Wenjian Luo , Bang Zhang , Zeping Yin , Zipeng Ye

Reinforcement Learning (RL) has become a key approach for enhancing the reasoning capabilities of large language models. However, prevalent RL approaches like proximal policy optimization and group relative policy optimization suffer from…

Machine Learning · Computer Science 2026-02-02 Jingtong Gao , Ling Pan , Yejing Wang , Rui Zhong , Chi Lu , Maolin Wang , Qingpeng Cai , Peng Jiang , Xiangyu Zhao

Reinforcement learning (RL) has successfully automated the complex process of mining formulaic alpha factors, for creating interpretable and profitable investment strategies. However, existing methods are hampered by the sparse rewards…

Machine Learning · Computer Science 2025-07-29 Junjie Zhao , Chengxi Zhang , Chenkai Wang , Peng Yang

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

Machine Learning · Computer Science 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

Optimizing techniques for discovering molecular structures with desired properties is crucial in artificial intelligence(AI)-based drug discovery. Combining deep generative models with reinforcement learning has emerged as an effective…

Machine Learning · Computer Science 2024-04-01 Jinyeong Park , Jaegyoon Ahn , Jonghwan Choi , Jibum Kim

Deducing the contribution of each agent and assigning the corresponding reward to them is a crucial problem in cooperative Multi-Agent Reinforcement Learning (MARL). Previous studies try to resolve the issue through designing an intrinsic…

Machine Learning · Computer Science 2023-02-21 Wei Li , Weiyan Liu , Shitong Shao , Shiyi Huang

The main challenge in developing effective reinforcement learning (RL) pipelines is often the design and tuning the reward functions. Well-designed shaping reward can lead to significantly faster learning. Naively formulated rewards,…

Robotics · Computer Science 2023-07-20 Se Hwan Jeon , Steve Heim , Charles Khazoom , Sangbae Kim

Deep Reinforcement Learning (DRL) has recently spread into a range of domains within physics and engineering, with multiple remarkable achievements. Still, much remains to be explored before the capabilities of these methods are well…

Computational Engineering, Finance, and Science · Computer Science 2020-12-22 Jonathan Viquerat , Jean Rabault , Alexander Kuhnle , Hassan Ghraieb , Aurélien Larcher , Elie Hachem

Conversational Recommender Systems (CRS) actively elicit user preferences to generate adaptive recommendations. Mainstream reinforcement learning-based CRS solutions heavily rely on handcrafted reward functions, which may not be aligned…

Information Retrieval · Computer Science 2023-11-01 Zhendong Chu , Nan Wang , Hongning Wang

Exploration is essential in reinforcement learning, particularly in environments where external rewards are sparse. Here we focus on exploration with intrinsic rewards, where the agent transiently augments the external rewards with…

Machine Learning · Computer Science 2024-01-26 Changmin Yu , Neil Burgess , Maneesh Sahani , Samuel J. Gershman

In addressing control problems such as regulation and tracking through reinforcement learning, it is often required to guarantee that the acquired policy meets essential performance and stability criteria such as a desired settling time and…

Systems and Control · Electrical Eng. & Systems 2024-03-21 Francesco De Lellis , Marco Coraggio , Giovanni Russo , Mirco Musolesi , Mario di Bernardo

Learning effective policies for sparse objectives is a key challenge in Deep Reinforcement Learning (RL). A common approach is to design task-related dense rewards to improve task learnability. While such rewards are easily interpreted,…

Machine Learning · Computer Science 2020-10-12 Hassam Sheikh , Shauharda Khadka , Santiago Miret , Somdeb Majumdar

Reinforcement Learning (RL) has been widely used to solve tasks where the environment consistently provides a dense reward value. However, in real-world scenarios, rewards can often be poorly defined or sparse. Auxiliary signals are…

Artificial Intelligence · Computer Science 2024-08-01 David Valencia , Henry Williams , Yuning Xing , Trevor Gee , Minas Liarokapis , Bruce A. MacDonald

Large Multimodal Models (LMMs) excel at comprehending human instructions and demonstrate remarkable results across a broad spectrum of tasks. Reinforcement Learning from Human Feedback (RLHF) and AI Feedback (RLAIF) further refine LLMs by…

Artificial Intelligence · Computer Science 2024-10-07 Ju-Seung Byun , Jiyun Chun , Jihyung Kil , Andrew Perrault

Positive affect has been linked to increased interest, curiosity and satisfaction in human learning. In reinforcement learning, extrinsic rewards are often sparse and difficult to define, intrinsically motivated learning can help address…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Dean Zadok , Daniel McDuff , Ashish Kapoor

Test-time scaling (TTS) for large language models (LLMs) has thus far fallen into two largely separate paradigms: (1) reinforcement learning (RL) methods that optimize sparse outcome-based rewards, yet suffer from instability and low sample…

Machine Learning · Computer Science 2026-02-10 Can Jin , Yang Zhou , Qixin Zhang , Hongwu Peng , Di Zhang , Zihan Dong , Marco Pavone , Ligong Han , Zhang-Wei Hong , Tong Che , Dimitris N. Metaxas

In continuing tasks, average-reward reinforcement learning may be a more appropriate problem formulation than the more common discounted reward formulation. As usual, learning an optimal policy in this setting typically requires a large…

Artificial Intelligence · Computer Science 2023-01-18 Yuqian Jiang , Sudarshanan Bharadwaj , Bo Wu , Rishi Shah , Ufuk Topcu , Peter Stone

Deep reinforcement learning agents have achieved state-of-the-art results by directly maximising cumulative reward. However, environments contain a much wider variety of possible training signals. In this paper, we introduce an agent that…

We consider the problem of reward learning for temporally extended tasks. For reward learning, inverse reinforcement learning (IRL) is a widely used paradigm. Given a Markov decision process (MDP) and a set of demonstrations for a task, IRL…

Robotics · Computer Science 2021-07-14 Farzan Memarian , Zhe Xu , Bo Wu , Min Wen , Ufuk Topcu