English
Related papers

Related papers: Handling Sparse Rewards in Reinforcement Learning …

200 papers

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

Machine Learning · Computer Science 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Model-based reinforcement learning (MBRL) is sample-efficient but struggles in sparse reward settings. A critical bottleneck arises from the lack of informative gradients in sparse settings, where standard reward models often yield flat…

Machine Learning · Computer Science 2026-05-11 Yao-Hui Li , Zeyu Wang , Xin Li , Wei Pang , Yingfang Yuan , Zhengkun Chen , Boya Zhang , Riashat Islam , Alex Lamb , Yonggang Zhang

Reinforcement learning (RL) in sparse-reward environments remains a significant challenge due to the lack of informative feedback. We propose a simple yet effective method that uses a small number of successful demonstrations to initialize…

Machine Learning · Computer Science 2025-10-29 Seyed Mahdi Basiri Azad , Joschka Boedecker

Mastering robotic manipulation skills through reinforcement learning (RL) typically requires the design of shaped reward functions. Recent developments in this area have demonstrated that using sparse rewards, i.e. rewarding the agent only…

Machine Learning · Computer Science 2021-11-12 Ozsel Kilinc , Giovanni Montana

The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning…

Robotics · Computer Science 2022-07-21 Jaeuk Shin , Astghik Hakobyan , Mingyu Park , Yeoneung Kim , Gihun Kim , Insoon Yang

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

Machine Learning · Computer Science 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal…

Machine Learning · Computer Science 2018-02-27 Ashvin Nair , Bob McGrew , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

Recent studies have shown that reinforcement learning (RL) models are vulnerable in various noisy scenarios. For instance, the observed reward channel is often subject to noise in practice (e.g., when rewards are collected through sensors),…

Machine Learning · Computer Science 2020-02-04 Jingkang Wang , Yang Liu , Bo Li

While using shaped rewards can be beneficial when solving sparse reward tasks, their successful application often requires careful engineering and is problem specific. For instance, in tasks where the agent must achieve some goal state,…

Artificial Intelligence · Computer Science 2019-11-05 Alexander Trott , Stephan Zheng , Caiming Xiong , Richard Socher

In spite of the success of existing meta reinforcement learning methods, they still have difficulty in learning a meta policy effectively for RL problems with sparse reward. In this respect, we develop a novel meta reinforcement learning…

Machine Learning · Computer Science 2021-06-08 Yun Hua , Xiangfeng Wang , Bo Jin , Wenhao Li , Junchi Yan , Xiaofeng He , Hongyuan Zha

Reinforcement Learning has emerged as a strong alternative to solve optimization tasks efficiently. The use of these algorithms highly depends on the feedback signals provided by the environment in charge of informing about how good (or…

Machine Learning · Computer Science 2022-12-01 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

Multiagent Systems · Computer Science 2026-05-25 Elie Abboud , Oren Gal

The reward signal plays a central role in defining the desired behaviors of agents in reinforcement learning (RL). Rewards collected from realistic environments could be perturbed, corrupted, or noisy due to an adversary, sensor error, or…

Machine Learning · Computer Science 2025-03-12 Xi Chen , Zhihui Zhu , Andrew Perrault

Reinforcement learning algorithms often suffer from slow convergence due to sparse reward signals, particularly in complex environments where feedback is delayed or infrequent. This paper introduces the Psychological Regret Model (PRM), a…

Machine Learning · Computer Science 2026-02-04 Zhe Xu

In Europe, profit-seeking balance responsible parties can deviate in real time from their day-ahead nominations to assist transmission system operators in maintaining the supply-demand balance. Model predictive control (MPC) strategies to…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Seyed Soroush Karimi Madahi , Kenneth Bruninx , Bert Claessens , Chris Develder

Reward design is a fundamental problem in reinforcement learning (RL). A misspecified or poorly designed reward can result in low sample efficiency and undesired behaviors. In this paper, we propose the idea of programmatic reward design,…

Machine Learning · Computer Science 2022-01-10 Weichao Zhou , Wenchao Li

Conveying complex objectives to reinforcement learning (RL) agents can often be difficult, involving meticulous design of reward functions that are sufficiently informative yet easy enough to provide. Human-in-the-loop RL methods allow…

Machine Learning · Computer Science 2021-06-10 Kimin Lee , Laura Smith , Pieter Abbeel

For task-oriented dialog systems, training a Reinforcement Learning (RL) based Dialog Management module suffers from low sample efficiency and slow convergence speed due to the sparse rewards in RL.To solve this problem, many strategies…

Computation and Language · Computer Science 2021-04-13 Zhengxu Hou , Bang Liu , Ruihui Zhao , Zijing Ou , Yafei Liu , Xi Chen , Yefeng Zheng

Reinforcement learning often suffer from the sparse reward issue in real-world robotics problems. Learning from demonstration (LfD) is an effective way to eliminate this problem, which leverages collected expert data to aid online learning.…

Robotics · Computer Science 2023-03-09 Yanjiang Guo , Jingyue Gao , Zheng Wu , Chengming Shi , Jianyu Chen