English
Related papers

Related papers: Increasing Entropy to Boost Policy Gradient Perfor…

200 papers

We revisit the Reinforce policy gradient algorithm from the literature. Note that this algorithm typically works with cost returns obtained over random length episodes obtained from either termination upon reaching a goal state (as with…

Machine Learning · Computer Science 2023-10-10 Shalabh Bhatnagar

In reinforcement learning (RL), it is often advantageous to consider additional constraints on the action space to ensure safety or action relevance. Existing work on such action-constrained RL faces challenges regarding effective policy…

Machine Learning · Computer Science 2025-12-01 Roland Stolz , Michael Eichelbeck , Matthias Althoff

Projected policy gradient under the simplex parameterization, policy gradient and natural policy gradient under the softmax parameterization, are fundamental algorithms in reinforcement learning. There have been a flurry of recent…

Optimization and Control · Mathematics 2024-04-12 Jiacai Liu , Wenye Li , Ke Wei

In long-horizon tasks, recent agents based on Large Language Models (LLMs) face a significant challenge that sparse, outcome-based rewards make it difficult to assign credit to intermediate steps. Previous methods mainly focus on creating…

Machine Learning · Computer Science 2025-09-12 Jiawei Wang , Jiacai Liu , Yuqian Fu , Yingru Li , Xintao Wang , Yuan Lin , Yu Yue , Lin Zhang , Yang Wang , Ke Wang

Direct optimization is an appealing framework that replaces integration with optimization of a random objective for approximating gradients in models with discrete random variables. A$^\star$ sampling is a framework for optimizing such…

Machine Learning · Computer Science 2020-10-26 Guy Lorberbom , Chris J. Maddison , Nicolas Heess , Tamir Hazan , Daniel Tarlow

We study the problem of efficiently estimating policies that simultaneously optimize multiple objectives in reinforcement learning (RL). Given $n$ objectives (or tasks), we seek the optimal partition of these objectives into $k \ll n$…

Machine Learning · Computer Science 2026-02-24 Zhenshuo Zhang , Minxuan Duan , Youran Ye , Hongyang R. Zhang

Deep reinforcement learning agents frequently suffer from premature convergence, where early entropy collapse causes the policy to discard exploratory behaviors before discovering globally optimal strategies. We introduce Optimistic Policy…

Machine Learning · Computer Science 2026-03-10 Mai Pham , Vikrant Vaze , Peter Chin

Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently…

Machine Learning · Computer Science 2019-05-15 Andreas Doerr , Michael Volpp , Marc Toussaint , Sebastian Trimpe , Christian Daniel

Policy gradient methods hold great potential for solving complex continuous control tasks. Still, their training efficiency can be improved by exploiting structure within the optimization problem. Recent work indicates that supervised…

Machine Learning · Computer Science 2024-03-19 Jan Schneider , Pierre Schumacher , Simon Guist , Le Chen , Daniel Häufle , Bernhard Schölkopf , Dieter Büchler

Deep reinforcement learning (RL) agents often fail to generalize to unseen scenarios, even when they are trained on many instances of semantically similar environments. Data augmentation has recently been shown to improve the sample…

Machine Learning · Computer Science 2021-02-23 Roberta Raileanu , Max Goldstein , Denis Yarats , Ilya Kostrikov , Rob Fergus

Deploying a safe mobile robot policy in scenarios with human pedestrians is challenging due to their unpredictable movements. Current Reinforcement Learning-based motion planners rely on a single policy to simulate pedestrian movements and…

Robotics · Computer Science 2024-10-17 Wen Zheng Terence Ng , Jianda Chen , Sinno Jialin Pan , Tianwei Zhang

Policy regularization methods such as maximum entropy regularization are widely used in reinforcement learning to improve the robustness of a learned policy. In this paper, we show how this robustness arises from hedging against worst-case…

Machine Learning · Computer Science 2024-04-29 Rob Brekelmans , Tim Genewein , Jordi Grau-Moya , Grégoire Delétang , Markus Kunesch , Shane Legg , Pedro Ortega

Policy gradient methods usually rely on entropy regularization to prevent premature convergence. However, maximizing entropy indiscriminately pushes the policy towards a uniform distribution, often overriding the reward signal if not…

Machine Learning · Computer Science 2026-03-06 Luca Serfilippi , Giorgio Franceschelli , Antonio Corradi , Mirco Musolesi

In recent years, on-policy reinforcement learning (RL) has been successfully applied to many different continuous control tasks. While RL algorithms are often conceptually simple, their state-of-the-art implementations take numerous low-…

We study the global convergence of policy gradient for infinite-horizon, continuous state and action space, and entropy-regularized Markov decision processes (MDPs). We consider a softmax policy with (one-hidden layer) neural network…

Optimization and Control · Mathematics 2022-06-17 Bekzhan Kerimkulov , James-Michael Leahy , David Šiška , Lukasz Szpruch

Reasoning ability has become a defining capability of Large Language Models (LLMs), with Reinforcement Learning with Verifiable Rewards (RLVR) emerging as a key paradigm to enhance it. However, RLVR training often suffers from policy…

Machine Learning · Computer Science 2026-04-20 Xiaoyun Zhang , Xiaojian Yuan , Di Huang , Wang You , Chen Hu , Jingqing Ruan , Ai Jian , Kejiang Chen , Xing Hu

Regularized reinforcement learning (RL), particularly the entropy-regularized kind, has gained traction in optimal control and inverse RL. While standard unregularized RL methods remain unaffected by changes in the number of actions, we…

Machine Learning · Computer Science 2025-01-10 Sobhan Mohammadpour , Emma Frejinger , Pierre-Luc Bacon

Model-based planners for partially observable problems must accommodate both model uncertainty during planning and goal uncertainty during objective inference. However, model-based planners may be brittle under these types of uncertainty…

Artificial Intelligence · Computer Science 2024-02-15 Harrison Delecki , Marcell Vazquez-Chanlatte , Esen Yel , Kyle Wray , Tomer Arnon , Stefan Witwicki , Mykel J. Kochenderfer

Composing previously mastered skills to solve novel tasks promises dramatic improvements in the data efficiency of reinforcement learning. Here, we analyze two recent works composing behaviors represented in the form of action-value…

Machine Learning · Computer Science 2019-07-08 Jonathan J Hunt , Andre Barreto , Timothy P Lillicrap , Nicolas Heess

Reinforcement learning~(RL) is a versatile framework for learning to solve complex real-world tasks. However, influences on the learning performance of RL algorithms are often poorly understood in practice. We discuss different analysis…

Machine Learning · Computer Science 2023-09-14 Jan Schneider , Pierre Schumacher , Daniel Häufle , Bernhard Schölkopf , Dieter Büchler