English
Related papers

Related papers: Linear Convergence of Entropy-Regularized Natural …

200 papers

We study the sequential decision making problem of maximizing the expected total reward while satisfying a constraint on the expected total utility. We employ the natural policy gradient method to solve the discounted infinite-horizon…

Optimization and Control · Mathematics 2025-10-16 Dongsheng Ding , Kaiqing Zhang , Jiali Duan , Tamer Başar , Mihailo R. Jovanović

The softmax policy gradient (PG) method, which performs gradient ascent under softmax policy parameterization, is arguably one of the de facto implementations of policy optimization in modern reinforcement learning. For $\gamma$-discounted…

Machine Learning · Computer Science 2022-12-19 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

A major challenge in multi-agent systems is that the system complexity grows dramatically with the number of agents as well as the size of their action spaces, which is typical in real world scenarios such as autonomous vehicles, robotic…

Optimization and Control · Mathematics 2022-08-31 Shicong Cen , Fan Chen , Yuejie Chi

We propose a general framework for entropy-regularized average-reward reinforcement learning in Markov decision processes (MDPs). Our approach is based on extending the linear-programming formulation of policy optimization in MDPs to…

Machine Learning · Computer Science 2017-05-23 Gergely Neu , Anders Jonsson , Vicenç Gómez

Entropy regularization has been widely used in policy optimization algorithms to enhance exploration and the robustness of the optimal control; however it also introduces an additional regularization bias. This work quantifies the impact of…

Optimization and Control · Mathematics 2025-03-25 Deven Sethi , David Šiška , Yufei Zhang

Natural policy gradient (NPG) is a common policy optimization algorithm and can be viewed as mirror ascent in the space of probabilities. Recently, Vaswani et al. [2021] introduced a policy gradient method that corresponds to mirror ascent…

Machine Learning · Computer Science 2025-06-02 Reza Asad , Reza Babanezhad , Issam Laradji , Nicolas Le Roux , Sharan Vaswani

Reinforcement Learning (RL) has emerged as a powerful framework for sequential decision-making in dynamic environments, particularly when system parameters are unknown. This paper investigates RL-based control for entropy-regularized…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Gabriel Diaz , Lucky Li , Wenhao Zhang

Various acceleration approaches for Policy Gradient (PG) have been analyzed within the realm of Reinforcement Learning (RL). However, the theoretical understanding of the widely used momentum-based acceleration method on PG remains largely…

Machine Learning · Computer Science 2024-06-07 Yen-Ju Chen , Nai-Chieh Huang , Ching-Pei Lee , Ping-Chun Hsieh

We revisit the finite time analysis of policy gradient methods in the one of the simplest settings: finite state and action MDPs with a policy class consisting of all stochastic policies and with exact gradient evaluations. There has been…

Machine Learning · Computer Science 2021-12-14 Jalaj Bhandari , Daniel Russo

In this paper, we present a probability one convergence proof, under suitable conditions, of a certain class of actor-critic algorithms for finding approximate solutions to entropy-regularized MDPs using the machinery of stochastic…

Machine Learning · Computer Science 2019-10-23 Wesley Suttle , Zhuoran Yang , Kaiqing Zhang , Ji Liu

Entropy regularization is an important idea in reinforcement learning, with great success in recent algorithms like Soft Q Network (SQN) and Soft Actor-Critic (SAC1). In this work, we extend this idea into the on-policy realm. We propose…

Machine Learning · Computer Science 2020-10-19 Jingbin Liu , Xinyang Gu , Shuai Liu

Despite its popularity in the reinforcement learning community, a provably convergent policy gradient method for continuous space-time control problems with nonlinear state dynamics has been elusive. This paper proposes proximal gradient…

Optimization and Control · Mathematics 2022-12-27 Christoph Reisinger , Wolfgang Stockinger , Yufei Zhang

Softmax policy gradient is a popular algorithm for policy optimization in single-agent reinforcement learning, particularly since projection is not needed for each gradient update. However, in multi-agent systems, the lack of central…

Optimization and Control · Mathematics 2022-11-01 Runyu Zhang , Jincheng Mei , Bo Dai , Dale Schuurmans , Na Li

Risk-sensitive reinforcement learning (RL) has become a popular tool for controlling the risk of uncertain outcomes and ensuring reliable performance in highly stochastic sequential decision-making problems. While it has been shown that…

Machine Learning · Computer Science 2026-01-21 Xian Yu , Lei Ying

We study the performance of policy gradient methods for the subclass of Markov games known as Markov potential games (MPGs), which extends the notion of normal-form potential games to the stateful setting and includes the important special…

Multiagent Systems · Computer Science 2022-06-16 Dingyang Chen , Qi Zhang , Thinh T. Doan

We provide global convergence rates for vanilla and entropy-regularized federated softmax stochastic policy gradient (FedPG) with local training. We show that FedPG converges to a near-optimal policy in terms of the average agent value,…

Machine Learning · Computer Science 2026-04-02 Safwan Labbi , Paul Mangold , Daniil Tiapkin , Eric Moulines

We study entropy-regularized constrained Markov decision processes (CMDPs) under the soft-max parameterization, in which an agent aims to maximize the entropy-regularized value function while satisfying constraints on the expected total…

Machine Learning · Computer Science 2023-04-10 Donghao Ying , Yuhao Ding , Javad Lavaei

Policy gradient methods are known to be highly sensitive to the choice of policy parameterization. In particular, the widely used softmax parameterization can induce ill-conditioned optimization landscapes and lead to exponentially slow…

Machine Learning · Computer Science 2026-04-02 Safwan Labbi , Daniil Tiapkin , Paul Mangold , Eric Moulines

While policy optimization algorithms have played an important role in recent empirical success of Reinforcement Learning (RL), the existing theoretical understanding of policy optimization remains rather limited -- they are either…

Machine Learning · Computer Science 2023-12-05 Qinghua Liu , Gellért Weisz , András György , Chi Jin , Csaba Szepesvári

Regularization is one of the most important techniques in reinforcement learning algorithms. The well-known soft actor-critic algorithm is a special case of regularized policy iteration where the regularizer is chosen as Shannon entropy.…

Machine Learning · Computer Science 2023-10-12 Zeyang Li , Chuxiong Hu , Yunan Wang , Guojian Zhan , Jie Li , Shengbo Eben Li