English
Related papers

Related papers: Geometry and convergence of natural policy gradien…

200 papers

We prove that, for finite-arm bandits with linear function approximation, the global convergence of policy gradient (PG) methods depends on inter-related properties between the policy update and the representation. textcolor{blue}{First},…

Machine Learning · Computer Science 2025-04-04 Jincheng Mei , Bo Dai , Alekh Agarwal , Mohammad Ghavamzadeh , Csaba Szepesvari , Dale Schuurmans

We consider the problem of designing sample efficient learning algorithms for infinite horizon discounted reward Markov Decision Process. Specifically, we propose the Accelerated Natural Policy Gradient (ANPG) algorithm that utilizes an…

Machine Learning · Computer Science 2024-02-06 Washim Uddin Mondal , Vaneet Aggarwal

Entropy regularization is an efficient technique for encouraging exploration and preventing a premature convergence of (vanilla) policy gradient methods in reinforcement learning (RL). However, the theoretical understanding of…

Machine Learning · Computer Science 2024-07-16 Yuhao Ding , Junzi Zhang , Hyunin Lee , Javad Lavaei

We study the global convergence of a Fisher-Rao policy gradient flow for infinite-horizon entropy-regularised Markov decision processes with Polish state and action space. The flow is a continuous-time analogue of a policy mirror descent…

Optimization and Control · Mathematics 2025-06-09 Bekzhan Kerimkulov , James-Michael Leahy , David Siska , Lukasz Szpruch , Yufei Zhang

Policy gradient methods are widely used in reinforcement learning. Yet, the nonconvexity of policy optimization poses significant challenges in understanding the global convergence of policy gradient methods. For a class of finite-horizon…

Optimization and Control · Mathematics 2026-03-10 Xin Chen , Yifan Hu , Minda Zhao

We present a new geometric interpretation of Markov Decision Processes (MDPs) with a natural normalization procedure that allows us to adjust the value function at each state without altering the advantage of any action with respect to any…

Machine Learning · Computer Science 2025-03-06 Arsenii Mustafin , Aleksei Pakharev , Alex Olshevsky , Ioannis Ch. Paschalidis

We propose a new policy gradient method, named homotopic policy mirror descent (HPMD), for solving discounted, infinite horizon MDPs with finite state and action spaces. HPMD performs a mirror descent type policy update with an additional…

Machine Learning · Computer Science 2022-11-30 Yan Li , Guanghui Lan , Tuo Zhao

We present the first finite time global convergence analysis of policy gradient in the context of infinite horizon average reward Markov decision processes (MDPs). Specifically, we focus on ergodic tabular MDPs with finite state and action…

Machine Learning · Computer Science 2024-03-12 Navdeep Kumar , Yashaswini Murthy , Itai Shufaro , Kfir Y. Levy , R. Srikant , Shie Mannor

This work focuses on the entropy-regularized independent natural policy gradient (NPG) algorithm in multi-agent reinforcement learning. In this work, agents are assumed to have access to an oracle with exact policy evaluation and seek to…

Machine Learning · Computer Science 2024-05-07 Youbang Sun , Tao Liu , P. R. Kumar , Shahin Shahrampour

We study policy gradient methods for continuous-action, entropy-regularized reinforcement learning through the lens of Wasserstein geometry. Starting from a Wasserstein proximal update, we derive Wasserstein Proximal Policy Gradient (WPPG)…

Machine Learning · Computer Science 2026-03-04 Zhaoyu Zhu , Shuhan Zhang , Rui Gao , Shuang Li

This work studies an independent natural policy gradient (NPG) algorithm for the multi-agent reinforcement learning problem in Markov potential games. It is shown that, under mild technical assumptions and the introduction of the…

Machine Learning · Computer Science 2023-10-30 Youbang Sun , Tao Liu , Ruida Zhou , P. R. Kumar , Shahin Shahrampour

Gradient-based algorithms are one of the methods of choice for the optimisation of Markov Decision Processes. In this article we will present a novel approximate Newton algorithm for the optimisation of such models. The algorithm has…

Optimization and Control · Mathematics 2015-08-05 Thomas Furmston , David Barber

We consider policy optimization methods in reinforcement learning settings where the state space is arbitrarily large, or even countably infinite. The motivation arises from control problems in communication networks, matching markets, and…

Machine Learning · Computer Science 2024-09-23 Yashaswini Murthy , Isaac Grosof , Siva Theja Maguluri , R. Srikant

Despite its popularity in the reinforcement learning community, a provably convergent policy gradient method for continuous space-time control problems with nonlinear state dynamics has been elusive. This paper proposes proximal gradient…

Optimization and Control · Mathematics 2022-12-27 Christoph Reisinger , Wolfgang Stockinger , Yufei Zhang

A novel Policy Gradient (PG) algorithm, called $\textit{Matryoshka Policy Gradient}$ (MPG), is introduced and studied, in the context of fixed-horizon max-entropy reinforcement learning, where an agent aims at maximizing entropy bonuses…

Machine Learning · Computer Science 2024-10-10 François Ged , Maria Han Veiga

Traditional policy gradient methods are fundamentally flawed. Natural gradients converge quicker and better, forming the foundation of contemporary Reinforcement Learning such as Trust Region Policy Optimization (TRPO) and Proximal Policy…

Machine Learning · Computer Science 2022-09-07 W. J. A. van Heeswijk

We study the performance of policy gradient methods for the subclass of Markov games known as Markov potential games (MPGs), which extends the notion of normal-form potential games to the stateful setting and includes the important special…

Multiagent Systems · Computer Science 2022-06-16 Dingyang Chen , Qi Zhang , Thinh T. Doan

Recently, the impressive empirical success of policy gradient (PG) methods has catalyzed the development of their theoretical foundations. Despite the huge efforts directed at the design of efficient stochastic PG-type algorithms, the…

Machine Learning · Computer Science 2023-11-09 Ilyas Fatkhullin , Anas Barakat , Anastasia Kireeva , Niao He

We consider the problem of constrained Markov decision process (CMDP) in continuous state-actions spaces where the goal is to maximize the expected cumulative reward subject to some constraints. We propose a novel Conservative Natural…

Machine Learning · Computer Science 2024-05-20 Qinbo Bai , Amrit Singh Bedi , Vaneet Aggarwal

We consider the problem of approximating a function by an element of a nonlinear manifold which admits a differentiable parametrization, typical examples being neural networks with differentiable activation functions or tensor networks.…

Machine Learning · Computer Science 2026-04-20 Anthony Nouy , Agustín Somacal