English
Related papers

Related papers: Matryoshka Policy Gradient for Entropy-Regularized…

200 papers

This paper aims to establish an entropy-regularized value-based reinforcement learning method that can ensure the monotonic improvement of policies at each policy update. Unlike previously proposed lower-bounds on policy improvement in…

Machine Learning · Computer Science 2020-08-26 Lingwei Zhu , Takamitsu Matsubara

In long-horizon tasks, recent agents based on Large Language Models (LLMs) face a significant challenge that sparse, outcome-based rewards make it difficult to assign credit to intermediate steps. Previous methods mainly focus on creating…

Machine Learning · Computer Science 2025-09-12 Jiawei Wang , Jiacai Liu , Yuqian Fu , Yingru Li , Xintao Wang , Yuan Lin , Yu Yue , Lin Zhang , Yang Wang , Ke Wang

Robust Markov decision processes (RMDPs) provide a promising framework for computing reliable policies in the face of model errors. Many successful reinforcement learning algorithms build on variations of policy-gradient methods, but…

Machine Learning · Computer Science 2024-05-15 Qiuhao Wang , Chin Pang Ho , Marek Petrik

We consider (stochastic) softmax policy gradient (PG) methods for bandits and tabular Markov decision processes (MDPs). While the PG objective is non-concave, recent research has used the objective's smoothness and gradient domination…

Machine Learning · Computer Science 2024-10-01 Michael Lu , Matin Aghaei , Anant Raj , Sharan Vaswani

Since its introduction a decade ago, \emph{relative entropy policy search} (REPS) has demonstrated successful policy learning on a number of simulated and real-world robotic domains, not to mention providing algorithmic components used by…

Machine Learning · Computer Science 2021-03-18 Aldo Pacchiano , Jonathan Lee , Peter Bartlett , Ofir Nachum

We study the global convergence of policy gradient for infinite-horizon entropy-regularized Markov decision processes (MDPs) with continuous state and action spaces. We consider log-linear softmax policies with linear function…

Machine Learning · Computer Science 2026-05-26 Ziyue Chen , David Šiška , Lukasz Szpruch

We study the error introduced by entropy regularization in infinite-horizon discrete discounted Markov decision processes. We show that this error decreases exponentially in the inverse regularization strength, both in a weighted…

Optimization and Control · Mathematics 2025-12-16 Johannes Müller , Semih Cayci

Multi-agent interactions are increasingly important in the context of reinforcement learning, and the theoretical foundations of policy gradient methods have attracted surging research interest. We investigate the global convergence of…

Optimization and Control · Mathematics 2023-03-21 Sarath Pattathil , Kaiqing Zhang , Asuman Ozdaglar

Policy gradient (PG) methods are popular and efficient for large-scale reinforcement learning due to their relative stability and incremental nature. In recent years, the empirical success of PG methods has led to the development of a…

Machine Learning · Computer Science 2022-05-24 Yuhao Ding , Junzi Zhang , Javad Lavaei

We prove that, for finite-arm bandits with linear function approximation, the global convergence of policy gradient (PG) methods depends on inter-related properties between the policy update and the representation. textcolor{blue}{First},…

Machine Learning · Computer Science 2025-04-04 Jincheng Mei , Bo Dai , Alekh Agarwal , Mohammad Ghavamzadeh , Csaba Szepesvari , Dale Schuurmans

We investigate the challenge of parametrizing policies for reinforcement learning (RL) in high-dimensional continuous action spaces. Our objective is to develop a multimodal policy that overcomes limitations inherent in the commonly-used…

Machine Learning · Computer Science 2023-07-21 Zhiao Huang , Litian Liang , Zhan Ling , Xuanlin Li , Chuang Gan , Hao Su

We study the sequential decision making problem of maximizing the expected total reward while satisfying a constraint on the expected total utility. We employ the natural policy gradient method to solve the discounted infinite-horizon…

Optimization and Control · Mathematics 2025-10-16 Dongsheng Ding , Kaiqing Zhang , Jiali Duan , Tamer Başar , Mihailo R. Jovanović

Markov Decision Processes are classically solved using Value Iteration and Policy Iteration algorithms. Recent interest in Reinforcement Learning has motivated the study of methods inspired by optimization, such as gradient ascent. Among…

Machine Learning · Computer Science 2021-05-05 Sajad Khodadadian , Prakirt Raj Jhunjhunwala , Sushil Mahavir Varma , Siva Theja Maguluri

Entropy Regularisation is a widely adopted technique that enhances policy optimisation performance and stability. A notable form of entropy regularisation is augmenting the objective with an entropy term, thereby simultaneously optimising…

Machine Learning · Computer Science 2024-07-26 Jean Seong Bjorn Choe , Jong-Kook Kim

This work focuses on the entropy-regularized independent natural policy gradient (NPG) algorithm in multi-agent reinforcement learning. In this work, agents are assumed to have access to an oracle with exact policy evaluation and seek to…

Machine Learning · Computer Science 2024-05-07 Youbang Sun , Tao Liu , P. R. Kumar , Shahin Shahrampour

Policy gradient (PG) methods are a widely used reinforcement learning methodology in many applications such as video games, autonomous driving, and robotics. In spite of its empirical success, a rigorous understanding of the global…

Optimization and Control · Mathematics 2020-06-30 Kaiqing Zhang , Alec Koppel , Hao Zhu , Tamer Başar

Post-deployment machine learning algorithms often influence the environments they act in, and thus shift the underlying dynamics that the standard reinforcement learning (RL) methods ignore. While designing optimal algorithms in this…

Machine Learning · Computer Science 2026-02-03 Debabrota Basu , Udvas Das , Brahim Driss , Uddalak Mukherjee

We propose a general framework for entropy-regularized average-reward reinforcement learning in Markov decision processes (MDPs). Our approach is based on extending the linear-programming formulation of policy optimization in MDPs to…

Machine Learning · Computer Science 2017-05-23 Gergely Neu , Anders Jonsson , Vicenç Gómez

Entropy augmented to reward is known to soften the greedy argmax policy to softmax policy. Entropy augmentation is reformulated and leads to a motivation to introduce an additional entropy term to the objective function in the form of…

Machine Learning · Computer Science 2020-06-08 Donghoon Lee

Entropy regularization has been widely used in policy optimization algorithms to enhance exploration and the robustness of the optimal control; however it also introduces an additional regularization bias. This work quantifies the impact of…

Optimization and Control · Mathematics 2025-03-25 Deven Sethi , David Šiška , Yufei Zhang