English
Related papers

Related papers: Optimization Landscape of Policy Gradient Methods …

200 papers

Policy gradient (PG) methods have played an essential role in the empirical successes of reinforcement learning. In order to handle large state-action spaces, PG methods are typically used with function approximation. In this setting, the…

Solutions of optimization problems, including policy optimization in reinforcement learning, typically rely upon some variant of gradient descent. There has been much recent work in the machine learning, control, and optimization…

Machine Learning · Computer Science 2025-07-17 Eduardo D. Sontag

The policy gradient approach is a flexible and powerful reinforcement learning method particularly for problems with continuous actions such as robot control. A common challenge in this scenario is how to reduce the variance of policy…

Machine Learning · Computer Science 2013-01-18 Tingting Zhao , Hirotaka Hachiya , Voot Tangkaratt , Jun Morimoto , Masashi Sugiyama

We propose a method for finding approximate compilations of quantum unitary transformations, based on techniques from policy gradient reinforcement learning. The choice of a stochastic policy allows us to rephrase the optimization problem…

Quantum Physics · Physics 2022-09-14 David A. Herrera-Martí

We consider policy gradient algorithms for the indefinite least squares stationary optimal control, e.g., linear-quadratic-regulator (LQR) with indefinite state and input penalization matrices. Such a setup has important applications in…

Optimization and Control · Mathematics 2020-02-13 Jingjing Bu , Mehran Mesbahi

Policy gradient lies at the core of deep reinforcement learning (RL) in continuous domains. Despite much success, it is often observed in practice that RL training with policy gradient can fail for many reasons, even on standard control…

Machine Learning · Computer Science 2024-01-23 Tao Wang , Sylvia Herbert , Sicun Gao

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Dongdong Li , Jiuxiang Dong

We study the efficient off-policy evaluation of natural stochastic policies, which are defined in terms of deviations from the behavior policy. This is a departure from the literature on off-policy evaluation where most work consider the…

Machine Learning · Computer Science 2020-11-05 Nathan Kallus , Masatoshi Uehara

Policy gradient methods hold great potential for solving complex continuous control tasks. Still, their training efficiency can be improved by exploiting structure within the optimization problem. Recent work indicates that supervised…

Machine Learning · Computer Science 2024-03-19 Jan Schneider , Pierre Schumacher , Simon Guist , Le Chen , Daniel Häufle , Bernhard Schölkopf , Dieter Büchler

Nonsmooth nonconvex optimization problems broadly emerge in machine learning and business decision making, whereas two core challenges impede the development of efficient solution methods with finite-time convergence guarantee: the lack of…

Optimization and Control · Mathematics 2022-10-18 Tianyi Lin , Zeyu Zheng , Michael I. Jordan

Feedback optimization is a control paradigm that enables physical systems to autonomously reach efficient operating points. Its central idea is to interconnect optimization iterations in closed-loop with the physical plant. Since iterative…

Optimization and Control · Mathematics 2024-07-16 Zhiyu He , Saverio Bolognani , Jianping He , Florian Dörfler , Xinping Guan

Off-policy learning refers to the problem of learning the value function of a way of behaving, or policy, while following a different policy. Gradient-based off-policy learning algorithms, such as GTD and TDC/GQ, converge even when using…

Artificial Intelligence · Computer Science 2015-12-15 Lucas Lehnert , Doina Precup

Stateful policies play an important role in reinforcement learning, such as handling partially observable environments, enhancing robustness, or imposing an inductive bias directly into the policy structure. The conventional method for…

Machine Learning · Computer Science 2023-11-08 Firas Al-Hafez , Guoping Zhao , Jan Peters , Davide Tateo

This paper explores the decentralized control of linear deterministic systems in which different controllers operate based on distinct state information, and extends the findings to the output feedback scenario. Assuming the controllers…

Optimization and Control · Mathematics 2024-09-09 Hongdan Li , Yawen Sun , Huanshui Zhang

The distributed setting for Saddle Problems (SPs) has recently emerged as a framework for various modern applications in machine learning and multiagent systems. Despite its relevance, the theoretical foundations of this setting have not…

Optimization and Control · Mathematics 2026-05-19 Ruichen Luo , Anton Rodomanov , Sebastian U. Stich

This paper presents novel methods for achieving stable and efficient convergence in multivariable extremum seeking control (ESC) using sliding mode techniques. Drawing inspiration from both classical sliding mode control and more recent…

Optimization and Control · Mathematics 2025-08-13 Roberto Luo , Victor Hugo Pereira Rodrigues , Tiago Roux Oliveira , Miroslav Krstic

Policy gradient methods have achieved remarkable successes in solving challenging reinforcement learning problems. However, it still often suffers from the large variance issue on policy gradient estimation, which leads to poor sample…

Machine Learning · Statistics 2018-02-26 Hao Liu , Yihao Feng , Yi Mao , Dengyong Zhou , Jian Peng , Qiang Liu

Gradient normalization and soft clipping are two popular techniques for tackling instability issues and improving convergence of stochastic gradient descent (SGD) with momentum. In this article, we study these types of methods through the…

Optimization and Control · Mathematics 2025-07-01 Måns Williamson , Tony Stillfjord

This paper addresses the problem of static output feedback (SOF) stabilization for discrete-time LTI systems. We approach this problem using the recently developed periodically time-varying memory state-feedback controller (PTVMSFC) design…

Optimization and Control · Mathematics 2014-09-01 Dong Hwan Lee , Young Hoon Joo , Myung Hwan Tak

In this work, we analyze the properties of the solution to the covariance steering problem for discrete time Gaussian linear systems with a squared Wasserstein distance terminal cost. In our previous work, we have shown that by utilizing…

Optimization and Control · Mathematics 2021-03-26 Isin M. Balci , Abhishek Halder , Efstathios Bakolas