English
Related papers

Related papers: Second-Order Policy Gradient Methods for the Linea…

200 papers

Policy gradient methods have shown success in learning control policies for high-dimensional dynamical systems. Their biggest downside is the amount of exploration they require before yielding high-performing policies. In a lifelong…

Machine Learning · Computer Science 2020-10-23 Jorge A. Mendez , Boyu Wang , Eric Eaton

Recent studies of gradient descent with large step sizes have shown that there is often a regime with an initial increase in the largest eigenvalue of the loss Hessian (progressive sharpening), followed by a stabilization of the eigenvalue…

Machine Learning · Computer Science 2022-10-11 Atish Agarwala , Fabian Pedregosa , Jeffrey Pennington

Direct data-driven design methods for the linear quadratic regulator (LQR) mainly use offline or episodic data batches, and their online adaptation has been acknowledged as an open problem. In this paper, we propose a direct adaptive method…

Optimization and Control · Mathematics 2024-10-07 Feiran Zhao , Florian Dörfler , Alessandro Chiuso , Keyou You

We present a midpoint policy iteration algorithm to solve linear quadratic optimal control problems in both model-based and model-free settings. The algorithm is a variation of Newton's method, and we show that in the model-based setting it…

Optimization and Control · Mathematics 2022-02-16 Benjamin Gravell , Iman Shames , Tyler Summers

Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently…

Machine Learning · Computer Science 2019-05-15 Andreas Doerr , Michael Volpp , Marc Toussaint , Sebastian Trimpe , Christian Daniel

In this paper, we propose two second-order methods for solving the \(\ell_1\)-regularized composite optimization problem, which are developed based on two distinct definitions of approximate second-order stationary points. We introduce a…

Optimization and Control · Mathematics 2026-01-12 Hong Zhu

The recent promises of Model Predictive Control in robotics have motivated the development of tailored second-order methods to solve optimal control problems efficiently. While those methods benefit from strong convergence properties,…

Robotics · Computer Science 2024-09-30 Jianghan Zhang , Armand Jordana , Ludovic Righetti

We consider the classic stochastic linear quadratic regulator (LQR) problem under an infinite horizon average stage cost. By leveraging recent policy gradient methods from reinforcement learning, we obtain a first-order method that finds a…

Optimization and Control · Mathematics 2025-02-21 Caleb Ju , Georgios Kotsalis , Guanghui Lan

Variance-reduced gradient estimators for policy gradient methods have been one of the main focus of research in the reinforcement learning in recent years as they allow acceleration of the estimation process. We propose a variance-reduced…

Machine Learning · Computer Science 2023-11-28 Saber Salehkaleybar , Sadegh Khorasani , Negar Kiyavash , Niao He , Patrick Thiran

Policy gradient (PG) methods are successful approaches to deal with continuous reinforcement learning (RL) problems. They learn stochastic parametric (hyper)policies by either exploring in the space of actions or in the space of parameters.…

Machine Learning · Computer Science 2024-05-31 Alessandro Montenegro , Marco Mussi , Alberto Maria Metelli , Matteo Papini

Policy gradient methods have been frequently applied to problems in control and reinforcement learning with great success, yet existing convergence analysis still relies on non-intuitive, impractical and often opaque conditions. In…

Machine Learning · Computer Science 2022-04-08 Matthew S. Zhang , Murat A. Erdogdu , Animesh Garg

We propose a new reinforcement learning based approach to designing hierarchical linear quadratic regulator (LQR) controllers for heterogeneous linear multi-agent systems with unknown state-space models and separated control objectives. The…

Systems and Control · Electrical Eng. & Systems 2020-07-29 He Bai , Jemin George , Aranya Chakrabortty

We investigate the problem of learning an $\epsilon$-approximate solution for the discrete-time Linear Quadratic Regulator (LQR) problem via a Stochastic Variance-Reduced Policy Gradient (SVRPG) approach. Whilst policy gradient methods have…

Optimization and Control · Mathematics 2023-09-20 Leonardo F. Toso , Han Wang , James Anderson

We analyze Newton's method with lazy Hessian updates for solving general possibly non-convex optimization problems. We propose to reuse a previously seen Hessian for several iterations while computing new gradients at each step of the…

Optimization and Control · Mathematics 2023-06-16 Nikita Doikov , El Mahdi Chayti , Martin Jaggi

There has been substantial recent progress on the theoretical understanding of model-free approaches to Linear Quadratic Regulator (LQR) problems. Much attention has been devoted to the special case when the goal is to drive the state close…

Optimization and Control · Mathematics 2021-04-13 Zhaolin Ren , Aoxiao Zhong , Na Li

Reinforcement learning (RL) policies represented in Reproducing Kernel Hilbert Spaces (RKHS) offer powerful representational capabilities. While second-order optimization methods like Newton's method demonstrate faster convergence than…

Machine Learning · Computer Science 2025-06-03 Yixian Zhang , Huaze Tang , Chao Wang , Wenbo Ding

Policy optimization (PO), an essential approach of reinforcement learning for a broad range of system classes, requires significantly more system data than indirect (identification-followed-by-control) methods or behavioral-based direct…

Optimization and Control · Mathematics 2023-09-18 Feiran Zhao , Florian Dörfler , Keyou You

It is known that reinforcement learning (RL) is data-hungry. To improve sample-efficiency of RL, it has been proposed that the learning algorithm utilize data from 'approximately similar' processes. However, since the process models are…

Machine Learning · Computer Science 2025-11-24 Vinay Kanakeri , Shivam Bajaj , Ashwin Verma , Vijay Gupta , Aritra Mitra

We propose two policy gradient algorithms for solving the problem of control in an off-policy reinforcement learning (RL) context. Both algorithms incorporate a smoothed functional (SF) based gradient estimation scheme. The first algorithm…

Machine Learning · Computer Science 2024-06-25 Nithia Vijayan , Prashanth L. A

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright
‹ Prev 1 3 4 5 6 7 10 Next ›