English
Related papers

Related papers: Value-Gradient Iteration with Quadratic Approximat…

200 papers

Projected Gradient Descent denotes a class of iterative methods for solving optimization programs. Its applicability to convex optimization programs has gained significant popularity for its intuitive implementation that involves only…

Optimization and Control · Mathematics 2016-10-24 Giampaolo Torrisi , Sergio Grammatico , Roy S. Smith , Manfred Morari

We consider the problem of computing optimal linear control policies for linear systems in finite-horizon. The states and the inputs are required to remain inside pre-specified safety sets at all times despite unknown disturbances. In this…

Systems and Control · Computer Science 2019-12-17 Luca Furieri , Maryam Kamgarpour

Off-policy stochastic actor-critic methods rely on approximating the stochastic policy gradient in order to derive an optimal policy. One may also derive the optimal policy by approximating the action-value gradient. The use of action-value…

Machine Learning · Statistics 2017-03-14 Yemi Okesanjo , Victor Kofia

Managing risk in dynamic decision problems is of cardinal importance in many fields such as finance and process control. The most common approach to defining risk is through various variance related criteria such as the Sharpe Ratio or the…

Machine Learning · Computer Science 2012-07-03 Dotan Di Castro , Aviv Tamar , Shie Mannor

Consider a real-valued function that can only be observed with stochastic noise at a finite set of design points within a Euclidean space. We wish to determine whether there exists a convex function that goes through the true function…

Other Statistics · Statistics 2018-07-30 Nanjing Jian , Shane G. Henderson

Reinforcement learning constantly deals with hard integrals, for example when computing expectations in policy evaluation and policy iteration. These integrals are rarely analytically solvable and typically estimated with the Monte Carlo…

Machine Learning · Computer Science 2022-02-23 Sebastien M. R. Arnold , Pierre L'Ecuyer , Liyu Chen , Yi-fan Chen , Fei Sha

This paper presents a novel factor graph-based approach to solve the discrete-time finite-horizon Linear Quadratic Regulator problem subject to auxiliary linear equality constraints within and across time steps. We represent such optimal…

Robotics · Computer Science 2021-10-27 Shuo Yang , Gerry Chen , Yetong Zhang , Howie Choset , Frank Dellaert

Policy gradients in continuous control have been derived for both stochastic and deterministic policies. Here we study the relationship between the two. In a widely-used family of MDPs involving Gaussian control noise and quadratic control…

Machine Learning · Computer Science 2025-06-11 Emo Todorov

We propose a new way of deriving policy gradient updates for reinforcement learning. Our technique, based on Fourier analysis, recasts integrals that arise with expected policy gradients as convolutions and turns them into multiplications.…

Machine Learning · Computer Science 2018-05-31 Matthew Fellows , Kamil Ciosek , Shimon Whiteson

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

Machine Learning · Computer Science 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

This paper considers stochastic optimization problems for a large class of objective functions, including convex and continuous submodular. Stochastic proximal gradient methods have been widely used to solve such problems; however, their…

Optimization and Control · Mathematics 2018-11-13 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

We propose a novel randomized incremental gradient algorithm, namely, VAriance-Reduced Accelerated Gradient (Varag), for finite-sum optimization. Equipped with a unified step-size policy that adjusts itself to the value of the condition…

Optimization and Control · Mathematics 2019-11-01 Guanghui Lan , Zhize Li , Yi Zhou

In this paper we discuss $\l$-policy iteration, a method for exact and approximate dynamic programming. It is intermediate between the classical value iteration (VI) and policy iteration (PI) methods, and it is closely related to optimistic…

Systems and Control · Computer Science 2015-07-07 Dimitri P. Bertsekas

Several researchers have recently investigated the connection between reinforcement learning and classification. We are motivated by proposals of approximate policy iteration schemes without value functions which focus on policy…

Machine Learning · Computer Science 2008-07-06 Christos Dimitrakakis , Michail G. Lagoudakis

Optimal control is a successful approach to generate motions for complex robots, in particular for legged locomotion. However, these techniques are often too slow to run in real time for model predictive control or one needs to drastically…

Robotics · Computer Science 2022-01-12 Julian Viereck , Avadesh Meduri , Ludovic Righetti

Although well-established in general reinforcement learning (RL), value-based methods are rarely explored in constrained RL (CRL) for their incapability of finding policies that can randomize among multiple actions. To apply value-based…

Machine Learning · Computer Science 2022-06-28 Tianchi Cai , Wenpeng Zhang , Lihong Gu , Xiaodong Zeng , Jinjie Gu

We describe and analyze a simple algorithm for principal component analysis and singular value decomposition, VR-PCA, which uses computationally cheap stochastic iterations, yet converges exponentially fast to the optimal solution. In…

Machine Learning · Computer Science 2015-08-03 Ohad Shamir

Risk-sensitive reinforcement learning (RL) aims to optimize policies that balance the expected reward and risk. In this paper, we present a novel risk-sensitive RL framework that employs an Iterated Conditional Value-at-Risk (CVaR)…

Machine Learning · Computer Science 2023-12-05 Yu Chen , Yihan Du , Pihe Hu , Siwei Wang , Desheng Wu , Longbo Huang

We revisit the finite time analysis of policy gradient methods in the one of the simplest settings: finite state and action MDPs with a policy class consisting of all stochastic policies and with exact gradient evaluations. There has been…

Machine Learning · Computer Science 2021-12-14 Jalaj Bhandari , Daniel Russo

We study the performance of stochastic first-order methods for finding saddle points of convex-concave functions. A notorious challenge faced by such methods is that the gradients can grow arbitrarily large during optimization, which may…

Machine Learning · Computer Science 2024-06-10 Gergely Neu , Nneka Okolo