English
Related papers

Related papers: Continuous-time iterative linear-quadratic regulat…

200 papers

This paper employs a policy iteration reinforcement learning (RL) method to study continuous-time linear-quadratic mean-field control problems in infinite horizon. The drift and diffusion terms in the dynamics involve the states, the…

Optimization and Control · Mathematics 2024-11-05 Na Li , Xun Li , Zuo Quan Xu

We consider the optimal control problem for a linear conditional McKean-Vlasov equation with quadratic cost functional. The coefficients of the system and the weigh-ting matrices in the cost functional are allowed to be adapted processes…

Probability · Mathematics 2017-03-09 Huyên Pham

This paper studies an infinite horizon optimal control problem for discrete-time linear systems and quadratic criteria, both with random parameters which are independent and identically distributed with respect to time. A classical approach…

Optimization and Control · Mathematics 2020-11-11 Kai Du , Qingxin Meng , Fu Zhang

A method is presented for solving the discrete-time finite-horizon Linear Quadratic Regulator (LQR) problem subject to auxiliary linear equality constraints, such as fixed end-point constraints. The method explicitly determines an affine…

Systems and Control · Computer Science 2018-09-18 Forrest Laine , Claire Tomlin

Learning-based control methods for industrial processes leverage the repetitive nature of the underlying process to learn optimal inputs for the system. While many works focus on linear systems, real-world problems involve nonlinear…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Samuel Balula , Efe C. Balta , Dominic Liao-McPherson , Alisa Rupenyan , John Lygeros

In this paper, a leader-follower stochastic differential game is studied for a linear stochastic differential equation with a quadratic cost functional. The coefficients in the state equation and the weighting matrices in the cost…

Optimization and Control · Mathematics 2021-07-13 Zixuan Li , Jingtao Shi

In this paper, we consider the inverse optimal control problem for the discrete-time linear quadratic regulator, over finite-time horizons. Given observations of the optimal trajectories, and optimal control inputs, to a linear…

Optimization and Control · Mathematics 2018-10-31 Han Zhang , Jack Umenberger , Xiaoming Hu

A general and new stochastic linear quadratic optimal control problem is studied, where the coefficients are allowed to be time-varying, and both state delay and control delay can appear simultaneously in the state equation and the cost…

Optimization and Control · Mathematics 2026-02-24 Weijun Meng , Tianxiao Wang , Ji-Feng Zhang

This paper presents a novel factor graph-based approach to solve the discrete-time finite-horizon Linear Quadratic Regulator problem subject to auxiliary linear equality constraints within and across time steps. We represent such optimal…

Robotics · Computer Science 2021-10-27 Shuo Yang , Gerry Chen , Yetong Zhang , Howie Choset , Frank Dellaert

This paper focuses on adaptive control of the discrete-time linear quadratic regulator (adaptive LQR). Recent literature has made significant contributions in proving non-asymptotic convergence rates, but existing approaches have a few…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Peter A. Fisher , Anuradha M. Annaswamy

We present high order explicit geometric integrators to solve linear-quadratic optimal control problems and $N$-player differential games. These problems are described by a system coupled non-linear differential equations with boundary…

Numerical Analysis · Mathematics 2013-11-06 Sergio Blanes

This paper is concerned with a discrete-time mean-field stochastic linear-quadratic optimal control problem arose from financial application. Through matrix dynamical optimization method, a group of linear feedback controls is investigated.…

Optimization and Control · Mathematics 2017-06-15 Xun Li , Allen H. Tai , Fei Tian

We present a midpoint policy iteration algorithm to solve linear quadratic optimal control problems in both model-based and model-free settings. The algorithm is a variation of Newton's method, and we show that in the model-based setting it…

Optimization and Control · Mathematics 2022-02-16 Benjamin Gravell , Iman Shames , Tyler Summers

Efficient Riccati equation based techniques for the approximate solution of discrete time linear regulator problems are restricted in their application to problems with quadratic terminal payoffs. Where non-quadratic terminal payoffs are…

Optimization and Control · Mathematics 2017-11-13 Huan Zhang , Peter M. Dower

In this paper we study the quadratic regulator problem for a process governed by a Volterra integral equation in ${\mathbb R}^n$. Our main goal is the proof that it is possible to associate a Riccati differential equation to this quadratic…

Optimization and Control · Mathematics 2016-10-25 L. Pandolfi

Many problems in robotics involve multiple decision making agents. To operate efficiently in such settings, a robot must reason about the impact of its decisions on the behavior of other agents. Differential games offer an expressive…

Systems and Control · Electrical Eng. & Systems 2020-03-19 David Fridovich-Keil , Ellis Ratner , Lasse Peters , Anca D. Dragan , Claire J. Tomlin

This paper proposes a novel iterative algorithm to compute the stabilizing solution of regime-switching stochastic game-theoretic Riccati differential equations with periodic coefficients. The method decomposes the original complex…

Numerical Analysis · Mathematics 2025-11-11 Yiyuan Wang

This paper revisits and extends the convergence and robustness properties of value and policy iteration algorithms for discrete-time linear quadratic regulator problems. In the model-based case, we extend current results concerning the…

Systems and Control · Electrical Eng. & Systems 2025-04-11 Bowen Song , Chenxuan Wu , Andrea Iannelli

In this article, we study a continuous-time stochastic $H_\infty$ control problem based on reinforcement learning (RL) techniques that can be viewed as solving a stochastic linear-quadratic two-person zero-sum differential game (LQZSG).…

Optimization and Control · Mathematics 2024-10-02 Zhongshi Sun , Guangyan Jia

A fundamental theory of deterministic linear-quadratic (LQ) control is the equivalent relationship between control problems, two-point boundary value problems and Riccati equations. In this paper, we extend the equivalence to a general…

Mathematical Finance · Quantitative Finance 2021-10-13 Hongyan Cai , Danhong Chen , Yunfei Peng , Wei Wei