English
Related papers

Related papers: Data-driven policy iteration algorithm for continu…

200 papers

This paper studies the finite-horizon linear quadratic regulation problem where the dynamics of the system are assumed to be unknown and the state is accessible. Information on the system is given by a finite set of input-state data, where…

Systems and Control · Electrical Eng. & Systems 2020-08-13 Monica Rotulo , Claudio De Persis , Pietro Tesi

With the outstanding performance of policy gradient (PG) method in the reinforcement learning field, the convergence theory of it has aroused more and more interest recently. Meanwhile, the significant importance and abundant theoretical…

Optimization and Control · Mathematics 2024-04-19 Xinpei Zhang , Guangyan Jia

Linear-quadratic optimal control problem for systems governed by forward-backward stochastic differential equations has been extensively studied over the past three decades. Recent research has revealed that for forward-backward control…

Optimization and Control · Mathematics 2025-04-22 Qi Lü , Bowen Ma , Hanxiao Wang

A linear quadratic optimal stochastic control problem with random coefficients and indefinite state/control weight costs is usually linked to an indefinite stochastic Riccati equation (SRE) which is a matrix-valued quadratic backward…

Optimization and Control · Mathematics 2015-12-22 Kai Du

This paper studies the robustness of policy iteration in the context of continuous-time infinite-horizon linear quadratic regulation (LQR) problem. It is shown that Kleinman's policy iteration algorithm is inherently robust to small…

Systems and Control · Electrical Eng. & Systems 2020-09-01 Bo Pang , Tao Bian , Zhong-Ping Jiang

A mixed linear quadratic (MLQ, for short) optimal control problem is considered. The controlled stochastic system consists of two diffusion processes which are in different time horizons. There are two control actions: a standard control…

Optimization and Control · Mathematics 2012-12-05 Jianhui Huang , Xun Li , Jiongmin Yong

Presented is an algorithm to synthesize an infinite-horizon LQR optimal feedback controller for continuous-time systems. The algorithm does not require knowledge of the system dynamics, but instead uses only a finite-length sampling of…

This paper investigates a zero-sum stochastic linear-quadratic (SLQ, for short) Stackelberg differential game problem, where the coefficients of the state equation and the weighting matrices in the performance functional are regulated by a…

Optimization and Control · Mathematics 2024-09-02 Fan Wu , Xun Li , Jie Xiong , Xin Zhang

This paper is concerned with a kind of linear-quadratic (LQ) optimal control problem of backward stochastic differential equation (BSDE) with partial information. The cost functional includes cross terms between the state and control, and…

Optimization and Control · Mathematics 2025-09-03 Jialong Li , Zhiyong Yu , Wanying Yue

In this paper, we study the optimal control problem for steering the state covariance of a discrete-time linear stochastic system over a finite time horizon. First, we establish the existence and uniqueness of the optimal control law for a…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Fengjiao Liu , George Rapakoulias , Panagiotis Tsiotras

This paper is concerned with a discrete-time mean-field stochastic linear-quadratic optimal control problem arose from financial application. Through matrix dynamical optimization method, a group of linear feedback controls is investigated.…

Optimization and Control · Mathematics 2017-06-15 Xun Li , Allen H. Tai , Fei Tian

This paper presents a data-driven solution to the discrete-time infinite horizon LQR problem. The state feedback gain is computed directly from a batch of input and state data collected from the plant. Simulation examples illustrate the…

Optimization and Control · Mathematics 2021-04-12 Gustavo R. Gonçalves da Silva , Alexandre S. Bazanella , Lucíola Campstrini

In this paper, our goal is to study fundamental foundations of linear quadratic Gaussian (LQG) control problems for stochastic linear time-invariant systems via Lagrangian duality of semidefinite programming (SDP) problems. In particular,…

Optimization and Control · Mathematics 2021-08-21 Donghwan Lee

The purpose of this paper is to investigate the role that the continuous-time generalised Riccati equation plays within the context of singular linear-quadratic optimal control. This equation has been defined following the analogy with the…

Dynamical Systems · Mathematics 2013-05-24 Augusto Ferrante , Lorenzo Ntogramatzidis

This paper focuses on indefinite stochastic mean-field linear-quadratic (MF-LQ, for short) optimal control problems, which allow the weighting matrices for state and control in the cost functional to be indefinite. The solvability of…

Optimization and Control · Mathematics 2020-12-02 Na Li , Xun Li , Zhiyong Yu

In this paper, the solvability of discrete-time stochastic linear-quadratic (LQ) optimal control problem in finite horizon is considered. Firstly, it shows that the closed-loop solvability for the LQ control problem is optimal if and only…

Optimization and Control · Mathematics 2025-02-25 Yue Sun , Xianping Wu , Xun Li

We study the time-inconsistent linear quadratic optimal control problem for forward-backward stochastic differential equations with potentially indefinite cost weighting matrices for both the state and the control variables. Our research…

Optimization and Control · Mathematics 2023-12-15 Qi Lü , Bowen Ma

Linear-Quadratic (LQ) problems that arise in systems and controls include the classical optimal control problems of the Linear Quadratic Regulator (LQR) in both its deterministic and stochastic forms, as well as $H^\infty$-analysis (the…

Systems and Control · Electrical Eng. & Systems 2024-01-04 Bassam Bamieh

We consider the infinite dimensional linear programming (inf-LP) approach for solving stochastic control problems. The inf-LP corresponding to problems with uncountable state and input spaces is in general computationally intractable. By…

Optimization and Control · Mathematics 2018-10-16 Maryam Kamgarpour , Tyler Summers

This paper examines stochastic optimal control problems in which the state is perfectly known, but the controller's measure of time is a stochastic process derived from a strictly increasing L\'evy process. We provide dynamic programming…

Optimization and Control · Mathematics 2014-01-03 Andrew Lamperski , Noah J. Cowan