Related papers: Operator-valued Kernels and Control of Infinite di…
A finite horizon linear quadratic(LQ) optimal control problem is studied for a class of discrete-time linear fractional systems (LFSs) affected by multiplicative, independent random perturbations. Based on the dynamic programming technique,…
We study the infinite horizon Linear-Quadratic problem and the associated algebraic Riccati equations for systems with unbounded control actions. The operator-theoretic context is motivated by composite systems of Partial Differential…
We consider the infinite dimensional linear programming (inf-LP) approach for solving stochastic control problems. The inf-LP corresponding to problems with uncountable state and input spaces is in general computationally intractable. By…
We study the problem of adaptive control of the linear quadratic regulator for systems in very high, or even infinite dimension. We demonstrate that while sublinear regret requires finite dimensional inputs, the ambient state dimension of…
The quadratic optimal state feedback (LQR) is one of the most popular designs for linear systems and succeeds via the solution of the algebraic Riccati equation. The situation is different in the case of non-linear systems: the Riccati…
This paper studies the learning-to-control problem under process and sensing uncertainties for dynamical systems. In our previous work, we developed a data-based generalization of the iterative linear quadratic regulator (iLQR) to design…
This paper studies data-driven approaches to the continuous-time linear quadratic regulator (LQR) problem based on two existing parameterizations, namely a closed-loop (CL) parameterization from behavioral system theory and an integral…
The purpose of this paper is to close the remaining gaps in the understanding of the role that the constrained generalized continuous algebraic Riccati equation plays in singular linear-quadratic (LQ) optimal control. Indeed, in spite of…
In this paper, we solve the long-standing fundamental problem of irregular linear--quadratic (LQ) optimal control, which has received significant attention since the 1960s. We derive the optimal controllers via the key technique of finding…
This paper is concerned with the linear quadratic (LQ) optimal control of continuous-time system with terminal state constraint. In particular, multiple agents exist in the system which can only access partial information of the matrix…
This paper mainly establishes the finite-horizon stochastic bounded real lemma, and then solves the $H_{\infty}$ control problem for discrete-time stochastic linear systems defined on the separable Hilbert spaces, thereby unifying the…
We study the linear-quadratic optimal control problem for infinite-dimensional dissipative systems with possibly indefinite cost functional. Under the assumption that a storage function exists, we show that this indefinite optimal control…
We consider the linear quadratic regulator (LQR) for one-dimensional linear evolution partial differential equations (PDEs) on a finite interval in space. The control is applied as an additive forcing term to PDEs. Existing methods for…
We derive an explicit solution to the operator Riccati equation solving the Linear-Quadratic (LQ) optimal control problem for a class of boundary controlled hyperbolic partial differential equations (PDEs). Different descriptions of the…
In this effort, a novel operator theoretic framework is developed for data-driven solution of optimal control problems. The developed methods focus on the use of trajectories (i.e., time-series) as the fundamental unit of data for the…
In this paper we study the quadratic regulator problem for a process governed by a Volterra integral equation in ${\mathbb R}^n$. Our main goal is the proof that it is possible to associate a Riccati differential equation to this quadratic…
This article presents a method to automatically generate energy-optimal trajectories for systems with linear dynamics, linear constraints, and a quadratic cost functional (LQ systems). First, using recent advancements in optimal control, we…
A promising method for constructing a data-driven output-feedback control law involves the construction of a model-free observer. The Linear Quadratic Regulator (LQR) optimal control policy can then be obtained by both policy-iteration (PI)…
The convergence of policy gradient algorithms in reinforcement learning hinges on the optimization landscape of the underlying optimal control problem. Theoretical insights into these algorithms can often be acquired from analyzing those of…
The Linear Quadratic Regulator (LQR) is a cornerstone of optimal control theory, widely studied in both model-based and model-free approaches. Despite its well-established nature, certain foundational aspects remain subtle. In this paper,…