Related papers: Classical LQG's limitation and modification in sto…
This manuscript surveys reinforcement learning from the perspective of optimization and control with a focus on continuous control applications. It surveys the general formulation, terminology, and typical experimental implementations of…
We derive the quantum stochastic master equation for bosonic systems without measurement theory but control theory. It is shown that the quantum effect of the measurement can be represented as the correlation between dynamical and…
This article explores the discrete-time stochastic optimal LQR control with delay and quadratic constraints. The inclusion of delay, compared to delay-free optimal LQR control with quadratic constraints, significantly increases the…
State-of-the-art approaches to optimal control use smooth approximations of value and policy functions and gradient-based algorithms for improving approximator parameters. Unfortunately, we show that value and policy functions that arise in…
Modern optimal control theory involves adjoining the already known equations of motion of a dynamic system to the objective function using dynamic costates; this is done in order to constrain the optimal control solutions to satisfy the…
In this paper, the solvability of discrete-time stochastic linear-quadratic (LQ) optimal control problem in finite horizon is considered. Firstly, it shows that the closed-loop solvability for the LQ control problem is optimal if and only…
This paper studies a stochastic algorithm for linearly constrained nonconvex optimization, where the objective function is smooth but only unbiased stochastic gradients with bounded variance are available. We propose a momentum-based…
We study in this paper a class of constrained linear-quadratic (LQ) optimal control problem formulations for the scalar-state stochastic system with multiplicative noise, which has various applications, especially in the financial risk…
In this paper, we describe a constrained Lagrangian and Hamiltonian formalism for the optimal control of nonholonomic mechanical systems. In particular, we aim to minimize a cost functional, given initial and final conditions where the…
Model-based controllers learned from data have the biases and noise of their training trajectories, making it important to know which trajectories help or hurt closed-loop performance. Influence functions, widely used in machine learning…
Nowadays, power imbalance happens more frequently due to the more integration of renewable energy sources. Energy storage is a kind of devices that can charge energy at one time and discharge energy at another time. This function makes that…
This paper presents a formulation of Lagrangian dynamics of constrained mechanical systems in terms of reduced quasi-velocities and quasi-forces that can be used for simulation, analysis, and control purposes. In this formulation, Cholesky…
In this paper, we consider optimal control problems derived by stochastic systems with delay, where control domains are non-convex and the diffusion coefficients depend on control variables. By an estimate of the integral of…
A stochastic linear quadratic (LQ) optimal control problem with a pointwise linear equality constraint on the terminal state is considered. A strong Lagrangian duality theorem is proved under a uniform convexity condition on the cost…
A mechanical system can be optimally controlled through continuous measurements of its position followed by feedback. We revisit the complete formalism for predicting the performance of such as system without invoking the standard rotating…
With the advent of quantum technologies, control issues are becoming increasingly important. In this article, we address the control in phase space under a global constraint provided by a minimal energy-like cost function and a local (in…
This paper investigates the stochastic linear-quadratic (LQ, for short) optimal control problems with non-Markovian regime switching in a finite time horizon where the state equation is multi-dimensional. Similar to the classical stochastic…
In this paper, we study linear-quadratic control problems for stochastic Volterra integral equations with singular and non-convolution-type coefficients. The weighting matrices in the cost functional are not assumed to be non-negative…
This paper focuses on the linear quadratic control (LQC) design of systems corrupted by both stochastic noise and bounded noise simultaneously. When only of these noises are considered, the LQC strategy leads to stochastic or robust…
In this paper, we study a class of stochastic time-inconsistent linear-quadratic (LQ) control problems with control input constraints. These problems are investigated within the more general framework associated with random coefficients.…