English
Related papers

Related papers: Q-Learning for Linear Quadratic Optimal Control wi…

200 papers

This paper applies a reinforcement learning (RL) method to solve infinite horizon continuous-time stochastic linear quadratic problems, where drift and diffusion terms in the dynamics may depend on both the state and control. Based on…

Optimization and Control · Mathematics 2021-09-17 Na Li , Xun Li , Jing Peng , Zuo Quan Xu

We consider an LQR optimal control problem with partially unknown dynamics. We propose a new model-based online algorithm to obtain an approximation of the dynamics $and$ the control at the same time during a single simulation.

Numerical Analysis · Mathematics 2021-05-31 Agnese Pacifico , Andrea Pesare , Maurizio Falcone

Although Q-learning is one of the most successful algorithms for finding the best action-value function (and thus the optimal policy) in reinforcement learning, its implementation often suffers from large overestimation of Q-function values…

Machine Learning · Computer Science 2020-10-13 Huaqing Xiong , Lin Zhao , Yingbin Liang , Wei Zhang

The goal of this paper is to study a multi-objective linear quadratic Gaussian (LQG) control problem. In particular, we consider an optimal control problem minimizing a quadratic cost over a finite time horizon for linear stochastic systems…

Optimization and Control · Mathematics 2021-06-01 Donghwan Lee , Do Wan Kim

A method is presented for solving the discrete-time finite-horizon Linear Quadratic Regulator (LQR) problem subject to auxiliary linear equality constraints, such as fixed end-point constraints. The method explicitly determines an affine…

Systems and Control · Computer Science 2018-09-18 Forrest Laine , Claire Tomlin

Finding minimal time and establishing the structure of the corresponding optimal controls which can transfer a given initial state of a quantum system into a given target state is a key problem of quantum control. In this work, this problem…

Quantum Physics · Physics 2025-02-21 L. V. Lokutsievskiy , A. N. Pechen , M. I. Zelikin

This paper is concerned with a discrete-time mean-field stochastic linear-quadratic optimal control problem arose from financial application. Through matrix dynamical optimization method, a group of linear feedback controls is investigated.…

Optimization and Control · Mathematics 2017-06-15 Xun Li , Allen H. Tai , Fei Tian

This paper proposes a novel robust reinforcement learning framework for discrete-time linear systems with model mismatch that may arise from the sim-to-real gap. A key strategy is to invoke advanced techniques from control theory. Using the…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Leilei Cui , Tamer Başar , Zhong-Ping Jiang

In both the fields of computer science and medicine there is very strong interest in developing personalized treatment policies for patients who have variable responses to treatments. In particular, I aim to find an optimal personalized…

Machine Learning · Computer Science 2014-07-01 Yousuf M. Soliman

This work presents a novel algorithm for impulsive optimal control of linear time-varying systems with the inclusion of input magnitude constraints. Impulsive optimal control problems, where the optimal input solution is a sum of delta…

Optimization and Control · Mathematics 2026-03-17 Ethan Foss , Simone D'Amico

The paper deals with an optimal control problem in a dynamical system described by a linear differential equation with the Caputo fractional derivative. The goal of control is to minimize a Bolza-type cost functional, which consists of two…

Optimization and Control · Mathematics 2019-09-25 Mikhail Gomoyunov

We study the distributed Linear Quadratic Gaussian (LQG) control problem in discrete-time and finite-horizon, where the controller depends linearly on the history of the outputs and it is required to lie in a given subspace, e.g. to possess…

Systems and Control · Electrical Eng. & Systems 2021-07-14 Luca Furieri , Maryam Kamgarpour

Model-free algorithms are brought into the control system's research with the emergence of reinforcement learning algorithms. However, there are two practical challenges of reinforcement learning-based methods. First, learning by…

Systems and Control · Electrical Eng. & Systems 2024-09-18 Mi Zhou , Erik Verriest , Chaouki Abdallah

Controlling complex dynamical systems has been a topic of considerable interest in academic circles in recent decades. While existing works have primarily focused on closed-loop control schemes with infinite-time durations, this paper…

Optimization and Control · Mathematics 2025-01-08 Xiaoxiao Peng , Shijie Zhou

Linear Quadratic Regulator (LQR) and Linear Quadratic Gaussian (LQG) control are foundational and extensively researched problems in optimal control. We investigate LQR and LQG problems with semi-adversarial perturbations and time-varying…

Machine Learning · Computer Science 2023-10-26 Y. Jennifer Sun , Stephen Newman , Elad Hazan

In this work, we will investigate the question of optimal control for bilinear systems with constrained endpoint. The optimal control will be characterized through a set of unconstrained minimization problems that approximate the former.…

Optimization and Control · Mathematics 2021-07-28 Soufiane Yahyaoui , Lahoussine Lafhim , Mohamed Ouzahra

This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed-observable settings, where the…

Optimization and Control · Mathematics 2022-11-22 Ugo Rosolia , Yuxiao Chen , Shreyansh Daftry , Masahiro Ono , Yisong Yue , Aaron D. Ames

This paper proposes a general formulation for temporal parallelisation of dynamic programming for optimal control problems. We derive the elements and associative operators to be able to use parallel scans to solve these problems with…

Optimization and Control · Mathematics 2022-01-25 Simo Särkkä , Ángel F. García-Fernández

Linear-Quadratic-Gaussian (LQG) control is concerned with the design of an optimal controller and estimator for linear Gaussian systems with imperfect state information. Standard LQG assumes the set of sensor measurements, to be fed to the…

Optimization and Control · Mathematics 2020-05-18 Vasileios Tzoumas , Luca Carlone , George J. Pappas , Ali Jadbabaie

We propose nearly-optimal control strategies for changing states of a quantum system. We argue that quantum control optimization can be studied analytically within some protocol families that depend on a small set of parameters for…

Quantum Physics · Physics 2017-09-13 Chen Sun , Avadh Saxena , Nikolai A. Sinitsyn