English
Related papers

Related papers: Optimal Adaptive Control of Linear Stochastic Syst…

200 papers

This paper studies a class of continuous-time scalar-state stochastic Linear-Quadratic (LQ) optimal control problem with the linear control constraints. Applying the state separation theorem induced from its special structure, we develop…

Portfolio Management · Quantitative Finance 2018-06-12 Weiping Wu , Jianjun Gao , Junguo Lu , Xun Li

A novel method of an adaptive linear quadratic (LQ) regulation of uncertain continuous linear time-invariant systems is proposed. Such an approach is based on the direct self-tuning regulators design framework and the exponentially stable…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Anton Glushchenko , Konstantin Lastochkin

This paper considers the linear-quadratic dual control problem where the system parameters need to be identified and the control objective needs to be optimized in the meantime. Contrary to existing works on data-driven linear-quadratic…

Systems and Control · Electrical Eng. & Systems 2021-11-22 Yiwen Lu , Yilin Mo

We study the problem of state representation learning for control from partial and potentially high-dimensional observations. We approach this problem via cost-driven state representation learning, in which we learn a dynamical model in a…

Machine Learning · Computer Science 2026-03-10 Yi Tian , Kaiqing Zhang , Russ Tedrake , Suvrit Sra

The Linear Quadratic Gaussian (LQG) controller is known to be inherently fragile to model misspecifications common in real-world situations. We consider discrete-time partially observable stochastic linear systems and provide a…

Optimization and Control · Mathematics 2025-07-31 Marta Fochesato , Lucia Falconi , Mattia Zorzi , Augusto Ferrante , John Lygeros

We consider the optimal control problem for a linear conditional McKean-Vlasov equation with quadratic cost functional. The coefficients of the system and the weigh-ting matrices in the cost functional are allowed to be adapted processes…

Probability · Mathematics 2017-03-09 Huyên Pham

This paper is concerned with a backward stochastic linear-quadratic (LQ, for short) optimal control problem with deterministic coefficients. The weighting matrices are allowed to be indefinite, and cross-product terms in the control and…

Optimization and Control · Mathematics 2021-04-13 Jingrui Sun , Zhen Wu , Jie Xiong

This paper revisits the classical Linear Quadratic Gaussian (LQG) control from a modern optimization perspective. We analyze two aspects of the optimization landscape of the LQG problem: 1) connectivity of the set of stabilizing controllers…

Optimization and Control · Mathematics 2021-02-09 Yang Zheng , Yujie Tang , Na Li

This paper studies the stochastic optimal control problem for systems with unknown dynamics. First, an open-loop deterministic trajectory optimization problem is solved without knowing the explicit form of the dynamical system. Next, a…

Systems and Control · Computer Science 2017-05-30 Dan Yu , Mohammadhussein Rafieisakhaei , Suman Chakravorty

This paper is concerned with the linear quadratic optimal control of discrete-time time-varying system with terminal state constraint. The main contribution is to propose a Q-learning algorithm for the optimal controller when the…

Optimization and Control · Mathematics 2023-07-20 Juanjuan Xu , Jingmei Liu , Zhaorong Zhang , Wei Wang

In this paper, we propose a novel linear quadratic Gaussian controller whose parameters can be automatically tuned. While linear quadratic regulator method has been widely used in adaptive cruise control system design, researchers have not…

Systems and Control · Electrical Eng. & Systems 2020-12-01 Yuncheng Jiang , Lilong Cai , Xiaofeng Jin

We study the performance of the certainty equivalent controller on Linear Quadratic (LQ) control problems with unknown transition dynamics. We show that for both the fully and partially observed settings, the sub-optimality gap between the…

Optimization and Control · Mathematics 2019-06-25 Horia Mania , Stephen Tu , Benjamin Recht

TWe establish regret lower bounds for adaptively controlling an unknown linear Gaussian system with quadratic costs. We combine ideas from experiment design, estimation theory and a perturbation bound of certain information matrices to…

Machine Learning · Computer Science 2024-06-13 Ingvar Ziemann , Henrik Sandberg

We consider a variant of the classical linear quadratic Gaussian regulator (LQG) in which penalties on the endpoint state are replaced by the specification of the terminal state distribution. The resulting theory considerably differs from…

Optimization and Control · Mathematics 2015-03-18 Yongxin Chen , Tryphon Georgiou , Michele Pavon

We consider adaptive control of the Linear Quadratic Regulator (LQR), where an unknown linear system is controlled subject to quadratic costs. Leveraging recent developments in the estimation of linear systems and in robust controller…

Machine Learning · Computer Science 2018-05-25 Sarah Dean , Horia Mania , Nikolai Matni , Benjamin Recht , Stephen Tu

This paper investigates a class of unified stochastic linear quadratic Gaussian (LQG) social optima problems involving a large number of weakly-coupled interactive agents under a {generalized} setting. For each individual agent, the control…

Optimization and Control · Mathematics 2020-05-15 Zhenghong Qiu , Jianhui Huang , Tinghan Xie

In this paper, we define and solve the Inverse Stochastic Optimal Control (ISOC) problem of the linear-quadratic Gaussian (LQG) and the linear-quadratic sensorimotor (LQS) control model. These Stochastic Optimal Control (SOC) models are…

Optimization and Control · Mathematics 2022-11-01 Philipp Karg , Simon Stoll , Simon Rothfuß , Sören Hohmann

In this work, we revisit the Linear Quadratic Gaussian (LQG) optimal control problem from a behavioral perspective. Motivated by the suitability of behavioral models for data-driven control, we begin with a reformulation of the LQG problem…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Abed AlRahman Al Makdah , Vishaal Krishnan , Vaibhav Katewa , Fabio Pasqualetti

This paper addresses the inverse optimal control for the linear quadratic tracking problem with a fixed but unknown target state, which aims to estimate the possible triplets comprising the target state, the state weight matrix, and the…

Systems and Control · Electrical Eng. & Systems 2026-01-14 Yao Li , Chengpu Yu , Hao Fang , Jie Chen

In this paper, we consider linear quadratic optimal control with mean-field type for discrete-time stochastic systems with state and control dependent noise. An optimal control problem is studied for a linear mean-field stochastic…

Optimization and Control · Mathematics 2022-10-06 Arzu Ahmadova , Nazim I. Mahmudov