English
Related papers

Related papers: Robustness and Consistency in Linear Quadratic Con…

200 papers

Performance of adaptive control policies is assessed through the regret with respect to the optimal regulator, which reflects the increase in the operating cost due to uncertainty about the dynamics parameters. However, available results in…

Systems and Control · Computer Science 2020-03-24 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

The main challenge for adaptive regulation of linear-quadratic systems is the trade-off between identification and control. An adaptive policy needs to address both the estimation of unknown dynamics parameters (exploration), as well as the…

Systems and Control · Computer Science 2019-04-01 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

Model-free approaches for reinforcement learning (RL) and continuous control find policies based only on past states and rewards, without fitting a model of the system dynamics. They are appealing as they are general purpose and easy to…

Machine Learning · Computer Science 2018-10-09 Yasin Abbasi-Yadkori , Nevena Lazic , Csaba Szepesvari

We consider the problem of controlling an unknown linear dynamical system in the presence of (nonstochastic) adversarial perturbations and adversarial convex loss functions. In contrast to classical control, the a priori determination of an…

Machine Learning · Computer Science 2020-01-22 Elad Hazan , Sham M. Kakade , Karan Singh

Overconservatism has long been recognized as a major issue with robust optimization, despite its key advantages of tractability, performance guarantee, and limited information. To address this issue, a new criterion is proposed that can…

Optimization and Control · Mathematics 2026-03-20 Yingjie Lan

We study online control of an unknown nonlinear dynamical system that is approximated by a time-invariant linear system with model misspecification. Our study focuses on robustness, a measure of how much deviation from the assumed linear…

Optimization and Control · Mathematics 2022-04-06 Xinyi Chen , Udaya Ghai , Elad Hazan , Alexandre Megretski

Recent work by Mania et al. has proved that certainty equivalent control achieves nearly optimal regret for linear systems with quadratic costs. However, when parameter uncertainty is large, certainty equivalence cannot be relied upon to…

Optimization and Control · Mathematics 2020-01-01 Jack Umenberger , Thomas B. Schon

For constrained linear systems with bounded disturbances and parametric uncertainty, we propose a robust adaptive model predictive control strategy with online parameter estimation. Constraints enforcing persistently exciting closed loop…

Optimization and Control · Mathematics 2023-03-08 Xiaonan Lu , Mark Cannon

This paper proposes a model predictive controller for discrete-time linear systems with additive, possibly unbounded, stochastic disturbances and subject to chance constraints. By computing a polytopic probabilistic positively invariant set…

Optimization and Control · Mathematics 2024-09-23 Kai Wang , Kiet Tuan Hoang , Sébastien Gros

We consider the problem of adaptive stabilization for discrete-time, multi-dimensional linear systems with bounded control input constraints and unbounded stochastic disturbances, where the parameters of the true system are unknown. To…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

We study the problem of improving the performance of online algorithms by incorporating machine-learned predictions. The goal is to design algorithms that are both consistent and robust, meaning that the algorithm performs well when…

Machine Learning · Computer Science 2020-10-23 Alexander Wei , Fred Zhang

We study the problem of adaptive control of the linear quadratic regulator for systems in very high, or even infinite dimension. We demonstrate that while sublinear regret requires finite dimensional inputs, the ambient state dimension of…

Optimization and Control · Mathematics 2021-07-16 Juan C. Perdomo , Max Simchowitz , Alekh Agarwal , Peter Bartlett

Autonomous systems increasingly rely on machine learning techniques to transform high-dimensional raw inputs into predictions that are then used for decision-making and control. However, it is often easy to maliciously manipulate such…

Machine Learning · Computer Science 2023-02-07 Jinghan Yang , Hunmin Kim , Wenbin Wan , Naira Hovakimyan , Yevgeniy Vorobeychik

We study the problem of online learning in predictive control of an unknown linear dynamical system with time varying cost functions which are unknown apriori. Specifically, we study the online learning problem where the control algorithm…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Dileep Kalathil , Pramod P. Khargonekar

This paper is concerned with model predictive control (MPC) of discrete-time linear systems subject to bounded additive disturbance and mixed constraints on the state and input, whereas the true disturbance set is unknown. Unlike most…

Optimization and Control · Mathematics 2024-05-22 Yulong Gao , Shuhao Yan , Jian Zhou , Mark Cannon , Alessandro Abate , Karl H. Johansson

Distributed optimal control is known to be challenging and can become intractable even for linear-quadratic regulator problems. In this work, we study a special class of such problems where distributed state feedback controllers can give…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Johan Olsson , Runyu Zhang , Emma Tegling , Na Li

This paper proposes a novel approach to resilient distributed optimization with quadratic costs in a networked control system (e.g., wireless sensor network, power grid, robotic team) prone to external attacks (e.g., hacking, power outage)…

Systems and Control · Electrical Eng. & Systems 2025-02-11 Luca Ballotta , Giacomo Como , Jeff S. Shamma , Luca Schenato

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a…

Machine Learning · Computer Science 2019-06-21 Xiaojing Zhang , Monimoy Bujarbaruah , Francesco Borrelli

We propose a new risk-constrained reformulation of the standard Linear Quadratic Regulator (LQR) problem. Our framework is motivated by the fact that the classical (risk-neutral) LQR controller, although optimal in expectation, might be…

Systems and Control · Electrical Eng. & Systems 2020-10-30 Anastasios Tsiamis , Dionysios S. Kalogerias , Luiz F. O. Chamon , Alejandro Ribeiro , George J. Pappas

This paper studies the linear quadratic regulation (LQR) problem of unknown discrete-time systems via dynamic output feedback learning control. In contrast to the state feedback, the optimality of the dynamic output feedback control for…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Kedi Xie , Martin Guay , Shimin Wang , Fang Deng , Maobin Lu