中文
相关论文

相关论文: Regret-optimal measurement-feedback control

200 篇论文

We study the control of finite-state systems driven by exogenous disturbances, and design causal policies that track the performance of a lookahead benchmark controller. This objective is formalized through dynamic regret, so that favorable…

最优化与控制 · 数学 2026-04-28 Yishay Polatov , Oron Sabag

In this paper we provide provable regret guarantees for an online meta-learning receding horizon control algorithm in an iterative control setting. We consider the setting where, in each iteration the system to be controlled is a linear…

系统与控制 · 电气工程与系统科学 2022-11-02 Deepan Muthirayan , Pramod P. Khargonekar

We propose an online learning algorithm that adaptively designs a decentralized linear quadratic regulator when the system model is unknown a priori and new data samples from a single system trajectory become progressively available. The…

最优化与控制 · 数学 2024-07-08 Lintao Ye , Ming Chi , Ruiquan Liao , Vijay Gupta

In this work we consider the online control of a known linear dynamic system with adversarial disturbance and adversarial controller cost. The goal in online control is to minimize the regret, defined as the difference between cumulative…

最优化与控制 · 数学 2021-10-15 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

In this paper, we consider the problem of finding a meta-learning online control algorithm that can learn across the tasks when faced with a sequence of $N$ (similar) control tasks. Each task involves controlling a linear dynamical system…

机器学习 · 计算机科学 2022-08-23 Deepan Muthirayan , Dileep Kalathil , Pramod P. Khargonekar

Modern control designs in robotics, aerospace, and cyber-physical systems rely heavily on real-world data obtained through system outputs. However, these outputs can be compromised by system faults and malicious attacks, distorting critical…

系统与控制 · 电气工程与系统科学 2024-09-17 Hiroyasu Tsukamoto , Joudi Hajar , Soon-Jo Chung , Fred Y. Hadaegh

This paper studies online nonstochastic control problems with adversarial and static constraints. We propose online nonstochastic control algorithms that achieve both sublinear regret and sublinear adversarial constraint violation while…

机器学习 · 计算机科学 2023-02-07 Xin Liu , Zixian Yang , Lei Ying

We study the control of a linear dynamical system with adversarial disturbances (as opposed to statistical noise). The objective we consider is one of regret: we desire an online control procedure that can do nearly as well as that of a…

机器学习 · 计算机科学 2019-02-26 Naman Agarwal , Brian Bullins , Elad Hazan , Sham M. Kakade , Karan Singh

We consider the problem of controlling an unknown linear dynamical system in the presence of (nonstochastic) adversarial perturbations and adversarial convex loss functions. In contrast to classical control, the a priori determination of an…

机器学习 · 计算机科学 2020-01-22 Elad Hazan , Sham M. Kakade , Karan Singh

We present an algorithm guaranteeing dynamic regret bounds for online omniprediction with long term constraints. The goal in this recently introduced problem is for a learner to generate a sequence of predictions which are broadcast to a…

机器学习 · 计算机科学 2025-10-09 Yahav Bechavod , Jiuyao Lu , Aaron Roth

We present safe control of partially-observed linear time-varying systems in the presence of unknown and unpredictable process and measurement noise. We introduce a control algorithm that minimizes dynamic regret, i.e., that minimizes the…

系统与控制 · 电气工程与系统科学 2023-04-03 Hongyu Zhou , Vasileios Tzoumas

We consider the problem of controlling a possibly unknown linear dynamical system with adversarial perturbations, adversarially chosen convex loss functions, and partially observed states, known as non-stochastic control. We introduce a…

机器学习 · 计算机科学 2020-06-26 Max Simchowitz , Karan Singh , Elad Hazan

In online inverse linear optimization, a learner observes time-varying sets of feasible actions and an agent's optimal actions, selected by solving linear optimization over the feasible actions. The learner sequentially makes predictions of…

机器学习 · 计算机科学 2025-05-23 Shinsaku Sakaue , Taira Tsuchiya , Han Bao , Taihei Oki

In this work, we focus on the design of optimal controllers that must comply with an information structure. State-of-the-art approaches do so based on the H2 or Hinfty norm to minimize the expected or worst-case cost in the presence of…

系统与控制 · 电气工程与系统科学 2025-11-24 Daniele Martinelli , Andrea Martin , Giancarlo Ferrari-Trecate , Luca Furieri

Continuous-time adaptive controllers for systems with a matched uncertainty often comprise an online parameter estimator and a corresponding parameterized controller to cancel the uncertainty. However, such methods are often impossible to…

系统与控制 · 电气工程与系统科学 2025-03-18 Aren Karapetyan , Efe C. Balta , Anastasios Tsiamis , Andrea Iannelli , John Lygeros

We consider the classic problem of online convex optimisation. Whereas the notion of static regret is relevant for stationary problems, the notion of switching regret is more appropriate for non-stationary problems. A switching regret is…

机器学习 · 计算机科学 2025-03-07 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis , Mark Herbster

We consider the problem of online learning in Linear Quadratic Control systems whose state transition and state-action transition matrices $A$ and $B$ may be initially unknown. We devise an online learning algorithm and provide guarantees…

机器学习 · 计算机科学 2021-09-30 Yassir Jedra , Alexandre Proutiere

The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality…

系统与控制 · 电气工程与系统科学 2023-04-18 Aren Karapetyan , Anastasios Tsiamis , Efe C. Balta , Andrea Iannelli , John Lygeros

In this work we provide provable regret guarantees for an online meta-learning control algorithm in an iterative control setting, where in each iteration the system to be controlled is a linear deterministic system that is different and…

机器学习 · 计算机科学 2022-02-07 Deepan Muthirayan , Pramod Khargonekar

In this paper, we consider the problem of prediction with expert advice in dynamic environments. We choose tracking regret as the performance metric and develop two adaptive and efficient algorithms with data-dependent tracking regret…

机器学习 · 计算机科学 2020-02-11 Shiyin Lu , Lijun Zhang