中文
相关论文

相关论文: Regret Bounds for LQ Adaptive Control Under Databa…

200 篇论文

We study optimal regret bounds for control in linear dynamical systems under adversarially changing strongly convex cost functions, given the knowledge of transition dynamics. This includes several well studied and fundamental frameworks…

机器学习 · 计算机科学 2019-09-12 Naman Agarwal , Elad Hazan , Karan Singh

In the classic expert problem, $\Phi$-regret measures the gap between the learner's total loss and that achieved by applying the best action transformation $\phi \in \Phi$. A recent work by Lu et al., [2025] introduces an adaptive algorithm…

机器学习 · 计算机科学 2025-12-16 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

We consider measurement-feedback control in linear dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing an online controller which competes with the optimal…

系统与控制 · 电气工程与系统科学 2021-06-24 Gautam Goel , Babak Hassibi

Recent literature has made much progress in understanding \emph{online LQR}: a modern learning-theoretic take on the classical control problem in which a learner attempts to optimally control an unknown linear dynamical system with fully…

机器学习 · 计算机科学 2020-10-06 Max Simchowitz

In this work, we consider the problem of regret minimization in adaptive minimum variance and linear quadratic control problems. Regret minimization has been extensively studied in the literature for both types of adaptive control problems.…

最优化与控制 · 数学 2022-11-16 Kévin Colin , Håkan Hjalmarsson , Xavier Bombois

This paper addresses the distributed online control problem over a network of linear time-invariant (LTI) systems (with possibly unknown dynamics) in the presence of adversarial perturbations. There exists a global network cost that is…

最优化与控制 · 数学 2023-10-06 Ting-Jui Chang , Shahin Shahrampour

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

机器学习 · 计算机科学 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

This paper focuses on adaptive control of the discrete-time linear quadratic regulator (adaptive LQR). Recent literature has made significant contributions in proving non-asymptotic convergence rates, but existing approaches have a few…

系统与控制 · 电气工程与系统科学 2026-04-27 Peter A. Fisher , Anuradha M. Annaswamy

We present an optimisation-based method for synthesising a dynamic regret optimal controller for linear systems with potentially adversarial disturbances and known or adversarial initial conditions. The dynamic regret is defined as the…

系统与控制 · 电气工程与系统科学 2022-05-31 Alexandre Didier , Jerome Sieber , Melanie N. Zeilinger

We study adversarially robust multitask adaptive linear quadratic control; a setting where multiple systems collaboratively learn control policies under model uncertainty and adversarial corruption. We propose a clustered multitask approach…

机器学习 · 计算机科学 2025-11-10 Kasra Fallah , Leonardo F. Toso , James Anderson

We study adaptive regret bounds in terms of the variation of the losses (the so-called path-length bounds) for both multi-armed bandit and more generally linear bandit. We first show that the seemingly suboptimal path-length bound of (Wei…

机器学习 · 计算机科学 2019-06-19 Sébastien Bubeck , Yuanzhi Li , Haipeng Luo , Chen-Yu Wei

This paper proposes a robust regret control framework in which the performance baseline adapts to the realization of system uncertainty. The plant is modeled as a discrete-time, uncertain linear time-invariant system with real-parametric…

最优化与控制 · 数学 2025-10-27 Jietian Liu , Peter Seiler

We consider the framework of non-stationary Online Convex Optimization where a learner seeks to control its dynamic regret against an arbitrary sequence of comparators. When the loss functions are strongly convex or exp-concave, we…

机器学习 · 计算机科学 2021-11-24 Dheeraj Baby , Hilaf Hasson , Yuyang Wang

We study the problem of adaptive control of a high dimensional linear quadratic (LQ) system. Previous work established the asymptotic convergence to an optimal controller for various adaptive control schemes. More recently, for the average…

机器学习 · 统计学 2013-03-26 Morteza Ibrahimi , Adel Javanmard , Benjamin Van Roy

We consider control in linear time-varying dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing an online controller which minimizes regret against the best…

机器学习 · 计算机科学 2021-02-03 Gautam Goel , Babak Hassibi

We study the $K$-armed dueling bandit problem, a variation of the standard stochastic bandit problem where the feedback is limited to relative comparisons of a pair of arms. We introduce a tight asymptotic regret lower bound that is based…

机器学习 · 统计学 2015-06-30 Junpei Komiyama , Junya Honda , Hisashi Kashima , Hiroshi Nakagawa

In this work we provide provable regret guarantees for an online meta-learning control algorithm in an iterative control setting, where in each iteration the system to be controlled is a linear deterministic system that is different and…

机器学习 · 计算机科学 2022-02-07 Deepan Muthirayan , Pramod Khargonekar

We study how to adapt to smoothly-varying ('easy') environments in well-known online learning problems where acquiring information is expensive. For the problem of label efficient prediction, which is a budgeted version of prediction with…

机器学习 · 计算机科学 2019-12-09 Siddharth Mitra , Aditya Gopalan

We study the problem of regret minimization in partially observable linear quadratic control systems when the model dynamics are unknown a priori. We propose ExpCommit, an explore-then-commit algorithm that learns the model Markov…

机器学习 · 计算机科学 2020-03-10 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

This paper investigates stochastic multi-armed bandit algorithms that are robust to adversarial attacks, where an attacker can first observe the learner's action and {then} alter their reward observation. We study two cases of this model,…

机器学习 · 计算机科学 2024-08-19 Xuchuang Wang , Jinhang Zuo , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili