中文
相关论文

相关论文: An Online Learning Analysis of Minimax Adaptive Co…

200 篇论文

We investigate online convex optimization in changing environments, and choose the adaptive regret as the performance measure. The goal is to achieve a small regret over every interval so that the comparator is allowed to change over time.…

机器学习 · 计算机科学 2019-06-18 Lijun Zhang , Tie-Yan Liu , Zhi-Hua Zhou

We study the problem of online learning with a notion of regret defined with respect to a set of strategies. We develop tools for analyzing the minimax rates and for deriving regret-minimization algorithms in this scenario. While the…

机器学习 · 统计学 2013-02-13 Wei Han , Alexander Rakhlin , Karthik Sridharan

We study the problem of system identification and adaptive control in partially observable linear dynamical systems. Adaptive and closed-loop system identification is a challenging problem due to correlations introduced in data collection.…

机器学习 · 计算机科学 2020-06-25 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

We consider an online learning process to forecast a sequence of outcomes for nonconvex models. A typical measure to evaluate online learning algorithms is regret but such standard definition of regret is intractable for nonconvex models…

机器学习 · 计算机科学 2018-11-30 Sergul Aydore , Lee Dicker , Dean Foster

In online convex optimization, the player aims to minimize regret, or the difference between her loss and that of the best fixed decision in hindsight over the entire repeated game. Algorithms that minimize (standard) regret may converge to…

机器学习 · 计算机科学 2023-02-14 Zhou Lu , Elad Hazan

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

机器学习 · 计算机科学 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

The strategy of pre-training a large model on a diverse dataset, then fine-tuning for a particular application has yielded impressive results in computer vision, natural language processing, and robotic control. This strategy has vast…

系统与控制 · 电气工程与系统科学 2024-07-30 Bruce D. Lee , Anders Rantzer , Nikolai Matni

We propose an online learning algorithm that adaptively designs a decentralized linear quadratic regulator when the system model is unknown a priori and new data samples from a single system trajectory become progressively available. The…

最优化与控制 · 数学 2024-07-08 Lintao Ye , Ming Chi , Ruiquan Liao , Vijay Gupta

We consider the classic problem of online convex optimisation. Whereas the notion of static regret is relevant for stationary problems, the notion of switching regret is more appropriate for non-stationary problems. A switching regret is…

机器学习 · 计算机科学 2025-03-07 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis , Mark Herbster

We present an optimisation-based method for synthesising a dynamic regret optimal controller for linear systems with potentially adversarial disturbances and known or adversarial initial conditions. The dynamic regret is defined as the…

系统与控制 · 电气工程与系统科学 2022-05-31 Alexandre Didier , Jerome Sieber , Melanie N. Zeilinger

We investigate online convex optimization in non-stationary environments and choose dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

机器学习 · 计算机科学 2024-04-09 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

Motivated by the predictable nature of real-life in data streams, we study online regression when the learner has access to predictions about future examples. In the extreme case, called transductive online learning, the sequence of…

机器学习 · 计算机科学 2025-10-07 Vinod Raman , Shenghao Xie , Samson Zhou

We propose a novel change point detection approach for online learning control with full information feedback (state, disturbance, and cost feedback) for unknown time-varying dynamical systems. We show that our algorithm can achieve a…

系统与控制 · 电气工程与系统科学 2023-03-28 Deepan Muthirayan , Ruijie Du , Yanning Shen , Pramod P. Khargonekar

This paper addresses the distributed online control problem over a network of linear time-invariant (LTI) systems (with possibly unknown dynamics) in the presence of adversarial perturbations. There exists a global network cost that is…

最优化与控制 · 数学 2023-10-06 Ting-Jui Chang , Shahin Shahrampour

In this paper, we study the dynamic regret of online linear quadratic regulator (LQR) control with time-varying cost functions and disturbances. We consider the case where a finite look-ahead window of cost functions and disturbances is…

最优化与控制 · 数学 2021-02-03 Runyu Zhang , Yingying Li , Na Li

We study online control of time-varying linear systems with unknown dynamics in the nonstochastic control model. At a high level, we demonstrate that this setting is \emph{qualitatively harder} than that of either unknown time-invariant or…

机器学习 · 计算机科学 2022-02-17 Edgar Minasyan , Paula Gradu , Max Simchowitz , Elad Hazan

In data-driven control design, an important problem is to deal with uncertainty due to limited and noisy data. One way to do this is to use a min-max approach, which aims to minimize some design criteria for the worst-case scenario.…

系统与控制 · 电气工程与系统科学 2024-09-25 Ruoqi Zhang , Per Mattsson , Dave Zachariah

In the online non-stochastic control problem, an agent sequentially selects control inputs for a linear dynamical system when facing unknown and adversarially selected convex costs and disturbances. A common metric for evaluating control…

最优化与控制 · 数学 2025-04-24 Vijeth Hebbar , Cédric Langbort

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

机器学习 · 计算机科学 2021-02-16 Nicolò Campolongo , Francesco Orabona

We consider the fundamental problem of online control of a linear dynamical system from two different viewpoints: regret minimization and competitive analysis. We prove that the optimal competitive policy is well-approximated by a convex…

机器学习 · 计算机科学 2022-11-22 Gautam Goel , Naman Agarwal , Karan Singh , Elad Hazan