English
Related papers

Related papers: Meta-Learning Guarantees for Online Receding Horiz…

200 papers

We study online reinforcement learning for finite-horizon deterministic control systems with {\it arbitrary} state and action spaces. Suppose that the transition dynamics and reward function is unknown, but the state and action space is…

Machine Learning · Computer Science 2019-05-07 Lin F. Yang , Chengzhuo Ni , Mengdi Wang

We introduce a new algorithm for online linear-quadratic control in a known system subject to adversarial disturbances. Existing regret bounds for this setting scale as $\sqrt{T}$ unless strong stochastic assumptions are imposed on the…

Machine Learning · Computer Science 2020-06-24 Dylan J. Foster , Max Simchowitz

We study the problem of full-information online learning in the "bounded recall" setting popular in the study of repeated games. An online learning algorithm $\mathcal{A}$ is $M$-$\textit{bounded-recall}$ if its output at time $t$ can be…

Machine Learning · Computer Science 2024-06-04 Jon Schneider , Kiran Vodrahalli

We study predictive control in a setting where the dynamics are time-varying and linear, and the costs are time-varying and well-conditioned. At each time step, the controller receives the exact predictions of costs, dynamics, and…

Optimization and Control · Mathematics 2021-06-22 Yiheng Lin , Yang Hu , Haoyuan Sun , Guanya Shi , Guannan Qu , Adam Wierman

We study the problem of online learning and online regret minimization when samples are drawn from a general unknown non-stationary process. We introduce the concept of a dynamic changing process with cost $K$, where the conditional…

Machine Learning · Computer Science 2023-11-14 Changlong Wu , Ananth Grama , Wojciech Szpankowski

We consider control in linear time-varying dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing an online controller which minimizes regret against the best…

Machine Learning · Computer Science 2021-02-03 Gautam Goel , Babak Hassibi

Non-stationary online learning has drawn much attention in recent years. In particular, dynamic regret and adaptive regret are proposed as two principled performance measures for online convex optimization in non-stationary environments. To…

Machine Learning · Computer Science 2025-09-10 Peng Zhao , Yan-Feng Xie , Lijun Zhang , Zhi-Hua Zhou

A natural goal when designing online learning algorithms for non-stationary environments is to bound the regret of the algorithm in terms of the temporal variation of the input sequence. Intuitively, when the variation is small, it should…

Machine Learning · Computer Science 2021-12-08 Gautam Goel , Babak Hassibi

This paper presents early work aiming at the development of a new framework for the design and analysis of algorithms for online learning based prediction and control. Firstly, we consider the task of predicting values of a function or time…

Optimization and Control · Mathematics 2019-03-26 Jan-P. Calliess

We consider measurement-feedback control in linear dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing an online controller which competes with the optimal…

Systems and Control · Electrical Eng. & Systems 2021-06-24 Gautam Goel , Babak Hassibi

We present an algorithm guaranteeing dynamic regret bounds for online omniprediction with long term constraints. The goal in this recently introduced problem is for a learner to generate a sequence of predictions which are broadcast to a…

Machine Learning · Computer Science 2025-10-09 Yahav Bechavod , Jiuyao Lu , Aaron Roth

Regret minimization is treated as the golden rule in the traditional study of online learning. However, regret minimization algorithms tend to converge to the static optimum, thus being suboptimal for changing environments. To address this…

Machine Learning · Computer Science 2020-02-07 Lijun Zhang , Shiyin Lu , Tianbao Yang

We investigate the hardness of online reinforcement learning in fixed horizon, sparse linear Markov decision process (MDP), with a special focus on the high-dimensional regime where the ambient dimension is larger than the number of…

Machine Learning · Computer Science 2021-02-11 Botao Hao , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

Motivated by the prevalence of ``price protection guarantee", which allows a customer who purchased a product in the past to receive a refund from the seller during the so-called price protection period (typically defined as a certain time…

Machine Learning · Statistics 2022-11-04 Qing Feng , Ruihao Zhu , Stefanus Jasin

Online learning is a powerful tool for analyzing iterative algorithms. However, the classic adversarial setup sometimes fails to capture certain regularity in online problems in practice. Motivated by this, we establish a new setup, called…

Machine Learning · Computer Science 2022-04-06 Ching-An Cheng , Jonathan Lee , Ken Goldberg , Byron Boots

We address the problem of learning to control an unknown nonlinear dynamical system through sequential interactions. Motivated by high-stakes applications in which mistakes can be catastrophic, such as robotics and healthcare, we study…

Machine Learning · Computer Science 2025-04-14 James Wang , Bruce D. Lee , Ingvar Ziemann , Nikolai Matni

This paper presents an iterative learning control (ILC) scheme for continuously operated repetitive systems for which no initial condition reset exists. To accomplish this, we develop a lifted system representation that accounts for the…

Systems and Control · Electrical Eng. & Systems 2021-08-17 Maxwell Wu , Mitchell Cobb , James Reed , Kirti Mishra , Chris Vermillion , Kira Barton

The problem of regret minimization for online adaptive control of linear-quadratic systems is studied. In this problem, the true system transition parameters (matrices $A$ and $B$) are unknown, and the objective is to design and analyze…

Optimization and Control · Mathematics 2022-10-31 Mohammad Akbari , Bahman Gharesifard , Tamas Linder

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

Machine Learning · Computer Science 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

We study the problem of reinforcement learning in infinite-horizon discounted linear Markov decision processes (MDPs), and propose the first computationally efficient algorithm achieving rate-optimal regret guarantees in this setting. Our…

Machine Learning · Computer Science 2026-03-16 Antoine Moulin , Gergely Neu , Luca Viano