English
Related papers

Related papers: Online optimization and regret guarantees for non-…

200 papers

In this work, we investigate the online learning problem of revenue maximization in ad auctions, where the seller needs to learn the click-through rates (CTRs) of each ad candidate and charge the price of the winner through a pay-per-click…

Information Retrieval · Computer Science 2024-03-05 Zhe Feng , Christopher Liaw , Zixin Zhou

Although online convex optimization (OCO) under arbitrary delays has received increasing attention recently, previous studies focus on stationary environments with the goal of minimizing static regret. In this paper, we investigate the…

Machine Learning · Computer Science 2025-11-10 Yuanyu Wan , Chang Yao , Yitao Ma , Mingli Song , Lijun Zhang

Stochastic and adversarial data are two widely studied settings in online learning. But many optimization tasks are neither i.i.d. nor fully adversarial, which makes it of fundamental interest to get a better theoretical understanding of…

Machine Learning · Computer Science 2025-11-03 Sarah Sachs , Hedi Hadiji , Tim van Erven , Cristobal Guzman

The extension of classical online algorithms when provided with predictions is a new and active research area. In this paper, we extend the primal-dual method for online algorithms in order to incorporate predictions that advise the online…

Machine Learning · Computer Science 2020-10-23 Étienne Bamas , Andreas Maggiori , Ola Svensson

We study the problem of uncertainty quantification via prediction sets, in an online setting where the data distribution may vary arbitrarily over time. Recent work develops online conformal prediction techniques that leverage regret…

Machine Learning · Computer Science 2023-02-16 Aadyot Bhatnagar , Huan Wang , Caiming Xiong , Yu Bai

This paper focuses on the online saddle point problem, which involves a sequence of two-player time-varying convex-concave games. Considering the nonstationarity of the environment, we adopt the duality gap and the dynamic Nash equilibrium…

Machine Learning · Computer Science 2025-06-27 Qing-xin Meng , Jian-wei Liu

This paper describes a new online convex optimization method which incorporates a family of candidate dynamical models and establishes novel tracking regret bounds that scale with the comparator's deviation from the best dynamical model in…

Machine Learning · Statistics 2013-01-08 Eric C. Hall , Rebecca M. Willett

Online optimisation facilitates the solution of dynamic inverse problems, such as image stabilisation, fluid flow monitoring, and dynamic medical imaging. In this paper, we improve upon previous work on predictive online primal-dual methods…

Optimization and Control · Mathematics 2025-02-28 Neil Dizon , Jyrki Jauhiainen , Tuomo Valkonen

We study the problem of online learning in predictive control of an unknown linear dynamical system with time varying cost functions which are unknown apriori. Specifically, we study the online learning problem where the control algorithm…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Dileep Kalathil , Pramod P. Khargonekar

The framework of online learning with memory naturally captures learning problems with temporal constraints, and was previously studied for the experts setting. In this work we extend the notion of learning with memory to the general Online…

Machine Learning · Computer Science 2014-06-11 Oren Anava , Elad Hazan , Shie Mannor

We propose an algorithm based on online convex optimization for controlling discrete-time linear dynamical systems. The algorithm is data-driven, i.e., does not require a model of the system, and is able to handle a priori unknown and…

Optimization and Control · Mathematics 2022-11-17 Marko Nonhoff , Matthias A. Müller

We show how to take any two parameter-free online learning algorithms with different regret guarantees and obtain a single algorithm whose regret is the minimum of the two base algorithms. Our method is embarrassingly simple: just add the…

Machine Learning · Statistics 2019-02-26 Ashok Cutkosky

This paper considers distributed online convex optimization with adversarial constraints. In this setting, a network of agents makes decisions at each round, and then only a portion of the loss function and a coordinate block of the…

Optimization and Control · Mathematics 2023-06-02 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Yiguang Hong , Tianyou Chai , Karl H. Johansson

Many prediction domains, such as ad placement, recommendation, trajectory prediction, and document summarization, require predicting a set or list of options. Such lists are often evaluated using submodular reward functions that measure…

Machine Learning · Computer Science 2013-05-14 Stephane Ross , Jiaji Zhou , Yisong Yue , Debadeepta Dey , J. Andrew Bagnell

We consider the problem of online prediction in a marginally stable linear dynamical system subject to bounded adversarial or (non-isotropic) stochastic perturbations. This poses two challenges. Firstly, the system is in general…

Machine Learning · Computer Science 2020-11-24 Udaya Ghai , Holden Lee , Karan Singh , Cyril Zhang , Yi Zhang

Which ads should we display in sponsored search in order to maximize our revenue? How should we dynamically rank information sources to maximize the value of the ranking? These applications exhibit strong diminishing returns: Redundancy…

Machine Learning · Computer Science 2014-07-07 Daniel Golovin , Andreas Krause , Matthew Streeter

A natural goal when designing online learning algorithms for non-stationary environments is to bound the regret of the algorithm in terms of the temporal variation of the input sequence. Intuitively, when the variation is small, it should…

Machine Learning · Computer Science 2021-12-08 Gautam Goel , Babak Hassibi

We consider the problem of online learning with non-convex losses. In terms of feedback, we assume that the learner observes - or otherwise constructs - an inexact model for the loss function encountered at each stage, and we propose a…

Machine Learning · Computer Science 2020-10-19 Amélie Héliou , Matthieu Martin , Panayotis Mertikopoulos , Thibaud Rahier

One of the main strengths of online algorithms is their ability to adapt to arbitrary data sequences. This is especially important in nonparametric settings, where performance is measured against rich classes of comparator functions that…

Machine Learning · Computer Science 2020-11-03 Ilja Kuzborskij , Nicolò Cesa-Bianchi

We study the control of a linear dynamical system with adversarial disturbances (as opposed to statistical noise). The objective we consider is one of regret: we desire an online control procedure that can do nearly as well as that of a…

Machine Learning · Computer Science 2019-02-26 Naman Agarwal , Brian Bullins , Elad Hazan , Sham M. Kakade , Karan Singh