English
Related papers

Related papers: Learning to Cover: Online Learning and Optimizatio…

200 papers

We study online learning with oblivious losses and delays under a novel ``capacity constraint'' that limits how many past rounds can be tracked simultaneously for delayed feedback. Under ``clairvoyance'' (i.e., delay durations are revealed…

Machine Learning · Computer Science 2025-06-27 Alexander Ryabchenko , Idan Attias , Daniel M. Roy

We consider an online revenue maximization problem over a finite time horizon subject to lower and upper bounds on cost. At each period, an agent receives a context vector sampled i.i.d. from an unknown distribution and needs to make a…

Machine Learning · Computer Science 2021-04-21 Alfonso Lobos , Paul Grigas , Zheng Wen

We consider the problem of online learning with non-convex losses. In terms of feedback, we assume that the learner observes - or otherwise constructs - an inexact model for the loss function encountered at each stage, and we propose a…

Machine Learning · Computer Science 2020-10-19 Amélie Héliou , Matthieu Martin , Panayotis Mertikopoulos , Thibaud Rahier

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

Machine Learning · Computer Science 2024-05-21 Jiashuo Jiang

We consider the problem of learning from revealed preferences in an online setting. In our framework, each period a consumer buys an optimal bundle of goods from a merchant according to her (linear) utility function and current prices,…

Data Structures and Algorithms · Computer Science 2014-12-02 Kareem Amin , Rachel Cummings , Lili Dworkin , Michael Kearns , Aaron Roth

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

Machine Learning · Computer Science 2021-02-16 Nicolò Campolongo , Francesco Orabona

We consider the problem of online classification under a privacy constraint. In this setting a learner observes sequentially a stream of labelled examples $(x_t, y_t)$, for $1 \leq t \leq T$, and returns at each iteration $t$ a hypothesis…

Machine Learning · Computer Science 2021-06-28 Noah Golowich , Roi Livni

We present methods for online linear optimization that take advantage of benign (as opposed to worst-case) sequences. Specifically if the sequence encountered by the learner is described well by a known "predictable process", the algorithms…

Machine Learning · Statistics 2014-05-27 Alexander Rakhlin , Karthik Sridharan

We study the problem of online learning in predictive control of an unknown linear dynamical system with time varying cost functions which are unknown apriori. Specifically, we study the online learning problem where the control algorithm…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Dileep Kalathil , Pramod P. Khargonekar

We study the framework of universal dynamic regret minimization with strongly convex losses. We answer an open problem in Baby and Wang 2021 by showing that in a proper learning setup, Strongly Adaptive algorithms can achieve the near…

Machine Learning · Computer Science 2022-01-25 Dheeraj Baby , Yu-Xiang Wang

Online linear programming plays an important role in both revenue management and resource allocation, and recent research has focused on developing efficient first-order online learning algorithms. Despite the empirical success of…

Machine Learning · Statistics 2025-01-07 Wenzhi Gao , Dongdong Ge , Chenyu Xue , Chunlin Sun , Yinyu Ye

We study the problem of online learning with non-convex losses, where the learner has access to an offline optimization oracle. We show that the classical Follow the Perturbed Leader (FTPL) algorithm achieves optimal regret rate of…

Machine Learning · Computer Science 2019-09-24 Arun Sai Suggala , Praneeth Netrapalli

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros

We consider the problem of online combinatorial optimization under semi-bandit feedback, where a learner has to repeatedly pick actions from a combinatorial decision set in order to minimize the total losses associated with its decisions.…

Machine Learning · Computer Science 2015-06-11 Gergely Neu

This paper studies an online learning problem that seeks optimal testing policies for a stream of subjects, each of whom can be evaluated through a sequence of candidate tests drawn from a common pool. We refer to this problem as the Online…

Machine Learning · Computer Science 2025-09-05 Qiyuan Chen , Raed Al Kontar

Inverse optimization is a powerful paradigm for learning preferences and restrictions that explain the behavior of a decision maker, based on a set of external signal and the corresponding decision pairs. However, most inverse optimization…

Machine Learning · Computer Science 2018-11-05 Chaosheng Dong , Yiran Chen , Bo Zeng

We study the problem of predicting the results of computations that are too expensive to run, via the observation of the results of smaller computations. We model this as an online learning problem with delayed feedback, where the length of…

Machine Learning · Computer Science 2016-09-08 Scott Garrabrant , Nate Soares , Jessica Taylor

We give a very general and simple framework to incorporate predictions on requests for online covering problems in a rigorous and black-box manner. Our framework turns any online algorithm with competitive ratio $\rho(k, \cdot)$ depending…

Data Structures and Algorithms · Computer Science 2025-07-09 Afrouz Jabal Ameli , Laura Sanita , Moritz Venzin

Online kernel selection is a fundamental problem of online kernel methods.In this paper,we study online kernel selection with memory constraint in which the memory of kernel selection and online prediction procedures is limited to a fixed…

Machine Learning · Computer Science 2025-03-25 Junfan Li , Shizhong Liao

We study online inverse linear optimization, also known as contextual recommendation, where a learner sequentially infers an agent's hidden objective vector from observed optimal actions over feasible sets that change over time. The learner…

Machine Learning · Computer Science 2026-05-13 Taihei Oki , Shinsaku Sakaue