English
Related papers

Related papers: Efficient Tracking of Large Classes of Experts

200 papers

A natural goal when designing online learning algorithms for non-stationary environments is to bound the regret of the algorithm in terms of the temporal variation of the input sequence. Intuitively, when the variation is small, it should…

Machine Learning · Computer Science 2021-12-08 Gautam Goel , Babak Hassibi

We study a generalization of the online binary prediction with expert advice framework where at each round, the learner is allowed to pick $m\geq 1$ experts from a pool of $K$ experts and the overall utility is a modular or submodular…

Machine Learning · Computer Science 2023-05-25 Omid Sadeghi , Maryam Fazel

This work studies external regret in sequential prediction games with both positive and negative payoffs. External regret measures the difference between the payoff obtained by the forecasting strategy and the payoff of the best action. In…

Statistics Theory · Mathematics 2007-06-13 Nicolo Cesa-Bianchi , Yishay Mansour , Gilles Stoltz

We study a variant of prediction with expert advice where the learner's action at round $t$ is only allowed to depend on losses on a specific subset of the rounds (where the structure of which rounds' losses are visible at time $t$ is…

Machine Learning · Computer Science 2024-07-02 Khashayar Gatmiry , Jon Schneider

We study the effectiveness of stochastic side information in deterministic online learning scenarios. We propose a forecaster to predict a deterministic sequence where its performance is evaluated against an expert class. We assume that…

Machine Learning · Computer Science 2023-03-13 Junzhang Jia , Xuetong Wu , Jingge Zhu , Jamie Evans

We revisit the sequential variants of linear regression with the squared loss, classification problems with hinge loss, and logistic regression, all characterized by unbounded losses in the setup where no assumptions are made on the…

Machine Learning · Statistics 2025-09-08 Jian Qian , Alexander Rakhlin , Nikita Zhivotovskiy

We study an online market-making problem in which a learner sequentially posts bid and ask prices for a single asset while interacting with traders holding private valuations. Unlike existing online learning formulations that assume fully…

Machine Learning · Computer Science 2026-05-20 Davide Maran , Marcello Restelli

We revisit the problem of online learning with sleeping experts/bandits: in each time step, only a subset of the actions are available for the algorithm to choose from (and learn about). The work of Kleinberg et al. (2010) showed that there…

Machine Learning · Computer Science 2021-04-27 Ehsan Emamjomeh-Zadeh , Chen-Yu Wei , Haipeng Luo , David Kempe

We consider a family of learning strategies for online optimization problems that evolve in continuous time and we show that they lead to no regret. From a more traditional, discrete-time viewpoint, this continuous-time approach allows us…

Optimization and Control · Mathematics 2014-02-28 Joon Kwon , Panayotis Mertikopoulos

We present a new anytime algorithm that achieves near-optimal regret for any instance of finite stochastic partial monitoring. In particular, the new algorithm achieves the minimax regret, within logarithmic factors, for both "easy" and…

Machine Learning · Computer Science 2012-07-03 Gabor Bartok , Navid Zolghadr , Csaba Szepesvari

In this paper, we develop a unified framework for analyzing the tracking error and dynamic regret of inexact online optimization methods under a variety of settings. Specifically, we leverage the quadratic constraint approach from control…

Optimization and Control · Mathematics 2023-03-03 Usman Syed , Emiliano Dall'Anese , Bin Hu

We study the problem of uncertainty quantification via prediction sets, in an online setting where the data distribution may vary arbitrarily over time. Recent work develops online conformal prediction techniques that leverage regret…

Machine Learning · Computer Science 2023-02-16 Aadyot Bhatnagar , Huan Wang , Caiming Xiong , Yu Bai

We consider the problem of controlling an unknown linear quadratic Gaussian (LQG) system consisting of multiple subsystems connected over a network. Our goal is to minimize and quantify the regret (i.e. loss in performance) of our strategy…

Systems and Control · Electrical Eng. & Systems 2021-08-19 Sagar Sudhakara , Aditya Mahajan , Ashutosh Nayyar , Yi Ouyang

This letter studies the problem of online multi-step-ahead prediction for unknown linear stochastic systems. Using conditional distribution theory, we derive an optimal parameterization of the prediction policy as a linear function of…

Machine Learning · Computer Science 2025-11-18 Jiachen Qian , Yang Zheng

We study the problem of incentive-compatible online learning with bandit feedback. In this class of problems, the experts are self-interested agents who might misrepresent their preferences with the goal of being selected most often. The…

Machine Learning · Computer Science 2024-05-13 Julian Zimmert , Teodor V. Marinov

In online learning, the data is provided in a sequential order, and the goal of the learner is to make online decisions to minimize overall regrets. This note is concerned with continuous-time models and algorithms for several online…

Machine Learning · Statistics 2024-05-20 Lexing Ying

This paper proposes a new family of algorithms for the online optimisation of composite objectives. The algorithms can be interpreted as the combination of the exponentiated gradient and $p$-norm algorithm. Combined with algorithmic ideas…

Optimization and Control · Mathematics 2022-08-09 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak

The prediction of a binary sequence is a classic example of online machine learning. We like to call it the 'stock prediction problem,' viewing the sequence as the price history of a stock that goes up or down one unit at each time step. In…

Optimization and Control · Mathematics 2020-07-28 Nadejda Drenska , Robert V. Kohn

We study the problem of online multi-group learning, a learning model in which an online learner must simultaneously achieve small prediction regret on a large collection of (possibly overlapping) subsequences corresponding to a family of…

Machine Learning · Computer Science 2025-07-16 Samuel Deng , Daniel Hsu , Jingwen Liu

Emerging mobility systems are increasingly capable of recommending options to mobility users, to guide them towards personalized yet sustainable system outcomes. Even more so than the typical recommendation system, it is crucial to minimize…

Machine Learning · Computer Science 2024-06-25 Tianyue Zhou , Jung-Hoon Cho , Babak Rahimi Ardabili , Hamed Tabkhi , Cathy Wu
‹ Prev 1 3 4 5 6 7 10 Next ›