English
Related papers

Related papers: Exp-Concavity of Proper Composite Losses

200 papers

We address online linear optimization problems when the possible actions of the decision maker are represented by binary vectors. The regret of the decision maker is the difference between her realized loss and the best loss she would have…

Machine Learning · Computer Science 2013-04-02 Jean-Yves Audibert , Sébastien Bubeck , Gábor Lugosi

In many sequential decision making applications, the change of decision would bring an additional cost, such as the wear-and-tear cost associated with changing server status. To control the switching cost, we introduce the problem of online…

Machine Learning · Computer Science 2021-03-23 Guanghui Wang , Yuanyu Wan , Tianbao Yang , Lijun Zhang

This paper proposes a new family of algorithms for the online optimisation of composite objectives. The algorithms can be interpreted as the combination of the exponentiated gradient and $p$-norm algorithm. Combined with algorithmic ideas…

Optimization and Control · Mathematics 2022-08-09 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak

Mixability is a property of a loss which characterizes when fast convergence is possible in the game of prediction with expert advice. We show that a key property of mixability generalizes, and the exp and log operations present in the…

Machine Learning · Computer Science 2014-06-25 Mark D. Reid , Rafael M. Frongillo , Robert C. Williamson , Nishant Mehta

We investigate online convex optimization in non-stationary environments and choose dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

Machine Learning · Computer Science 2024-04-09 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

This paper considers the distributed online convex optimization problem with time-varying constraints over a network of agents. This is a sequential decision making problem with two sequences of arbitrarily varying convex loss and…

Optimization and Control · Mathematics 2022-12-29 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Tianyou Chai , Karl H. Johansson

We consider the problem setting of prediction with expert advice with possibly heavy-tailed losses, i.e. the only assumption on the losses is an upper bound on their second moments, denoted by $\theta$. We develop adaptive algorithms that…

Machine Learning · Computer Science 2026-01-09 Antoine Moulin , Emmanuel Esposito , Dirk van der Hoeven

We consider the problem of the Zinkevich (2003)-style dynamic regret minimization in online learning with exp-concave losses. We show that whenever improper learning is allowed, a Strongly Adaptive online learner achieves the dynamic regret…

Machine Learning · Computer Science 2021-07-06 Dheeraj Baby , Yu-Xiang Wang

We study the online calibration of multi-dimensional forecasts over an arbitrary convex set $\mathcal{P} \subset \mathbb{R}^d$ relative to an arbitrary norm $\Vert\cdot\Vert$. We connect this with the problem of external regret minimization…

Machine Learning · Computer Science 2025-05-28 Maxwell Fishelson , Noah Golowich , Mehryar Mohri , Jon Schneider

We consider the framework of non-stationary Online Convex Optimization where a learner seeks to control its dynamic regret against an arbitrary sequence of comparators. When the loss functions are strongly convex or exp-concave, we…

Machine Learning · Computer Science 2021-11-24 Dheeraj Baby , Hilaf Hasson , Yuyang Wang

We study calibeating, the problem of post-processing external forecasts online to minimize cumulative losses and match an informativeness-based benchmark. Unlike prior work, which analyzed calibeating for specific losses with specific…

Machine Learning · Computer Science 2026-03-24 Yurong Chen , Zhiyi Huang , Michael I. Jordan , Haipeng Luo

In this paper, we propose an online convex optimization approach with two different levels of adaptivity. On a higher level, our approach is agnostic to the unknown types and curvatures of the online functions, while at a lower level, it…

Machine Learning · Computer Science 2024-04-17 Yu-Hu Yan , Peng Zhao , Zhi-Hua Zhou

We introduce a new online convex optimization algorithm that adaptively chooses its regularization function based on the loss functions observed so far. This is in contrast to previous algorithms that use a fixed regularization function…

Machine Learning · Computer Science 2010-07-08 H. Brendan McMahan , Matthew Streeter

The regret bound of an optimization algorithms is one of the basic criteria for evaluating the performance of the given algorithm. By inspecting the differences between the regret bounds of traditional algorithms and adaptive one, we…

Machine Learning · Statistics 2017-07-07 HyoungSeok Kim , JiHoon Kang , WooMyoung Park , SukHyun Ko , YoonHo Cho , DaeSung Yu , YoungSook Song , JungWon Choi

We study the generalization performance of online learning algorithms trained on samples coming from a dependent source of data. We show that the generalization error of any stable online algorithm concentrates around its regret--an easily…

Machine Learning · Statistics 2012-06-08 Alekh Agarwal , John C. Duchi

We revisit the challenge of designing online algorithms for the bandit convex optimization problem (BCO) which are also scalable to high dimensional problems. Hence, we consider algorithms that are \textit{projection-free}, i.e., based on…

Machine Learning · Computer Science 2019-10-09 Dan Garber , Ben Kretzu

We study Online Convex Optimization with adversarial constraints (COCO). At each round a learner selects an action from a convex decision set and then an adversary reveals a convex cost and a convex constraint function. The goal of the…

Machine Learning · Computer Science 2025-11-17 Abhishek Sinha , Rahul Vaze

We investigate the problem of cumulative regret minimization for individual sequence prediction with respect to the best expert in a finite family of size K under limited access to information. We assume that in each round, the learner can…

Statistics Theory · Mathematics 2022-10-06 El Mehdi Saad , G. Blanchard

We investigate the problem of online learning, which has gained significant attention in recent years due to its applicability in a wide range of fields from machine learning to game theory. Specifically, we study the online optimization of…

Machine Learning · Computer Science 2021-09-29 Kaan Gokcesu , Hakan Gokcesu

We consider the use of no-regret algorithms to compute equilibria for particular classes of convex-concave games. While standard regret bounds would lead to convergence rates on the order of $O(T^{-1/2})$, recent work \citep{RS13,SALS15}…

Machine Learning · Computer Science 2018-05-18 Jacob Abernethy , Kevin A. Lai , Kfir Y. Levy , Jun-Kun Wang