A second order regret bound for NormalHedge
Machine Learning
2026-02-10 v1 Machine Learning
Abstract
We consider the problem of prediction with expert advice for ``easy'' sequences. We show that a variant of NormalHedge enjoys a second-order -quantile regret bound of when , where is the cumulative second moment of instantaneous per-expert regret averaged with respect to a natural distribution determined by the algorithm. The algorithm is motivated by a continuous time limit using Stochastic Differential Equations. The discrete time analysis uses self-concordance techniques.
Keywords
Cite
@article{arxiv.2602.08151,
title = {A second order regret bound for NormalHedge},
author = {Yoav Freund and Nicholas J. A. Harvey and Victor S. Portella and Yabing Qi and Yu-Xiang Wang},
journal= {arXiv preprint arXiv:2602.08151},
year = {2026}
}