English

A second order regret bound for NormalHedge

Machine Learning 2026-02-10 v1 Machine Learning

Abstract

We consider the problem of prediction with expert advice for ``easy'' sequences. We show that a variant of NormalHedge enjoys a second-order ϵ\epsilon-quantile regret bound of O(VTlog(VT/ϵ))O\big(\sqrt{V_T \log(V_T/\epsilon)}\big) when VT>logNV_T > \log N, where VTV_T is the cumulative second moment of instantaneous per-expert regret averaged with respect to a natural distribution determined by the algorithm. The algorithm is motivated by a continuous time limit using Stochastic Differential Equations. The discrete time analysis uses self-concordance techniques.

Keywords

Cite

@article{arxiv.2602.08151,
  title  = {A second order regret bound for NormalHedge},
  author = {Yoav Freund and Nicholas J. A. Harvey and Victor S. Portella and Yabing Qi and Yu-Xiang Wang},
  journal= {arXiv preprint arXiv:2602.08151},
  year   = {2026}
}
R2 v1 2026-07-01T10:27:04.435Z