English

Generalised Mixability, Constant Regret, and Bayesian Updating

Machine Learning 2014-03-12 v1 Machine Learning

Abstract

Mixability of a loss is known to characterise when constant regret bounds are achievable in games of prediction with expert advice through the use of Vovk's aggregating algorithm. We provide a new interpretation of mixability via convex analysis that highlights the role of the Kullback-Leibler divergence in its definition. This naturally generalises to what we call Φ\Phi-mixability where the Bregman divergence DΦD_\Phi replaces the KL divergence. We prove that losses that are Φ\Phi-mixable also enjoy constant regret bounds via a generalised aggregating algorithm that is similar to mirror descent.

Keywords

Cite

@article{arxiv.1403.2433,
  title  = {Generalised Mixability, Constant Regret, and Bayesian Updating},
  author = {Mark D. Reid and Rafael M. Frongillo and Robert C. Williamson},
  journal= {arXiv preprint arXiv:1403.2433},
  year   = {2014}
}

Comments

12 pages

R2 v1 2026-06-22T03:23:57.800Z