Generalised Mixability, Constant Regret, and Bayesian Updating
Machine Learning
2014-03-12 v1 Machine Learning
Abstract
Mixability of a loss is known to characterise when constant regret bounds are achievable in games of prediction with expert advice through the use of Vovk's aggregating algorithm. We provide a new interpretation of mixability via convex analysis that highlights the role of the Kullback-Leibler divergence in its definition. This naturally generalises to what we call -mixability where the Bregman divergence replaces the KL divergence. We prove that losses that are -mixable also enjoy constant regret bounds via a generalised aggregating algorithm that is similar to mirror descent.
Keywords
Cite
@article{arxiv.1403.2433,
title = {Generalised Mixability, Constant Regret, and Bayesian Updating},
author = {Mark D. Reid and Rafael M. Frongillo and Robert C. Williamson},
journal= {arXiv preprint arXiv:1403.2433},
year = {2014}
}
Comments
12 pages