PAC-Bayesian Analysis of the Exploration-Exploitation Trade-off
Machine Learning
2015-03-19 v1 Machine Learning
Abstract
We develop a coherent framework for integrative simultaneous analysis of the exploration-exploitation and model order selection trade-offs. We improve over our preceding results on the same subject (Seldin et al., 2011) by combining PAC-Bayesian analysis with Bernstein-type inequality for martingales. Such a combination is also of independent interest for studies of multiple simultaneously evolving martingales.
Cite
@article{arxiv.1105.4585,
title = {PAC-Bayesian Analysis of the Exploration-Exploitation Trade-off},
author = {Yevgeny Seldin and Nicolò Cesa-Bianchi and François Laviolette and Peter Auer and John Shawe-Taylor and Jan Peters},
journal= {arXiv preprint arXiv:1105.4585},
year = {2015}
}
Comments
On-line Trading of Exploration and Exploitation 2 - ICML-2011 workshop. http://explo.cs.ucl.ac.uk/workshop/