Multi-scale exploration of convex functions and bandit convex optimization
Metric Geometry
2015-07-24 v1 Machine Learning
Optimization and Control
Probability
Machine Learning
Abstract
We construct a new map from a convex function to a distribution on its domain, with the property that this distribution is a multi-scale exploration of the function. We use this map to solve a decade-old open problem in adversarial bandit convex optimization by showing that the minimax regret for this problem is , where is the dimension and the number of rounds. This bound is obtained by studying the dual Bayesian maximin regret via the information ratio analysis of Russo and Van Roy, and then using the multi-scale exploration to solve the Bayesian problem.
Cite
@article{arxiv.1507.06580,
title = {Multi-scale exploration of convex functions and bandit convex optimization},
author = {Sébastien Bubeck and Ronen Eldan},
journal= {arXiv preprint arXiv:1507.06580},
year = {2015}
}
Comments
Preliminary version; 22 pages