English

Bandit Convex Optimization: sqrt{T} Regret in One Dimension

Machine Learning 2015-02-24 v1 Optimization and Control

Abstract

We analyze the minimax regret of the adversarial bandit convex optimization problem. Focusing on the one-dimensional case, we prove that the minimax regret is Θ~(T)\widetilde\Theta(\sqrt{T}) and partially resolve a decade-old open problem. Our analysis is non-constructive, as we do not present a concrete algorithm that attains this regret rate. Instead, we use minimax duality to reduce the problem to a Bayesian setting, where the convex loss functions are drawn from a worst-case distribution, and then we solve the Bayesian version of the problem with a variant of Thompson Sampling. Our analysis features a novel use of convexity, formalized as a "local-to-global" property of convex functions, that may be of independent interest.

Keywords

Cite

@article{arxiv.1502.06398,
  title  = {Bandit Convex Optimization: sqrt{T} Regret in One Dimension},
  author = {Sébastien Bubeck and Ofer Dekel and Tomer Koren and Yuval Peres},
  journal= {arXiv preprint arXiv:1502.06398},
  year   = {2015}
}
R2 v1 2026-06-22T08:35:22.465Z