English

Rate-optimal Bayesian Simple Regret in Best Arm Identification

Machine Learning 2023-07-27 v3 Machine Learning

Abstract

We consider best arm identification in the multi-armed bandit problem. Assuming certain continuity conditions of the prior, we characterize the rate of the Bayesian simple regret. Differing from Bayesian regret minimization (Lai, 1987), the leading term in the Bayesian simple regret derives from the region where the gap between optimal and suboptimal arms is smaller than logTT\sqrt{\frac{\log T}{T}}. We propose a simple and easy-to-compute algorithm with its leading term matching with the lower bound up to a constant factor; simulation results support our theoretical findings.

Keywords

Cite

@article{arxiv.2111.09885,
  title  = {Rate-optimal Bayesian Simple Regret in Best Arm Identification},
  author = {Junpei Komiyama and Kaito Ariu and Masahiro Kato and Chao Qin},
  journal= {arXiv preprint arXiv:2111.09885},
  year   = {2023}
}

Comments

To appear in Mathematics of Operations Research. Changed the title from the previous version

R2 v1 2026-06-24T07:43:59.760Z