Rate-optimal Bayesian Simple Regret in Best Arm Identification
Machine Learning
2023-07-27 v3 Machine Learning
Abstract
We consider best arm identification in the multi-armed bandit problem. Assuming certain continuity conditions of the prior, we characterize the rate of the Bayesian simple regret. Differing from Bayesian regret minimization (Lai, 1987), the leading term in the Bayesian simple regret derives from the region where the gap between optimal and suboptimal arms is smaller than . We propose a simple and easy-to-compute algorithm with its leading term matching with the lower bound up to a constant factor; simulation results support our theoretical findings.
Cite
@article{arxiv.2111.09885,
title = {Rate-optimal Bayesian Simple Regret in Best Arm Identification},
author = {Junpei Komiyama and Kaito Ariu and Masahiro Kato and Chao Qin},
journal= {arXiv preprint arXiv:2111.09885},
year = {2023}
}
Comments
To appear in Mathematics of Operations Research. Changed the title from the previous version