Nearly Instance Optimal Sample Complexity Bounds for Top-k Arm Selection
Abstract
In the Best--Arm problem, we are given stochastic bandit arms, each associated with an unknown reward distribution. We are required to identify the arms with the largest means by taking as few samples as possible. In this paper, we make progress towards a complete characterization of the instance-wise sample complexity bounds for the Best--Arm problem. On the lower bound side, we obtain a novel complexity term to measure the sample complexity that every Best--Arm instance requires. This is derived by an interesting and nontrivial reduction from the Best--Arm problem. We also provide an elimination-based algorithm that matches the instance-wise lower bound within doubly-logarithmic factors. The sample complexity of our algorithm strictly dominates the state-of-the-art for Best--Arm (module constant factors).
Cite
@article{arxiv.1702.03605,
title = {Nearly Instance Optimal Sample Complexity Bounds for Top-k Arm Selection},
author = {Lijie Chen and Jian Li and Mingda Qiao},
journal= {arXiv preprint arXiv:1702.03605},
year = {2017}
}
Comments
Accepted by AISTATS 2017