English

The Adaptivity Barrier in Batched Nonparametric Bandits: Sharp Characterization of the Price of Unknown Margin

Statistics Theory 2025-11-12 v2 Machine Learning Machine Learning Statistics Theory

Abstract

We study batched nonparametric contextual bandits under a margin condition when the margin parameter α\alpha is unknown. To capture the statistical cost of this ignorance, we introduce the regret inflation criterion, defined as the ratio between the regret of an adaptive algorithm and that of an oracle knowing α\alpha. We show that the optimal regret inflation grows polynomially with the horizon TT, with exponent given by the value of a convex optimization problem that depends on the dimension, smoothness, and number of batches MM. Moreover, the minimizer of this optimization problem directly prescribes the batch allocation and exploration strategy of a rate-optimal algorithm. Building on this principle, we develop RoBIN (RObust batched algorithm with adaptive BINning), which achieves the optimal regret inflation up to polylogarithmic factors. These results reveal a new adaptivity barrier: under batching, adaptation to an unknown margin parameter inevitably incurs a polynomial penalty, sharply characterized by a variational problem. Remarkably, this barrier vanishes once the number of batches exceeds order loglogT\log \log T; with only a doubly logarithmic number of updates, one can recover the oracle regret rate up to polylogarithmic factors.

Keywords

Cite

@article{arxiv.2511.03708,
  title  = {The Adaptivity Barrier in Batched Nonparametric Bandits: Sharp Characterization of the Price of Unknown Margin},
  author = {Rong Jiang and Cong Ma},
  journal= {arXiv preprint arXiv:2511.03708},
  year   = {2025}
}