English

Non-Stationary Bandit Convex Optimization: An Optimal Algorithm with Two-Point Feedback

Optimization and Control 2026-05-26 v3

Abstract

This paper studies bandit convex optimization in non-stationary environments with two-point feedback, using dynamic regret as the performance measure. We propose an algorithm based on bandit mirror descent that extends naturally to non-Euclidean settings. Let TT be the total number of iterations and PT,p\mathcal{P}_{T,p} the path variation with respect to the p\ell_p-norm. In Euclidean space, our algorithm matches the optimal regret bound O(dT(1+PT,2))\mathcal{O}(\sqrt{dT(1+\mathcal{P}_{T,2})}), improving upon \citet{zhao2021bandit} by a factor of O(d)\mathcal{O}(\sqrt{d}). Beyond Euclidean settings, our algorithm achieves an upper bound of O(dlog(d)Tlog(T)(1+PT,1))\mathcal{O}(\sqrt{d\log(d)T\log(T)(1 + \mathcal{P}_{T,1})}) on the simplex, which is nearly optimal up to log factors. For the cross-polytope, the bound reduces to O(dlog(d)T(1+PT,p))\mathcal{O}(\sqrt{d\log(d)T(1+\mathcal{P}_{T,p})}) for some p=1+1/log(d)p = 1 + 1/\log(d).

Keywords

Cite

@article{arxiv.2508.04654,
  title  = {Non-Stationary Bandit Convex Optimization: An Optimal Algorithm with Two-Point Feedback},
  author = {Chang He and Bo Jiang and Shuzhong Zhang},
  journal= {arXiv preprint arXiv:2508.04654},
  year   = {2026}
}
R2 v1 2026-07-01T04:37:45.900Z