Non-Stationary Bandit Convex Optimization: An Optimal Algorithm with Two-Point Feedback
Optimization and Control
2026-05-26 v3
Abstract
This paper studies bandit convex optimization in non-stationary environments with two-point feedback, using dynamic regret as the performance measure. We propose an algorithm based on bandit mirror descent that extends naturally to non-Euclidean settings. Let be the total number of iterations and the path variation with respect to the -norm. In Euclidean space, our algorithm matches the optimal regret bound , improving upon \citet{zhao2021bandit} by a factor of . Beyond Euclidean settings, our algorithm achieves an upper bound of on the simplex, which is nearly optimal up to log factors. For the cross-polytope, the bound reduces to for some .
Cite
@article{arxiv.2508.04654,
title = {Non-Stationary Bandit Convex Optimization: An Optimal Algorithm with Two-Point Feedback},
author = {Chang He and Bo Jiang and Shuzhong Zhang},
journal= {arXiv preprint arXiv:2508.04654},
year = {2026}
}