Near-Optimal Regret in Adversarial Kernel Bandits
Abstract
We study the adversarial kernel bandit problem, in which the loss at each round is induced by an arbitrary bounded element of a reproducing kernel Hilbert space (RKHS). We propose an exponential-weights algorithm built on a regularized importance-weighted loss estimator, together with an explicit correction term that cancels the bias introduced by the regularization. Our main result bounds the regret by , where is a widely-adopted notion of effective dimension that captures the complexity of the kernel. Up to logarithmic factors, this matches the known rate achieved in the related stochastic kernel bandit problem. A notable application is the Mat\'ern kernel with smoothness parameter on , for which our bound specializes to , improving over the best-known prior rate of Chatterji et al. [2019] while simultaneously removing the rank-one adversary assumption required by their analysis. Moreover, this rate is the same as the known optimal rate for stochastic kernel bandits, and also matches a lower bound from concurrent work up to a factor.
Cite
@article{arxiv.2605.26585,
title = {Near-Optimal Regret in Adversarial Kernel Bandits},
author = {Yu-Jie Zhang and Hao Qiu and Jonathan Scarlett and Kevin Jamieson},
journal= {arXiv preprint arXiv:2605.26585},
year = {2026}
}