English

Multinomial Logit Bandit with Low Switching Cost

Machine Learning 2020-07-10 v1 Machine Learning

Abstract

We study multinomial logit bandit with limited adaptivity, where the algorithms change their exploration actions as infrequently as possible when achieving almost optimal minimax regret. We propose two measures of adaptivity: the assortment switching cost and the more fine-grained item switching cost. We present an anytime algorithm (AT-DUCB) with O(NlogT)O(N \log T) assortment switches, almost matching the lower bound Ω(NlogTloglogT)\Omega(\frac{N \log T}{ \log \log T}). In the fixed-horizon setting, our algorithm FH-DUCB incurs O(NloglogT)O(N \log \log T) assortment switches, matching the asymptotic lower bound. We also present the ESUCB algorithm with item switching cost O(Nlog2T)O(N \log^2 T).

Cite

@article{arxiv.2007.04876,
  title  = {Multinomial Logit Bandit with Low Switching Cost},
  author = {Kefan Dong and Yingkai Li and Qin Zhang and Yuan Zhou},
  journal= {arXiv preprint arXiv:2007.04876},
  year   = {2020}
}

Comments

Accepted for presentation at the International Conference on Machine Learning (ICML) 2020

R2 v1 2026-06-23T16:59:19.681Z