English

Bandits with Feedback Graphs and Switching Costs

Machine Learning 2020-03-24 v2 Machine Learning

Abstract

We study the adversarial multi-armed bandit problem where partial observations are available and where, in addition to the loss incurred for each action, a \emph{switching cost} is incurred for shifting to a new action. All previously known results incur a factor proportional to the independence number of the feedback graph. We give a new algorithm whose regret guarantee depends only on the domination number of the graph. We further supplement that result with a lower bound. Finally, we also give a new algorithm with improved policy regret bounds when partial counterfactual feedback is available.

Keywords

Cite

@article{arxiv.1907.12189,
  title  = {Bandits with Feedback Graphs and Switching Costs},
  author = {Raman Arora and Teodor V. Marinov and Mehryar Mohri},
  journal= {arXiv preprint arXiv:1907.12189},
  year   = {2020}
}

Comments

Camera ready from NeurIPS 2019, new algorithm and improved results in Section 3.2

R2 v1 2026-06-23T10:33:19.990Z