English

Are Stochastic Multi-objective Bandits Harder than Single-objective Bandits?

Machine Learning 2026-05-08 v2 Machine Learning

Abstract

Multi-objective bandits have attracted increasing attention for their broad applicability, with dd-dimensional reward vectors inducing Pareto regret. There has been a subtle debate over whether this added structure makes the problem fundamentally harder than single-objective bandits. We answer this by showing that, in terms of Pareto regret, it is surprisingly no harder: Pareto regret scales inversely with gg^\dagger, the largest objective-wise suboptimality gap, and thus matches the smallest objective-wise classical regret. We formalize this idea via a novel method with upper and lower confidence-bound estimators for every arm-objective pair. It uses top-two races to compare arms within each objective and an uncertainty-greedy rule to allocate exploration toward the largest objective-wise gap gg^\dagger, until the corresponding Pareto-optimal arm is committed to. We prove that it achieves Pareto regret of O(\nicefraclogTg)O(\nicefrac{\log T}{g^\dagger}), where TT is the horizon, with \emph{no dependence on dd}. A matching lower bound of Ω(\nicefraclogTg)\Omega(\nicefrac{\log T}{g^\dagger}) implies optimality. We evaluate the method on synthetic and real-world datasets, confirming the theory and achieving order-of-magnitude reductions in Pareto regret over baselines. Real-world results further show that our method commits to a Pareto optimal arm, possibly at the cost of empirical fairness, suggesting a potential hardness absent in single-objective bandits.

Keywords

Cite

@article{arxiv.2604.07096,
  title  = {Are Stochastic Multi-objective Bandits Harder than Single-objective Bandits?},
  author = {Changkun Guan and Mengfan Xu},
  journal= {arXiv preprint arXiv:2604.07096},
  year   = {2026}
}

Comments

21 pages

R2 v1 2026-07-01T11:59:20.224Z