Are Stochastic Multi-objective Bandits Harder than Single-objective Bandits?
Abstract
Multi-objective bandits have attracted increasing attention for their broad applicability, with -dimensional reward vectors inducing Pareto regret. There has been a subtle debate over whether this added structure makes the problem fundamentally harder than single-objective bandits. We answer this by showing that, in terms of Pareto regret, it is surprisingly no harder: Pareto regret scales inversely with , the largest objective-wise suboptimality gap, and thus matches the smallest objective-wise classical regret. We formalize this idea via a novel method with upper and lower confidence-bound estimators for every arm-objective pair. It uses top-two races to compare arms within each objective and an uncertainty-greedy rule to allocate exploration toward the largest objective-wise gap , until the corresponding Pareto-optimal arm is committed to. We prove that it achieves Pareto regret of , where is the horizon, with \emph{no dependence on }. A matching lower bound of implies optimality. We evaluate the method on synthetic and real-world datasets, confirming the theory and achieving order-of-magnitude reductions in Pareto regret over baselines. Real-world results further show that our method commits to a Pareto optimal arm, possibly at the cost of empirical fairness, suggesting a potential hardness absent in single-objective bandits.
Cite
@article{arxiv.2604.07096,
title = {Are Stochastic Multi-objective Bandits Harder than Single-objective Bandits?},
author = {Changkun Guan and Mengfan Xu},
journal= {arXiv preprint arXiv:2604.07096},
year = {2026}
}
Comments
21 pages