English

Near-Optimal Regret for Efficient Stochastic Combinatorial Semi-Bandits

Machine Learning 2025-12-30 v2 Data Structures and Algorithms Machine Learning

Abstract

The combinatorial multi-armed bandit (CMAB) is a cornerstone of sequential decision-making framework, dominated by two algorithmic families: UCB-based and adversarial methods such as follow the regularized leader (FTRL) and online mirror descent (OMD). However, prominent UCB-based approaches like CUCB suffer from additional regret factor logT\log T that is detrimental over long horizons, while adversarial methods such as EXP3.M and HYBRID impose significant computational overhead. To resolve this trade-off, we introduce the Combinatorial Minimax Optimal Strategy in the Stochastic setting (CMOSS). CMOSS is a computationally efficient algorithm that achieves an instance-independent regret of O((logk)kmT)O\big( (\log k)\sqrt{kmT}\big ) when km2k\leq \frac{m}{2} and O((mk)logklog(mk)T)O\big((m-k)\sqrt{\log k\log(m-k)T}\big ) when k>m2k>\frac{m}{2} under semi-bandit feedback, where mm is the number of arms and kk is the maximum cardinality of a feasible action. Crucially, this result eliminates the dependency on logT\log T and matches the established lower bounds of Ω(kmT)\Omega\big(\sqrt{kmT}\big) when km2k\leq \frac{m}{2} and Ω((mk)log(mmk)T)\Omega\big((m-k)\sqrt{\log (\frac{m}{m-k}) T}\big) when k>m2k>\frac{m}{2} up to logarithmic terms of kk and mm. We then extend our analysis to show that CMOSS is also applicable to cascading feedback. Experiments on synthetic and real-world datasets validate that CMOSS consistently outperforms benchmark algorithms in both regret and runtime efficiency.

Keywords

Cite

@article{arxiv.2508.06247,
  title  = {Near-Optimal Regret for Efficient Stochastic Combinatorial Semi-Bandits},
  author = {Zichun Ye and Runqi Wang and Xutong Liu and Shuai Li},
  journal= {arXiv preprint arXiv:2508.06247},
  year   = {2025}
}