English

Additive Distributionally Robust Ranking and Selection

Machine Learning 2025-09-09 v1 Machine Learning Methodology

Abstract

Ranking and selection (R&S) aims to identify the alternative with the best mean performance among kk simulated alternatives. The practical value of R&S depends on accurate simulation input modeling, which often suffers from the curse of input uncertainty due to limited data. Distributionally robust ranking and selection (DRR&S) addresses this challenge by modeling input uncertainty via an ambiguity set of m>1m > 1 plausible input distributions, resulting in kmkm scenarios in total. Recent DRR&S studies suggest a key structural insight: additivity in budget allocation is essential for efficiency. However, existing justifications are heuristic, and fundamental properties such as consistency and the precise allocation pattern induced by additivity remain poorly understood. In this paper, we propose a simple additive allocation (AA) procedure that aims to exclusively sample the k+m1k + m - 1 previously hypothesized critical scenarios. Leveraging boundary-crossing arguments, we establish a lower bound on the probability of correct selection and characterize the procedure's budget allocation behavior. We then prove that AA is consistent and, surprisingly, achieves additivity in the strongest sense: as the total budget increases, only k+m1k + m - 1 scenarios are sampled infinitely often. Notably, the worst-case scenarios of non-best alternatives may not be among them, challenging prior beliefs about their criticality. These results offer new and counterintuitive insights into the additive structure of DRR&S. To improve practical performance while preserving this structure, we introduce a general additive allocation (GAA) framework that flexibly incorporates sampling rules from traditional R&S procedures in a modular fashion. Numerical experiments support our theoretical findings and demonstrate the competitive performance of the proposed GAA procedures.

Keywords

Cite

@article{arxiv.2509.06147,
  title  = {Additive Distributionally Robust Ranking and Selection},
  author = {Zaile Li and Yuchen Wan and L. Jeff Hong},
  journal= {arXiv preprint arXiv:2509.06147},
  year   = {2025}
}

Comments

Due to the 1,920-character limit imposed on the abstract field, the abstract presented here is a truncated version of the full abstract provided in the PDF. The only omitted sentence is: We also prove the additivity and consistency for GAA procedures

R2 v1 2026-07-01T05:25:17.729Z