English

Locally minimax optimal confidence sets for the best model

Statistics Theory 2025-09-23 v4 Methodology Machine Learning Statistics Theory

Abstract

This paper tackles a fundamental inference problem: given nn observations from a distribution PP over Rd\mathbb{R}^d with unknown mean μ\boldsymbol{\mu}, we must form a confidence set for the index (or indices) corresponding to the smallest component of μ\boldsymbol{\mu}. By duality, we reduce this to testing, for each rr in 1,,d1,\ldots,d, whether μr\mu_r is the smallest. Based on the sample splitting and self-normalization approach of Kim and Ramdas (2024), we propose "dimension-agnostic" tests that maintain validity regardless of how dd scales with nn, and regardless of arbitrary ties in μ\boldsymbol{\mu}. Notably, our validity holds under mild moment conditions, requiring little more than finiteness of a second moment, and permitting possibly strong dependence between coordinates. In addition, we establish the \emph{local} minimax separation rate for this problem, which adapts to the cardinality of a confusion set, and show that the proposed tests attain this rate. Furthermore, we develop robust variants that continue to achieve the same minimax rate under heavy-tailed distributions with only finite second moments. While these results highlight the theoretical strength of our method, a practical concern is that sample splitting can reduce finite-sample power. We show that this drawback can be substantially alleviated by the multi-split aggregation method of Guo and Shah (2025). Finally, empirical results on simulated and real data illustrate the strong performance of our approach in terms of type I error control and power compared to existing methods.

Keywords

Cite

@article{arxiv.2503.21639,
  title  = {Locally minimax optimal confidence sets for the best model},
  author = {Ilmun Kim and Aaditya Ramdas},
  journal= {arXiv preprint arXiv:2503.21639},
  year   = {2025}
}