English

Multiple Testing in Generalized Universal Inference

Methodology 2024-12-03 v1

Abstract

Compared to p-values, e-values provably guarantee safe, valid inference. If the goal is to test multiple hypotheses simultaneously, one can construct e-values for each individual test and then use the recently developed e-BH procedure to properly correct for multiplicity. Standard e-value constructions, however, require distributional assumptions that may not be justifiable. This paper demonstrates that the generalized universal inference framework can be used along with the e-BH procedure to control frequentist error rates in multiple testing when the quantities of interest are minimizers of risk functions, thereby avoiding the need for distributional assumptions. We demonstrate the validity and power of this approach via a simulation study, testing the significance of a predictor in quantile regression.

Keywords

Cite

@article{arxiv.2412.01008,
  title  = {Multiple Testing in Generalized Universal Inference},
  author = {Neil Dey and Ryan Martin and Jonathan P. Williams},
  journal= {arXiv preprint arXiv:2412.01008},
  year   = {2024}
}

Comments

10 pages, 3 figures