English
Related papers

Related papers: Carefree multiple testing with e-processes

200 papers

Multiple hypotheses testing is a core problem in statistical inference and arises in almost every scientific field. Given a sequence of null hypotheses $\mathcal{H}(n) = (H_1,..., H_n)$, Benjamini and Hochberg…

Methodology · Statistics 2015-03-05 Adel Javanmard , Andrea Montanari

We consider a multiple hypothesis testing setting where the hypotheses are ordered and one is only permitted to reject an initial contiguous block, H_1,\dots,H_k, of hypotheses. A rejection rule in this setting amounts to a procedure for…

Statistics Theory · Mathematics 2015-03-25 Max Grazier G'Sell , Stefan Wager , Alexandra Chouldechova , Robert Tibshirani

The graph based approach to multiple testing is an intuitive method that enables a study team to represent clearly, through a directed graph, its priorities for hierarchical testing of multiple hypotheses, and for propagating the available…

Methodology · Statistics 2025-01-07 Cyrus Mehta , Ajoy Mukhopadhyay , Martin Posch

High-dimensional inference based on matrix-valued data has drawn increasing attention in modern statistical research, yet not much progress has been made in large-scale multiple testing specifically designed for analysing such data sets.…

Methodology · Statistics 2021-06-18 Xu Han , Sanat Sarkar , Shiyu Zhang

In many applications of multiple hypothesis testing where more than one false rejection can be tolerated, procedures controlling error rates measuring at least $k$ false rejections, instead of at least one, for some fixed $k\ge 1$ can…

Statistics Theory · Mathematics 2008-12-18 Sanat K. Sarkar

We consider the problem of multiple hypothesis testing with generic side information: for each hypothesis $H_i$ we observe both a p-value $p_i$ and some predictor $x_i$ encoding contextual information about the hypothesis. For large-scale…

Methodology · Statistics 2018-07-26 Lihua Lei , William Fithian

In sequential anytime-valid inference, any admissible procedure must be based on e-processes: generalizations of test martingales that quantify the accumulated evidence against a composite null hypothesis at any stopping time. This paper…

Methodology · Statistics 2026-03-17 Yo Joong Choe , Aaditya Ramdas

Multiple testing with discrete p-values routinely arises in various scientific endeavors. However, procedures, including the false discovery rate (FDR) controlling Benjamini-Hochberg (BH) procedure, often used in such settings, being…

Methodology · Statistics 2019-06-06 Xiongzhi Chen , Sanat K. Sarkar

We consider clinical trials with multiple, overlapping patient populations, that test multiple treatment policies specifically tailored to these populations. Such designs may lead to multiplicity issues, as false statements will affect…

Methodology · Statistics 2025-11-13 Remi Luschei , Werner Brannath

This paper designs methods for decentralized multiple hypothesis testing on graphs that are equipped with provable guarantees on the false discovery rate (FDR). We consider the setting where distinct agents reside on the nodes of an…

Methodology · Statistics 2025-07-08 Aaditya Ramdas , Jianbo Chen , Martin J. Wainwright , Michael I. Jordan

In this paper, we have established a general framework of multistage hypothesis tests which applies to arbitrarily many mutually exclusive and exhaustive composite hypotheses. Within the new framework, we have constructed specific…

Statistics Theory · Mathematics 2013-11-05 Xinjia Chen

We propose sequential multiple testing procedures which control the false discover rate (FDR) or the positive false discovery rate (pFDR) under arbitrary dependence between the data streams. This is accomplished by "optimizing" an upper…

Methodology · Statistics 2024-11-27 Michael Hankin , Jay Bartroff

The introduction of the false discovery rate (FDR) by Benjamini and Hochberg has spurred a great interest in developing methodologies to control the FDR in various settings. The majority of existing approaches, however, address the FDR…

Methodology · Statistics 2016-06-09 Kasra Alishahi , Ahmad Reza Ehyaei , Ali Shojaie

Machine learning applications frequently come with multiple diverse objectives and constraints that can change over time. Accordingly, trained models can be tuned with sets of hyper-parameters that affect their predictive behavior (e.g.,…

Machine Learning · Computer Science 2022-10-17 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

A classical approach for dealing with the multiple testing problem is to restrict attention to procedures that control the familywise error rate (FWER), the probability of at least one false rejection. In many applications, one might be…

Statistics Theory · Mathematics 2008-10-29 Wenge Guo , M. Bhaskara Rao

In this paper, we address the normal mean inference problem, which involves testing multiple means of normal random variables with heteroscedastic variances. Most existing empirical Bayes methods for this setting are developed under…

Methodology · Statistics 2026-01-01 Kwangok Seo , Johan Lim , Kaiwen Wang , Dohwan Park , Shota Katayama , Xinlei Wang

We consider the problem of testing positively dependent multiple hypotheses assuming that a prior information about the dependence structure is available. We propose two-step multiple comparisons procedures that exploit the prior…

We study the problem of multiple hypothesis testing (HT) in view of a rejection option. That model of HT has many different applications. Errors in testing of M hypotheses regarding the source distribution with an option of rejecting all…

Information Theory · Computer Science 2016-11-17 Naira Grigoryan , Ashot Harutyunyan , Svyatoslav Voloshynovskiy , Oleksiy Koval

Hierarchical models are versatile tools for joint modeling of data sets arising from different, but related, sources. Fully Bayesian inference may, however, become computationally prohibitive if the source-specific data models are complex,…

Computation · Statistics 2016-05-06 Ritabrata Dutta , Paul Blomstedt , Samuel Kaski

In modern scientific experiments, we frequently encounter data that have large dimensions, and in some experiments, such high dimensional data arrive sequentially rather than full data being available all at a time. We develop multiple…

Methodology · Statistics 2023-06-09 Rahul Roy , Shyamal K. De , Subir Kumar Bhandari