English
Related papers

Related papers: Multiple testing with anytime-valid Monte Carlo p-…

200 papers

When the target parameter for inference is a real-valued, continuous function of probabilities in the $k$-sample multinomial problem, variance estimation may be challenging. In small samples or when the function is nondifferentiable at the…

Computation · Statistics 2025-05-13 Michael C Sachs , Erin E Gabriel , Michael P Fay

We develop a technique to improve the power of any e-value by a simple randomization involving one independent uniform random variable. Using this framework, we show that two procedures for false discovery rate (FDR) control -- the…

Methodology · Statistics 2025-12-15 Ziyu Xu , Aaditya Ramdas

In online multiple testing, the hypotheses arrive one by one, and at each time we must immediately reject or accept the current hypothesis solely based on the data and hypotheses observed so far. Many online procedures have been proposed,…

Methodology · Statistics 2026-02-27 Lasse Fischer , Ziyu Xu , Aaditya Ramdas

We consider the problem of multiple hypothesis testing with generic side information: for each hypothesis $H_i$ we observe both a p-value $p_i$ and some predictor $x_i$ encoding contextual information about the hypothesis. For large-scale…

Methodology · Statistics 2018-07-26 Lihua Lei , William Fithian

In the setting of multiple testing, compound p-values generalize p-values by asking for superuniformity to hold only \emph{on average} across all true nulls. We study the properties of the Benjamini--Hochberg procedure applied to compound…

Statistics Theory · Mathematics 2025-07-30 Rina Foygel Barber , Richard J Samworth

To find interesting items in genome-wide association studies or next generation sequencing data, a crucial point is to design powerful false discovery rate (FDR) controlling procedures that suitably combine discrete tests (typically…

Statistics Theory · Mathematics 2017-09-18 Sebastian Döhler , Guillermo Durand , Etienne Roquain

We consider large-scale studies in which thousands of significance tests are performed simultaneously. In some of these studies, the multiple testing procedure can be severely biased by latent confounding factors such as batch effects and…

Methodology · Statistics 2016-06-21 Jingshu Wang , Qingyuan Zhao , Trevor Hastie , Art B. Owen

In multiple testing problems, where a large number of hypotheses are tested simultaneously, false discovery rate (FDR) control can be achieved with the well-known Benjamini-Hochberg procedure, which adapts to the amount of signal present in…

Methodology · Statistics 2017-09-14 Ang Li , Rina Foygel Barber

Classical and more recent tests for detecting distributional changes in multivariate time series often lack power against alternatives that involve changes in the cross-sectional dependence structure. To be able to detect such changes…

Statistics Theory · Mathematics 2014-09-16 Axel Bücher , Ivan Kojadinovic , Tom Rohmer , Johan Segers

In a Monte-Carlo test, the observed dataset is fixed, and several resampled or permuted versions of the dataset are generated in order to test a null hypothesis that the original dataset is exchangeable with the resampled/permuted ones.…

Methodology · Statistics 2025-05-05 Lasse Fischer , Aaditya Ramdas

In covariate-adaptive or response-adaptive randomization, the treatment assignment and outcome can be correlated. Under this situation, re-randomization tests are a straightforward and attractive method to provide valid statistical…

Methodology · Statistics 2023-03-14 Yilong Zhang , Yujie Zhao , Yiwen Luo

In the spirit of modeling inference for microarrays as multiple testing for sparse mixtures, we present a similar approach to a simplified version of quantitative trait loci (QTL) mapping. Unlike in case of microarrays, where the number of…

Statistics Theory · Mathematics 2008-12-18 Małgorzata Bogdan , Jayanta K. Ghosh , Surya T. Tokdar

Many multiple testing procedures make use of the p-values from the individual pairs of hypothesis tests, and are valid if the p-value statistics are independent and uniformly distributed under the null hypotheses. However, it has recently…

Methodology · Statistics 2011-08-25 Joshua D. Habiger , Edsel A. Pena

Adjustment of statistical significance levels for repeated analysis in group sequential trials has been understood for some time. Similarly, methods for adjustment accounting for testing multiple hypotheses are common. There is limited…

Methodology · Statistics 2023-11-28 Yujie Zhao , Qi Liu , Linda Z. Sun , Keaven M. Anderson

When permutation methods are used in practice, often a limited number of random permutations are used to decrease the computational burden. However, most theoretical literature assumes that the whole permutation group is used, and methods…

Statistics Theory · Mathematics 2018-08-20 Jesse Hemerik , Jelle Goeman

$\textbf{Motivation:}$ Small $p$-values are often required to be accurately estimated in large-scale genomic studies for the adjustment of multiple hypothesis tests and the ranking of genomic features based on their statistical…

Applications · Statistics 2023-08-29 Yang Shi , Mengqiao Wang , Weiping Shi , Ji-Hyun Lee , Huining Kang , Hui Jiang

Multiple testing literature contains ample research on controlling false discoveries for hypotheses classified according to one criterion, which we refer to as one-way classified hypotheses. Although simultaneous classification of…

Methodology · Statistics 2019-03-12 Shinjini Nandi , Sanat K. Sarkar

We present a novel necessary and sufficient principle for multiple testing methods controlling an expected loss. This principle asserts that every such multiple testing method is a special case of a general closed testing procedure based on…

Methodology · Statistics 2026-01-05 Ziyu Xu , Aldo Solari , Lasse Fischer , Rianne de Heide , Aaditya Ramdas , Jelle Goeman

Many modern applications require using data to select the statistical tasks and make valid inference after selection. In this article, we provide a unifying approach to control for a class of selective risks. Our method is motivated by a…

Methodology · Statistics 2024-11-11 Zijun Gao , Wenjie Hu , Qingyuan Zhao

Simple Monte Carlo is a versatile computational method with a convergence rate of $O(n^{-1/2})$. It can be used to estimate the means of random variables whose distributions are unknown. Bernoulli random variables, $Y$, are widely used to…

Numerical Analysis · Mathematics 2014-11-06 Lan Jiang , Fred J. Hickernell