English
Related papers

Related papers: A General Framework for Multiple Testing via E-val…

200 papers

In this work, we consider hypothesis testing and anomaly detection on datasets where each observation is a weighted network. Examples of such data include brain connectivity networks from fMRI flow data, or word co-occurrence counts for…

Machine Learning · Statistics 2018-09-10 Guilherme Gomes , Vinayak Rao , Jennifer Neville

In many scientific applications, hypotheses are generated and tested continuously in a stream. We develop a framework for improving online multiple testing procedures with false discovery rate (FDR) control under arbitrary dependence. Our…

Methodology · Statistics 2026-03-27 Ziyu Xu , Lasse Fischer , Aaditya Ramdas

Conformalized multiple testing offers a model-free way to control predictive uncertainty in decision-making. Existing methods typically use only part of the available data to build score functions tailored to specific settings. We propose a…

Methodology · Statistics 2026-05-22 Yuyang Huo , Xiaoyang Wu , Changliang Zou , Haojie Ren

Current statistical inference problems in areas like astronomy, genomics, and marketing routinely involve the simultaneous testing of thousands -- even millions -- of null hypotheses. For high-dimensional multivariate distributions, these…

Methodology · Statistics 2017-04-25 Weixin Cai , Nima S. Hejazi , Alan E. Hubbard

In this paper we use e-values in the context of multiple hypothesis testing assuming that the base tests produce independent, or sequential, e-values. Our simulation and empirical studies and theoretical considerations suggest that, under…

Methodology · Statistics 2024-08-14 Vladimir Vovk , Ruodu Wang

We propose sufficient conditions and computationally efficient procedures for false discovery rate control in multiple testing when the $p$-values are related by a known \emph{dependency graph} -- meaning that we assume independence of…

Methodology · Statistics 2025-07-01 Drew T. Nguyen , William Fithian

The practice of pooling several individual test statistics to form aggregate tests is common in many statistical application where individual tests may be underpowered. While selection by aggregate tests can serve to increase power, the…

Methodology · Statistics 2020-12-08 Ruth Heller , Amit Meir , Nilanjan Chatterjee

Large-scale multiple testing tasks often exhibit dependence, and leveraging the dependence between individual tests is still one challenging and important problem in statistics. With recent advances in graphical models, it is feasible to…

Methodology · Statistics 2012-10-19 Jie Liu , Chunming Zhang , Catherine McCarty , Peggy Peissig , Elizabeth Burnside , David Page

We consider large-scale studies in which thousands of significance tests are performed simultaneously. In some of these studies, the multiple testing procedure can be severely biased by latent confounding factors such as batch effects and…

Methodology · Statistics 2016-06-21 Jingshu Wang , Qingyuan Zhao , Trevor Hastie , Art B. Owen

Many modern applications require using data to select the statistical tasks and make valid inference after selection. In this article, we provide a unifying approach to control for a class of selective risks. Our method is motivated by a…

Methodology · Statistics 2024-11-11 Zijun Gao , Wenjie Hu , Qingyuan Zhao

The power of multiple testing procedures can be increased by using weighted p-values (Genovese, Roeder and Wasserman 2005). We derive the optimal weights and we show that the power is remarkably robust to misspecification of these weights.…

Statistics Theory · Mathematics 2007-06-13 Larry Wasserman , Kathryn Roeder

We explicitly define the notions of (bona fide, approximate or asymptotic) compound p-values and e-values, which have been implicitly presented and used in the recent multiple testing literature. While it is known that the e-BH procedure…

Methodology · Statistics 2025-07-24 Nikolaos Ignatiadis , Ruodu Wang , Aaditya Ramdas

In the spirit of modeling inference for microarrays as multiple testing for sparse mixtures, we present a similar approach to a simplified version of quantitative trait loci (QTL) mapping. Unlike in case of microarrays, where the number of…

Statistics Theory · Mathematics 2008-12-18 Małgorzata Bogdan , Jayanta K. Ghosh , Surya T. Tokdar

In this article, we consider the problem of simultaneous testing of hypotheses when the individual test statistics are not necessarily independent. Specifically, we consider the problem of simultaneous testing of point null hypotheses…

Statistics Theory · Mathematics 2018-07-17 Prasenjit Ghosh , Arijit Chakrabarti

A platform trial with a master protocol provides an infrastructure to ethically and efficiently evaluate multiple treatment options in multiple diseases. Given that certain study drugs can enter or exit a platform trial, the randomization…

Methodology · Statistics 2025-07-15 Tianyu Zhan , Jane Zhang , Lei Shu , Yihua Gu

High dimensional hypothesis test deals with models in which the number of parameters is significantly larger than the sample size. Existing literature develops a variety of individual tests. Some of them are sensitive to the dense and small…

Statistics Theory · Mathematics 2018-08-09 Cheng Zhou , Xinsheng Zhang , Wenxin Zhou , Han Liu

We construct a "hyperparameter matrix" statistical method for performing the joint analyses of multiple correlated astronomical data sets, in which the weights of data sets are determined by their own statistical properties. This method is…

Instrumentation and Methods for Astrophysics · Physics 2014-05-20 Yin-Zhe Ma , Aaron Berndsen

Combining dependent p-values poses a long-standing challenge in statistical inference, particularly when aggregating findings from multiple methods to enhance signal detection. Recently, p-value combination tests based on regularly…

Methodology · Statistics 2025-04-22 Lin Gui , Yuchao Jiang , Jingshu Wang

The amount of quality data in many machine learning tasks is limited to what is available locally to data owners. The set of quality data can be expanded through trading or sharing with external data agents. However, data buyers need…

Machine Learning · Statistics 2025-07-21 Martin V. Vejling , Shashi Raj Pandey , Christophe A. N. Biscio , Petar Popovski

In the setting of multiple testing, compound p-values generalize p-values by asking for superuniformity to hold only \emph{on average} across all true nulls. We study the properties of the Benjamini--Hochberg procedure applied to compound…

Statistics Theory · Mathematics 2025-07-30 Rina Foygel Barber , Richard J Samworth