English
Related papers

Related papers: Online multiple testing with e-values

200 papers

The proliferation of deceptive content online necessitates robust Fake News Detection (FND) systems. While evidence-based approaches leverage external knowledge to verify claims, existing methods face critical limitations: noisy evidence…

Computation and Language · Computer Science 2025-06-16 Yuzhou Yang , Yangming Zhou , Zhiying Zhu , Zhenxing Qian , Xinpeng Zhang , Sheng Li

AI-Scientist systems that use large language models to automate research risk generating spurious discoveries through uncontrolled multiple testing. We present a functional architecture that enforces statistical rigor at two levels: a…

Software Engineering · Computer Science 2026-02-09 Karen Sargsyan

This paper is a review of the popular Benjamini Hochberg Method and other related useful methods of Multiple Hypothesis testing. This is written with the purpose of serving a short but complete easy to understand review of the main article…

Methodology · Statistics 2014-06-30 Anish Acharya

Differential privacy provides a rigorous framework for privacy-preserving data analysis. This paper proposes the first differentially private procedure for controlling the false discovery rate (FDR) in multiple hypothesis testing. Inspired…

Statistics Theory · Mathematics 2021-07-06 Cynthia Dwork , Weijie J. Su , Li Zhang

This paper revisits the following open question in simultaneous testing of multivariate normal means against two-sided alternatives: Can the method of Benjamini and Hochberg (BH, 1995) control the false discovery rate (FDR) without imposing…

Statistics Theory · Mathematics 2023-04-12 Sanat K. Sarkar

Results on the false discovery rate (FDR) and the false nondiscovery rate (FNR) are developed for single-step multiple testing procedures. In addition to verifying desirable properties of FDR and FNR as measures of error rates, these…

Statistics Theory · Mathematics 2007-06-13 Sanat K. Sarkar

The problem of selecting a handful of truly relevant variables in supervised machine learning algorithms is a challenging problem in terms of untestable assumptions that must hold and unavailability of theoretical assurances that selection…

Methodology · Statistics 2023-11-10 Mehdi Rostami , Olli Saarela

The present paper establishes new multiple procedures for simultaneous testing of a large number of hypotheses under dependence. Special attention is devoted to experiments with rare false hypotheses. This sparsity assumption is typically…

Statistics Theory · Mathematics 2019-10-01 Marc Ditzhaus , Arnold Janssen

In modern scientific experiments, we frequently encounter data that have large dimensions, and in some experiments, such high dimensional data arrive sequentially rather than full data being available all at a time. We develop multiple…

Methodology · Statistics 2023-06-09 Rahul Roy , Shyamal K. De , Subir Kumar Bhandari

We introduce a new class of methods for finite-sample false discovery rate (FDR) control in multiple testing problems with dependent test statistics where the dependence is fully or partially known. Our approach separately calibrates a…

Methodology · Statistics 2020-07-22 William Fithian , Lihua Lei

Analyzing large-scale, multi-experiment studies requires scientists to test each experimental outcome for statistical significance and then assess the results as a whole. We present Black Box FDR (BB-FDR), an empirical-Bayes method for…

Machine Learning · Statistics 2018-06-11 Wesley Tansey , Yixin Wang , David M. Blei , Raul Rabadan

Platform trials evaluate multiple experimental treatments under a single master protocol, where new treatment arms are added to the trial over time. Given the multiple treatment comparisons, there is the potential for inflation of the…

Methodology · Statistics 2022-02-09 David S. Robertson , James M. S. Wason , Franz König , Martin Posch , Thomas Jaki

Simultaneously performing variable selection and inference in high-dimensional regression models is an open challenge in statistics and machine learning. The increasing availability of vast amounts of variables requires the adoption of…

Methodology · Statistics 2025-05-08 Marco Molinari , Magne Thoresen

The steep rise in availability and usage of high-throughput technologies in biology brought with it a clear need for methods to control the False Discovery Rate (FDR) in multiple tests. Benjamini and Hochberg (BH) introduced in 1995 a…

Methodology · Statistics 2011-08-11 Amit Zeisel , Or Zuk , Eytan Domany

Voxel-based multiple testing is widely used in neuroimaging data analysis. Traditional false discovery rate (FDR) control methods often ignore the spatial dependence among the voxel-based tests and thus suffer from substantial loss of…

Machine Learning · Statistics 2024-05-06 Taehyo Kim , Hai Shu , Qiran Jia , Mony J. de Leon

Valid online inference is an important problem in contemporary multiple testing research,to which various solutions have been proposed recently. It is well-known that these existing methods can suffer from a significant loss of power if the…

Methodology · Statistics 2023-01-16 Sebastian Döhler , Iqraa Meah , Etienne Roquain

In large scale multiple testing problems, a two-class empirical Bayes approach can be used to control the false discovery rate (Fdr) for the entire array of hypotheses under study. A sample splitting step is incorporated to modify that…

Computation · Statistics 2019-12-13 Paramita Chakraborty , Chong Ma , John Grego , James Lynch

We introduce an Integrative Ranking and Thresholding (IRT) framework for fusing evidence from multiple testing procedures. The key innovation is a method that transforms binary testing decisions into compound $e-$values, enabling the…

Methodology · Statistics 2025-09-04 Trambak Banerjee , Bowen Gang , Jianliang He

In many large scale multiple testing applications, the hypotheses often have a known graphical structure, such as gene ontology in gene expression data. Exploiting this graphical structure in multiple testing procedures can improve power as…

Methodology · Statistics 2018-12-04 Wenge Guo , Gavin Lynch , Joseph P. Romano

Multiple testing has been a popular topic in statistical research. Although vast works have been done, controlling the false discoveries remains a challenging task when the corresponding test statistics are dependent. Various methods have…

Statistics Theory · Mathematics 2022-07-05 Meng Mei , Tao Yu , Yuan Jiang