English
Related papers

Related papers: AdaPT: An interactive procedure for multiple testi…

200 papers

In large-scale multiple hypothesis testing problems, the false discovery exceedance (FDX) provides a desirable alternative to the widely used false discovery rate (FDR) when the false discovery proportion (FDP) is highly variable. We…

Methodology · Statistics 2023-04-21 Pallavi Basu , Luella Fu , Alessio Saretto , Wenguang Sun

How to weigh the Benjamini-Hochberg procedure? In the context of multiple hypothesis testing, we propose a new step-wise procedure that controls the false discovery rate (FDR) and we prove it to be more powerful than any weighted…

Statistics Theory · Mathematics 2009-07-13 Etienne Roquain , Mark Van De Wiel

This article presents a Conformalized Locally Adaptive Weighting (CLAW) approach to multiple testing with side information. The proposed method employs innovative data-driven strategies to construct pairwise exchangeable scores, which are…

Methodology · Statistics 2025-02-28 Zinan Zhao , Wenguang Sun

We propose sufficient conditions and computationally efficient procedures for false discovery rate control in multiple testing when the $p$-values are related by a known \emph{dependency graph} -- meaning that we assume independence of…

Methodology · Statistics 2025-07-01 Drew T. Nguyen , William Fithian

Replicability is a lynchpin for credible discoveries. The partial conjunction (PC) p-value, which combines individual base p-values from multiple similar studies, can gauge whether a feature of interest exhibits replicated signals across…

Methodology · Statistics 2025-07-29 Ninh Tran , Dennis Leung

Modern biomedical research frequently involves testing multiple related hypotheses, while maintaining control over a suitable error rate. In many applications the false discovery rate (FDR), which is the expected proportion of false…

Methodology · Statistics 2018-09-27 David S. Robertson , James M. S. Wason

We introduce adaptive learn-then-test (aLTT), an efficient hyperparameter selection procedure that provides finite-sample statistical guarantees on the population risk of AI models. Unlike the existing learn-then-test (LTT) technique, which…

Machine Learning · Statistics 2025-02-03 Matteo Zecchin , Sangwoo Park , Osvaldo Simeone

Multiple hypothesis testing with false discovery rate (FDR) control is a fundamental problem in statistical inference, with broad applications in genomics, drug screening, and outlier detection. In many such settings, researchers may have…

Methodology · Statistics 2026-02-19 Yonghoon Lee , Meshi Bashari , Edgar Dobriban , Yaniv Romano

Multiple hypothesis testing often involves composite nulls, i.e., nulls that are associated with two or more distributions. In many cases, it is reasonable to assume that there is a prior distribution on the distributions despite it is…

Statistics Theory · Mathematics 2008-07-31 Zhiyi Chi

Some effort has been undertaken over the last decade to provide conditions for the control of the false discovery rate by the linear step-up procedure (LSU) for testing $n$ hypotheses when test statistics are dependent. In this paper we…

Statistics Theory · Mathematics 2007-10-18 Helmut Finner , Thorsten Dickhaus , Markus Roters

Model-free reinforcement learning algorithms combined with value function approximation have recently achieved impressive performance in a variety of application domains. However, the theoretical understanding of such algorithms is limited,…

Machine Learning · Computer Science 2021-02-12 Botao Hao , Nevena Lazic , Yasin Abbasi-Yadkori , Pooria Joulani , Csaba Szepesvari

As the volume and complexity of data continue to expand across various scientific disciplines, the need for robust methods to account for the multiplicity of comparisons has grown widespread. A popular measure of type 1 error rate in…

Methodology · Statistics 2024-11-19 Jianliang He , Bowen Gang , Luella Fu

Online testing procedures aim to control the extent of false discoveries over a sequence of hypothesis tests, allowing for the possibility that early-stage test results influence the choice of hypotheses to be tested in later stages.…

Methodology · Statistics 2021-10-18 Aaron Fisher

Sum-based global tests are highly popular in multiple hypothesis testing. In this paper we propose a general closed testing procedure for sum tests, which provides lower confidence bounds for the proportion of true discoveries (TDP),…

Methodology · Statistics 2023-04-21 Anna Vesely , Livio Finos , Jelle J. Goeman

Multiple hypothesis testing has been widely applied to problems dealing with high-dimensional data, e.g., selecting significant variables and controlling the selection error rate. The most prevailing measure of error rate used in the…

Methodology · Statistics 2022-06-07 Xiaoya Sun , Yan Fu

The integration of AI into modern critical infrastructure systems, such as healthcare, has introduced new vulnerabilities that can significantly impact workflow, efficiency, and safety. Additionally, the increased connectivity has made…

Cryptography and Security · Computer Science 2024-11-04 Haozhe Lei , Yunfei Ge , Quanyan Zhu

Scientific hypotheses in a variety of applications have domain-specific structures, such as the tree structure of the International Classification of Diseases (ICD), the directed acyclic graph structure of the Gene Ontology (GO), or the…

Methodology · Statistics 2020-04-14 Eugene Katsevich , Chiara Sabatti , Marina Bogomolov

We address the multiple testing problem under the assumption that the true/false hypotheses are driven by a Hidden Markov Model (HMM), which is recognized as a fundamental setting to model multiple testing under dependence since the seminal…

Methodology · Statistics 2021-05-04 Marie Perrot-Dockès , Gilles Blanchard , Pierre Neuvial , Etienne Roquain

Effective decision making from randomised controlled clinical trials relies on robust interpretation of the numerical results. However, the language we use to describe clinical trials can cause confusion both in trial design and in…

In multiple testing problems, where a large number of hypotheses are tested simultaneously, false discovery rate (FDR) control can be achieved with the well-known Benjamini-Hochberg procedure, which adapts to the amount of signal present in…

Methodology · Statistics 2017-09-14 Ang Li , Rina Foygel Barber