English
Related papers

Related papers: Active multiple testing with proxy p-values and e-…

200 papers

A/B testing is ubiquitous within the machine learning and data science operations of internet companies. Generically, the idea is to perform a statistical test of the hypothesis that a new feature is better than the existing platform---for…

Statistics Theory · Mathematics 2017-10-11 David Goldberg , James E. Johndrow

Many statistical problems can be addressed by applying a multiple testing procedure (MTP) that controls either the Family-wise Error Rate (FWER) or False Discovery Rate (FDR) under unknown arbitrarily-interdependent $p$-values, without…

Methodology · Statistics 2026-05-21 George Karabatsos

Controlling false discovery rate (FDR) while leveraging the side information of multiple hypothesis testing is an emerging research topic in modern data science. Existing methods rely on the test-level covariates while ignoring possible…

Machine Learning · Statistics 2021-01-26 Lin Qiu , Nils Murrugarra-Llerena , Vítor Silva , Lin Lin , Vernon M. Chinchilli

A fundamental task in the analysis of datasets with many variables is screening for associations. This can be cast as a multiple testing task, where the objective is achieving high detection power while controlling type I error. We consider…

Methodology · Statistics 2021-09-01 Nikolaos Ignatiadis , Wolfgang Huber

The simultaneous analysis of many statistical tests is ubiquitous in applications. Perhaps the most popular error rate used for avoiding type one error inflation is the false discovery rate (FDR). However, most theoretical and software…

Computation · Statistics 2019-04-04 Guillermo Durand , Florian Junge , Sebastian Döhler , Etienne Roquain

In the problem of active sequential hypothesis testing (ASHT), a learner seeks to identify the true hypothesis from among a known set of hypotheses. The learner is given a set of actions and knows the random distribution of the outcome of…

Machine Learning · Computer Science 2021-10-08 Kyra Gan , Su Jia , Andrew Li

High-dimensional tests are applied to find relevant sets of variables and relevant models. If variables are selected by analyzing the sums of products matrices and a corresponding mean-value test is performed, there is the danger that the…

Methodology · Statistics 2012-02-10 Juergen Laeuter , Maciej Rosolowski , Ekkehard Glimm

We study how to combine p-values and e-values, and design multiple testing procedures where both p-values and e-values are available for every hypothesis. Our results provide a new perspective on multiple testing with data-driven weights:…

Methodology · Statistics 2023-07-19 Nikolaos Ignatiadis , Ruodu Wang , Aaditya Ramdas

We consider the problem where an active Decision-Maker (DM) is tasked to identify the true hypothesis using as few as possible observations while maintaining accuracy. The DM collects observations according to its determined actions and…

Information Theory · Computer Science 2025-04-29 George Vershinin , Asaf Cohen , Omer Gurewitz

We study the problem of identifying the set of \emph{active} variables, termed in the literature as \emph{variable selection} or \emph{multiple hypothesis testing}, depending on the pursued criteria. For a general \emph{robust setting} of…

Statistics Theory · Mathematics 2021-09-24 Eduard Belitser , Nurzhan Nurushev

The standard paired-sample testing approach in the multidimensional setting applies multiple univariate tests on the individual features, followed by p-value adjustments. Such an approach suffers when the data carry numerous features. A…

Machine Learning · Statistics 2023-09-29 Ioannis Bargiotas , Argyris Kalogeratos , Nicolas Vayatis

We consider multiple testing with false discovery rate (FDR) control when p-values have discrete and heterogeneous null distributions. We propose a new estimator of the proportion of true null hypotheses and demonstrate that it is less…

Methodology · Statistics 2018-03-15 Xiongzhi Chen , Rebecca W. Doerge , Joseph F. Heyse

We address the multiple testing problem under the assumption that the true/false hypotheses are driven by a Hidden Markov Model (HMM), which is recognized as a fundamental setting to model multiple testing under dependence since the seminal…

Methodology · Statistics 2021-05-04 Marie Perrot-Dockès , Gilles Blanchard , Pierre Neuvial , Etienne Roquain

Modern intelligent systems researchers form hypotheses about system behavior and then run experiments using one or more independent variables to test their hypotheses. We present SIERRA, a novel framework structured around that idea for…

Artificial Intelligence · Computer Science 2022-08-17 John Harwell , Maria Gini

Online controlled experiments (A/B tests) are fundamental to data-driven decision-making in the digital economy. However, their real-world application is frequently compromised by two critical shortcomings: the use of statistically flawed…

Applications · Statistics 2025-09-30 Srijesh Pillai , Rajesh Kumar Chandrawat

As the volume and complexity of data continue to expand across various scientific disciplines, the need for robust methods to account for the multiplicity of comparisons has grown widespread. A popular measure of type 1 error rate in…

Methodology · Statistics 2024-11-19 Jianliang He , Bowen Gang , Luella Fu

Evaluating fairness can be challenging in practice because the sensitive attributes of data are often inaccessible due to privacy constraints. The go-to approach that the industry frequently adopts is using off-the-shelf proxy models to…

Machine Learning · Computer Science 2023-02-01 Zhaowei Zhu , Yuanshun Yao , Jiankai Sun , Hang Li , Yang Liu

Multiple testing problems arising in modern scientific applications can involve simultaneously testing thousands or even millions of hypotheses, with relatively few true signals. In this paper, we consider the multiple testing problem where…

Methodology · Statistics 2016-06-28 Ang Li , Rina Foygel Barber

Two-sample hypothesis testing for network comparison presents many significant challenges, including: leveraging repeated network observations and known node registration, but without requiring them to operate; relaxing strong structural…

Methodology · Statistics 2024-02-05 Meijia Shao , Dong Xia , Yuan Zhang , Qiong Wu , Shuo Chen

While data-driven confounder selection requires careful consideration, it is frequently employed in observational studies. Widely recognized criteria for confounder selection include the minimal-set approach, which involves selecting…

Methodology · Statistics 2025-08-21 Kazuharu Harada , Masataka Taguri