English
Related papers

Related papers: Controlling false discovery exceedance for heterog…

200 papers

In many practical applications of multiple hypothesis testing using the False Discovery Rate (FDR), the given hypotheses can be naturally partitioned into groups, and one may not only want to control the number of false discoveries (wrongly…

Methodology · Statistics 2016-11-01 Rina Foygel Barber , Aaditya Ramdas

Multiple testing problems arising in modern scientific applications can involve simultaneously testing thousands or even millions of hypotheses, with relatively few true signals. In this paper, we consider the multiple testing problem where…

Methodology · Statistics 2016-06-28 Ang Li , Rina Foygel Barber

Multiple comparison procedures that control a family-wise error rate or false discovery rate provide an achieved error rate as the adjusted p-value for each hypothesis tested. However, since such p-values are not probabilities that the null…

Methodology · Statistics 2013-09-03 David R. Bickel

The effective utilization of structural information in data while ensuring statistical validity poses a significant challenge in false discovery rate (FDR) analyses. Conformal inference provides rigorous theory for grounding complex machine…

Methodology · Statistics 2024-06-18 Zinan Zhao , Wenguang Sun

This paper continues the line of research initiated in Liu et. al. (2016) on developing a novel framework for multiple testing of hypotheses grouped in a one-way classified form using hypothesis-specific local false discovery rates…

Methodology · Statistics 2022-11-22 Sanat K. Sarkar , Zhigen Zhao

In many applications of multiple hypothesis testing where more than one false rejection can be tolerated, procedures controlling error rates measuring at least $k$ false rejections, instead of at least one, for some fixed $k\ge 1$ can…

Statistics Theory · Mathematics 2008-12-18 Sanat K. Sarkar

Simultaneously performing variable selection and inference in high-dimensional models is an open challenge in statistics and machine learning. The increasing availability of vast amounts of variables requires the adoption of specific…

Methodology · Statistics 2025-10-02 Marco Molinari , Magne Thoresen

The present paper establishes new multiple procedures for simultaneous testing of a large number of hypotheses under dependence. Special attention is devoted to experiments with rare false hypotheses. This sparsity assumption is typically…

Statistics Theory · Mathematics 2019-10-01 Marc Ditzhaus , Arnold Janssen

The local false discovery rate (lfdr) of Efron et al. (2001) enjoys major conceptual and decision-theoretic advantages over the false discovery rate (FDR) as an error criterion in multiple testing, but is only well-defined in Bayesian…

Statistics Theory · Mathematics 2025-02-25 Daniel Xiang , Jake A. Soloff , William Fithian

Some effort has been undertaken over the last decade to provide conditions for the control of the false discovery rate by the linear step-up procedure (LSU) for testing $n$ hypotheses when test statistics are dependent. In this paper we…

Statistics Theory · Mathematics 2007-10-18 Helmut Finner , Thorsten Dickhaus , Markus Roters

In many fields of science, we observe a response variable together with a large number of potential explanatory variables, and would like to be able to discover which variables are truly associated with the response. At the same time, we…

Methodology · Statistics 2015-10-15 Rina Foygel Barber , Emmanuel J. Candès

Competition-based approach to controlling the false discovery rate (FDR) recently rose to prominence when, generalizing it to sequential hypothesis testing, Barber and Cand\`es used it as part of their knockoff-filter. Control of the FDR…

Methodology · Statistics 2023-02-24 Arya Ebadi , Dong Luo , Jack Freestone , William Stafford Noble , Uri Keich

The horseshoe prior, a widely used handy alternative to the spike-and-slab prior, has proven to be an exceptional default global-local shrinkage prior in Bayesian inference and machine learning. However, designing tests with frequentist…

Methodology · Statistics 2025-02-19 Qiaoyu Liang , Zihan Zhu , Ziang Fu , Michael Evans

We introduce a novel method for sparse regression and variable selection, which is inspired by modern ideas in multiple testing. Imagine we have observations from the linear model y = X beta + z, then we suggest estimating the regression…

Methodology · Statistics 2013-10-30 Malgorzata Bogdan , Ewout van den Berg , Weijie Su , Emmanuel Candes

We present false discovery rate smoothing, an empirical-Bayes method for exploiting spatial structure in large multiple-testing problems. FDR smoothing automatically finds spatially localized regions of significant test statistics. It then…

Methodology · Statistics 2016-11-15 Wesley Tansey , Oluwasanmi Koyejo , Russell A. Poldrack , James G. Scott

Conformal selection (CS) uses calibration data to identify test inputs whose unobserved outcomes are likely to satisfy a pre-specified minimal quality requirement, while controlling the false discovery rate (FDR). Existing methods fix the…

Machine Learning · Computer Science 2026-04-20 Meiyi Zhu , Osvaldo Simeone

This paper presents a powerful methodology for flexible full-data nonparametric novelty detection that offers distribution-free false discovery rate (FDR) control guarantees. Building on the full conformal inference framework and the…

Methodology · Statistics 2026-04-21 Junu Lee , Ilia Popov , Zhimei Ren

In this work we study an adaptive step-down procedure for testing $m$ hypotheses. It stems from the repeated use of the false discovery rate controlling the linear step-up procedure (sometimes called BH), and makes use of the critical…

Statistics Theory · Mathematics 2009-04-01 Yulia Gavrilov , Yoav Benjamini , Sanat K. Sarkar

False discovery rate (FDR) control in structured hypotheses testing is an important topic in simultaneous inference. Most existing methods that aim to utilize group structure among hypotheses either employ the groupwise mixture model or…

Methodology · Statistics 2019-08-16 Xiongzhi Chen , Sanat K. Sarkar

In applications such as clinical safety analysis, the data of the experiments usually consists of frequency counts. In the analysis of such data, researchers often face the problem of multiple testing based on discrete test statistics,…

Methodology · Statistics 2019-08-15 Yalin Zhu , Wenge Guo