English
Related papers

Related papers: Optimal False Discovery Rate Control for Large Sca…

200 papers

In the problem of composite hypothesis testing, identifying the potential uniformly most powerful (UMP) unbiased test is of great interest. Beyond typical hypothesis settings with exponential family, it is usually challenging to prove the…

Methodology · Statistics 2022-08-03 Tianyu Zhan , Jian Kang

The large bulk of work in multiple testing has focused on specifying procedures that control the false discovery rate (FDR), with relatively less attention being paid to the corresponding Type II error known as the false non-discovery rate…

Statistics Theory · Mathematics 2020-05-11 Max Rabinovich , Michael I. Jordan , Martin J. Wainwright

Computational capability often falls short when confronted with massive data, posing a common challenge in establishing a statistical model or statistical inference method dealing with big data. While subsampling techniques have been…

Methodology · Statistics 2024-10-31 Yixiao Ruan , Zan Li , Zhaohui Li , Dennis K. J. Lin , Qingpei Hu , Dan Yu

The false discovery proportion (FDP) is a convenient way to account for false positives when a large number $m$ of tests are performed simultaneously. Romano and Wolf [Ann. Statist. 35 (2007) 1378-1408] have proposed a general principle…

Statistics Theory · Mathematics 2015-06-08 Sylvain Delattre , Etienne Roquain

The expectation-maximization (EM) algorithm and its variants are widely used in statistics. In high-dimensional mixture linear regression, the model is assumed to be a finite mixture of linear regression and the number of predictors is much…

Statistics Theory · Mathematics 2023-07-24 Ning Wang , Xin Zhang , Qing Mai

We consider statistical hypothesis testing simultaneously over a fairly general, possibly uncountably infinite, set of null hypotheses, under the assumption that a suitable single test (and corresponding $p$-value) is known for each…

Methodology · Statistics 2014-02-10 Gilles Blanchard , Sylvain Delattre , Etienne Roquain

Selective prediction, where a model has the option to abstain from making a decision, is crucial for machine learning applications in which mistakes are costly. In this work, we focus on distributional regression and introduce a framework…

Statistics Theory · Mathematics 2025-04-01 Ahmed Zaoui , Clément Dombry

Modern data analysis frequently involves large-scale hypothesis testing, which naturally gives rise to the problem of maintaining control of a suitable type I error rate, such as the false discovery rate (FDR). In many biomedical and…

Methodology · Statistics 2023-07-25 David S. Robertson , James M. S. Wason , Aaditya Ramdas

In this paper we propose a computationally efficient multiple hypothesis testing procedure for persistent homology. The computational efficiency of our procedure is based on the observation that one can empirically simulate a null…

Computational Geometry · Computer Science 2022-08-29 Mikael Vejdemo-Johansson , Sayan Mukherjee

This paper addresses patient heterogeneity associated with prediction problems in biomedical applications. We propose a systematic hypothesis testing approach to determine the existence of patient subgroup structure and the number of…

Methodology · Statistics 2021-01-08 Xu Gao , Weining Shen , Jing Ning , Ziding Feng , Jianhua Hu

In this work we consider a problem of multi-label classification, where each instance is associated with some binary vector. Our focus is to find a classifier which minimizes false negative discoveries under constraints. Depending on the…

Statistics Theory · Mathematics 2019-03-29 Evgenii Chzhen

To avoid specification of the error distribution in a regression model, we propose a general nonparametric scale mixture model for the error distribution. For fitting such mixtures, the predictive recursion method is a simple and…

Methodology · Statistics 2015-09-03 Ryan Martin , Zhen Han

We consider the problem of identifying whether findings replicate from one study of high dimension to another, when the primary study guides the selection of hypotheses to be examined in the follow-up study as well as when there is no…

Methodology · Statistics 2014-01-28 Marina Bogomolov , Ruth Heller

A systematic multiple hypothesis testing approach is applied to the search for astrophysical sources of high energy neutrinos. The method is based on the maximisation of the detection power maintaining the control of the confidence level of…

Instrumentation and Methods for Astrophysics · Physics 2010-11-24 Bruny Baret , Mathieu Labare , Daniel Bertrand

In many practical applications of multiple hypothesis testing using the False Discovery Rate (FDR), the given hypotheses can be naturally partitioned into groups, and one may not only want to control the number of false discoveries (wrongly…

Methodology · Statistics 2016-11-01 Rina Foygel Barber , Aaditya Ramdas

Modern scientific technology has provided a new class of large-scale simultaneous inference problems, with thousands of hypothesis tests to consider at the same time. Microarrays epitomize this type of technology, but similar situations…

Statistics Theory · Mathematics 2007-11-06 Bradley Efron

Closed testing procedures are classically used for familywise error rate (FWER) control, but they can also be used to obtain simultaneous confidence bounds for the false discovery proportion (FDP) in all subsets of the hypotheses. In this…

Methodology · Statistics 2019-11-15 Jelle Goeman , Rosa Meijer , Thijmen Krebs , Aldo Solari

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

How to weigh the Benjamini-Hochberg procedure? In the context of multiple hypothesis testing, we propose a new step-wise procedure that controls the false discovery rate (FDR) and we prove it to be more powerful than any weighted…

Statistics Theory · Mathematics 2009-07-13 Etienne Roquain , Mark Van De Wiel

Controlling the false discovery rate (FDR) is a critical challenge in large-scale data analysis, particularly in the presence of outliers. A common practice involves imposing a Student-$t$ distribution to eliminate the influence of…

Methodology · Statistics 2026-04-01 Yoshiko Hayashi