English
Related papers

Related papers: Estimation of False Discovery Proportion with Unkn…

200 papers

We develop a flexible feature selection framework based on deep neural networks that approximately controls the false discovery rate (FDR), a measure of Type-I error. The method applies to architectures whose first layer is fully connected.…

Machine Learning · Statistics 2026-02-10 Kazuma Sawaya

Parameter inference with an estimated covariance matrix systematically loses information due to the remaining uncertainty of the covariance matrix. Here, we quantify this loss of precision and develop a framework to hypothetically restore…

Cosmology and Nongalactic Astrophysics · Physics 2017-03-16 Elena Sellentin , Alan F. Heavens

We present a novel necessary and sufficient principle for False Discovery Rate (FDR) control. This e-Partitioning Principle says that a procedure controls FDR if and only if it is a special case of a general e-Partitioning procedure. By…

Statistics Theory · Mathematics 2025-09-15 Jelle Goeman , Rianne de Heide , Aldo Solari

Variable selection has been widely used in data analysis for the past decades, and it becomes increasingly important in the Big Data era as there are usually hundreds of variables available in a dataset. To enhance interpretability of a…

Methodology · Statistics 2020-08-17 Yuxiang Xie , Kwun Chuen Gary Chan

Estimating a covariance matrix is central to high-dimensional data analysis. Empirical analyses of high-dimensional biomedical data, including genomics, proteomics, microbiome, and neuroimaging, among others, consistently reveal strong…

Methodology · Statistics 2024-12-05 Yifan Yang , Chixiang Chen , Shuo Chen

This paper develops a general framework for controlling the false discovery rate (FDR) in multiple testing of Gaussian means against two-sided alternatives. The widely used Benjamini-Hochberg (BH) procedure provides exact FDR control under…

Methodology · Statistics 2025-11-26 Deepra Ghosh , Sanat K. Sarkar

Motivated by the gene co-expression pattern analysis, we propose a novel sample quantile-based contingency (squac) statistic to infer quantile associations conditioning on covariates. It features enhanced flexibility in handling variables…

Methodology · Statistics 2018-08-27 Jichun Xie , Ruosha Li

This paper is concerned with false discovery rate (FDR) control in large-scale multiple testing problems. We first propose a new data-driven testing procedure for controlling the FDR in large-scale t-tests for one-sample mean problem. The…

Statistics Theory · Mathematics 2020-03-02 Changliang Zou , Haojie Ren , Xu Guo , Runze Li

Testing for change points in sequences of covariance matrices is an important and equally challenging problem in statistical methodology with applications in various fields. Motivated by the observation that even in cases where the ratio…

Statistics Theory · Mathematics 2026-01-14 Nina Dörnemann , Holger Dette

Causal discovery is crucial for causal inference in observational studies, as it can enable the identification of valid adjustment sets (VAS) for unbiased effect estimation. However, global causal discovery is notoriously hard in the…

Machine Learning · Statistics 2024-06-04 Jacqueline Maasch , Weishen Pan , Shantanu Gupta , Volodymyr Kuleshov , Kyra Gan , Fei Wang

In practical applications of machine learning, it is necessary to look beyond standard metrics such as test accuracy in order to validate various qualitative properties of a model. Partial dependence plots (PDP), including instance-specific…

Machine Learning · Computer Science 2020-07-31 David I. Inouye , Liu Leqi , Joon Sik Kim , Bryon Aragam , Pradeep Ravikumar

Given a database and a target attribute of interest, how can we tell whether there exists a functional, or approximately functional dependence of the target on any set of other attributes in the data? How can we reliably, without bias to…

Databases · Computer Science 2017-06-20 Panagiotis Mandros , Mario Boley , Jilles Vreeken

The estimation of an f-divergence between two probability distributions based on samples is a fundamental problem in statistics and machine learning. Most works study this problem under very weak assumptions, in which case it is provably…

Machine Learning · Statistics 2019-10-25 Paul K. Rubenstein , Olivier Bousquet , Josip Djolonga , Carlos Riquelme , Ilya Tolstikhin

Distance-based regression model, as a nonparametric multivariate method, has been widely used to detect the association between variations in a distance or dissimilarity matrix for outcomes and predictor variables of interest in genetic…

Statistics Theory · Mathematics 2022-03-14 Yuke Shi , Wei Zhang , Aiyi Liu , Qizhai Li

A method is demonstrated for representing the false discovery rate (FDR) in a set of p-values on a quantile-quantile (Q-Q) plot of the p-values. Recognition of this connection between the FDR and the Q-Q plot facilitates both understanding…

Methodology · Statistics 2021-09-07 N. W. Galwey

By restricting the possible values of the proportion of null hypotheses that are true, the local false discovery rate (LFDR) can be estimated using as few as one comparison. The proportion of proteins with equivalent abundance was estimated…

Methodology · Statistics 2011-05-13 David R. Bickel

Measuring a strength of dependence of random variables is an important problem in statistical practice. In this paper, we propose a new function valued measure of dependence of two random variables. It allows one to study and visualize…

Methodology · Statistics 2014-05-12 Teresa Ledwina

The False Discovery Rate (FDR) is a commonly used type I error rate in multiple testing problems. It is defined as the expected False Discovery Proportion (FDP), that is, the expected fraction of false positives among rejected hypotheses.…

Statistics Theory · Mathematics 2013-10-04 Pierre Neuvial

Conformal prediction is emerging as a popular paradigm for providing rigorous uncertainty quantification in machine learning since it can be easily applied as a post-processing step to already trained models. In this paper, we extend…

Machine Learning · Computer Science 2023-06-02 Charles Lu , Yaodong Yu , Sai Praneeth Karimireddy , Michael I. Jordan , Ramesh Raskar

Motivation: Accurate estimation of false discovery rate (FDR) of spectral identification is a central problem in mass spectrometry-based proteomics. Over the past two decades, target decoy approaches (TDAs) and decoy-free approaches (DFAs),…

Quantitative Methods · Quantitative Biology 2020-09-18 Yisu Peng , Shantanu Jain , Yong Fuga Li , Michal Gregus , Alexander R. Ivanov , Olga Vitek , Predrag Radivojac