English
Related papers

Related papers: ECKO: Ensemble of Clustered Knockoffs for multivar…

200 papers

Voxel-based multiple testing is widely used in neuroimaging data analysis. Traditional false discovery rate (FDR) control methods often ignore the spatial dependence among the voxel-based tests and thus suffer from substantial loss of…

Machine Learning · Statistics 2024-05-06 Taehyo Kim , Hai Shu , Qiran Jia , Mony J. de Leon

Testing composite null hypotheses arises in various applications, such as mediation and replicability analyses. The problem becomes more challenging in high-throughput experiments where tens of thousands of features are examined…

Methodology · Statistics 2025-04-29 Pengfei Lyu , Xianyang Zhang , Hongyuan Cao

We consider the variable selection problem, which seeks to identify important variables influencing a response $Y$ out of many candidate features $X_1, \ldots, X_p$. We wish to do so while offering finite-sample guarantees about the…

Methodology · Statistics 2019-02-12 Rina Foygel Barber , Emmanuel J. Candès , Richard J. Samworth

Many contemporary large-scale applications involve building interpretable models linking a large set of potential covariates to a response in a nonlinear fashion, such as when the response is binary. Although this modeling problem has been…

Methodology · Statistics 2017-12-13 Emmanuel Candes , Yingying Fan , Lucas Janson , Jinchi Lv

We investigate the robustness of the model-X knockoffs framework with respect to the misspecified or estimated feature distribution. We achieve such a goal by theoretically studying the feature selection performance of a practically…

Methodology · Statistics 2024-06-06 Yingying Fan , Lan Gao , Jinchi Lv

Deep learning has become increasingly popular in both supervised and unsupervised machine learning thanks to its outstanding empirical performance. However, because of their intrinsic complexity, most deep learning methods are largely…

Machine Learning · Computer Science 2018-09-07 Yang Young Lu , Yingying Fan , Jinchi Lv , William Stafford Noble

Stability and reproducibility are essential considerations in various applications of statistical methods. False Discovery Rate (FDR) control methods are able to control false signals in scientific discoveries. However, many FDR control…

Methodology · Statistics 2025-12-22 Jiajun Sun , Zhanrui Cai , Wei Zhong

In many scientific fields, researchers are interested in discovering features with substantial effect on the response from a large number of features while controlling the proportion of false discoveries. By incorporating the knockoff…

Methodology · Statistics 2023-02-28 Jiaqi Gu , Guosheng Yin

Identifying important features linked to a response variable is a fundamental task in various scientific domains. This article explores statistical inference for simulated Markov random fields in high-dimensional settings. We introduce a…

Machine Learning · Statistics 2024-01-23 Haoyu Wei , Xiaoyu Lei , Yixin Han , Huiming Zhang

In this paper, a noisy version of the stochastic block model (NSBM) is introduced and we investigate the three following statistical inferences in this model: estimation of the model parameters, clustering of the nodes and identification of…

Statistics Theory · Mathematics 2019-07-25 Tabea Rebafka , Etienne Roquain , Fanny Villers

Knockoff variable selection is a powerful framework that creates synthetic knockoff variables to mirror the correlation structure of the observed features, enabling principled control of the false discovery rate in variable selection.…

Methodology · Statistics 2025-08-21 Evan Mason , Zhe Fei

Large-scale hypothesis testing is central to modern science, where controlling the False Discovery Rate (FDR) has become the standard approach to managing false positives across many simultaneous tests. Hypotheses rarely exist in isolation;…

Methodology · Statistics 2026-05-19 Binyamin Perets , Shie Mannor

Although sparse autoencoders (SAEs) are crucial for identifying interpretable features in neural networks, it is still challenging to distinguish between real computational patterns and erroneous correlations. We introduce Model-X knockoffs…

Machine Learning · Computer Science 2025-11-18 Tsogt-Ochir Enkhbayar

Recently, Barber and Cand\`es laid the theoretical foundation for a general framework for false discovery rate (FDR) control based on the notion of "knockoffs." A closely related FDR control methodology has long been employed in the…

Methodology · Statistics 2022-03-15 Dong Luo , Arya Ebadi , Yilun He , Kristen Emery , William Stafford Noble , Uri Keich

We propose one-at-a-time knockoffs (OATK), a new methodology for detecting important explanatory variables in linear regression models while controlling the false discovery rate (FDR). For each explanatory variable, OATK generates a…

Methodology · Statistics 2025-02-27 Charlie K. Guan , Zhimei Ren , Daniel W. Apley

We describe a series of algorithms that efficiently implement Gaussian model-X knockoffs to control the false discovery rate on large scale feature selection problems. Identifying the knockoff distribution requires solving a large scale…

Machine Learning · Computer Science 2020-06-17 Armin Askari , Quentin Rebjock , Alexandre d'Aspremont , Laurent El Ghaoui

Deep neural networks have amply demonstrated their prowess but estimating the reliability of their predictions remains challenging. Deep Ensembles are widely considered as being one of the best methods for generating uncertainty estimates…

Machine Learning · Computer Science 2021-06-28 Nikita Durasov , Timur Bagautdinov , Pierre Baque , Pascal Fua

The goal of feature selection is to identify important features that are relevant to explain an outcome variable. Most of the work in this domain has focused on identifying globally relevant features, which are features that are related to…

Machine Learning · Statistics 2019-05-30 Jaime Roquero Gimenez , James Zou

The knockoff filter of Barber and Candes (arXiv:1404.5609) is a flexible framework for multiple testing in supervised learning models, based on introducing synthetic predictor variables to control the false discovery rate (FDR). Using the…

Methodology · Statistics 2024-11-26 Yixiang Luo , William Fithian , Lihua Lei

Controlled feature selection aims to discover the features a response depends on while limiting the false discovery rate (FDR) to a predefined level. Recently, multiple deep-learning-based methods have been proposed to perform controlled…

Machine Learning · Statistics 2022-10-24 Derek Hansen , Brian Manzo , Jeffrey Regier