English
Related papers

Related papers: Derandomizing Knockoffs

200 papers

Thanks to its fine balance between model flexibility and interpretability, the nonparametric additive model has been widely used, and variable selection for this type of model has been frequently studied. However, none of the existing…

Methodology · Statistics 2022-01-10 Xiaowu Dai , Xiang Lyu , Lexin Li

In many research fields, researchers aim to identify significant associations between a set of explanatory variables and a response while controlling the FDR. The Knockoff filter has been recently proposed in the frequentist paradigm to…

Methodology · Statistics 2026-04-22 Lorenzo Focardi-Olmi , Anna Gottard , Michele Guindani , Marina Vannucci

In this article, we propose a novel strategy for conducting variable selection without prior model topology knowledge using the knockoff method with boosted tree models. Our method is inspired by the original knockoff method, where the…

Methodology · Statistics 2020-02-24 Tao Jiang , Yuanyuan Li , Alison A. Motsinger-Reif

Barber and Candes recently introduced a feature selection method called knockoff+ that controls the false discovery rate (FDR) among the selected features in the classical linear regression problem. Knockoff+ uses the competition between…

Methodology · Statistics 2019-11-25 Kristen Emery , Uri Keich

Although there is a huge literature on feature selection for the Cox model, none of the existing approaches can control the false discovery rate (FDR) unless the sample size tends to infinity. In addition, there is no formal power analysis…

Methodology · Statistics 2023-08-02 Daoji Li , Jinzhao Yu , Hui Zhao

The Model-X knockoffs is a practical methodology for variable selection, which stands out from other selection strategies since it allows for the control of the false discovery rate (FDR), relying on finite-sample guarantees. In this…

We describe a series of algorithms that efficiently implement Gaussian model-X knockoffs to control the false discovery rate on large scale feature selection problems. Identifying the knockoff distribution requires solving a large scale…

Machine Learning · Computer Science 2020-06-17 Armin Askari , Quentin Rebjock , Alexandre d'Aspremont , Laurent El Ghaoui

Modern scientific studies often require the identification of a subset of relevant explanatory variables, in the attempt to understand an interesting phenomenon. Several statistical methods have been developed to automate this task, but…

Methodology · Statistics 2019-05-14 Matteo Sesia , Chiara Sabatti , Emmanuel J. Candès

We tackle the problem of selecting from among a large number of variables those that are 'important' for an outcome. We consider situations where groups of variables are also of interest in their own right. For example, each variable might…

Methodology · Statistics 2018-08-13 Eugene Katsevich , Chiara Sabatti

Consider a case-control study in which we have a random sample, constructed in such a way that the proportion of cases in our sample is different from that in the general population---for instance, the sample is constructed to achieve a…

Methodology · Statistics 2019-01-01 Rina Foygel Barber , Emmanuel Candes

Researchers in biomedical studies often work with samples that are not selected uniformly at random from the population of interest, a major example being a case-control study. While these designs are motivated by specific scientific…

The fixed-X knockoff filter is a flexible framework for variable selection with false discovery rate (FDR) control in linear models with arbitrary design matrices (of full column rank) and it allows for finite-sample selective inference via…

Statistics Theory · Mathematics 2023-11-28 Mehrdad Pournaderi , Yu Xiang

The recent proliferation of high-dimensional data, such as electronic health records and genetics data, offers new opportunities to find novel predictors of outcomes. Presented with a large set of candidate features, interest often lies in…

Methodology · Statistics 2024-09-24 Michael J. Martens , Anjishnu Banerjee , Xinran Qi , Yushu Shi

The knockoffs is a recently proposed powerful framework that effectively controls the false discovery rate (FDR) for variable selection. However, none of the existing knockoff solutions are directly suited to handle multivariate or…

Methodology · Statistics 2024-06-28 Xinghao Qiao , Mingya Long , Qizhai Li

In many fields of science, we observe a response variable together with a large number of potential explanatory variables, and would like to be able to discover which variables are truly associated with the response. At the same time, we…

Methodology · Statistics 2015-10-15 Rina Foygel Barber , Emmanuel J. Candès

Variable selection plays a crucial role in enhancing modeling effectiveness across diverse fields, addressing the challenges posed by high-dimensional datasets of correlated variables. This work introduces a novel approach namely Knockoff…

Machine Learning · Statistics 2025-01-31 Xiaochen Zhang , Yunfeng Cai , Haoyi Xiong

An important problem in machine learning and statistics is to identify features that causally affect the outcome. This is often impossible to do from purely observational data, and a natural relaxation is to identify features that are…

Machine Learning · Statistics 2019-05-30 Jaime Roquero Gimenez , Amirata Ghorbani , James Zou

This paper develops a method based on model-X knockoffs to find conditional associations that are consistent across diverse environments, controlling the false discovery rate. The motivation for this problem is that large data sets may…

Methodology · Statistics 2021-06-09 Shuangning Li , Matteo Sesia , Yaniv Romano , Emmanuel Candès , Chiara Sabatti

One limitation of the most statistical/machine learning-based variable selection approaches is their inability to control the false selections. A recently introduced framework, model-x knockoffs, provides that to a wide range of models but…

Machine Learning · Statistics 2025-09-03 Deniz Koyuncu , Alex Gittens , Bülent Yener

The knockoff filter of Barber and Candes (arXiv:1404.5609) is a flexible framework for multiple testing in supervised learning models, based on introducing synthetic predictor variables to control the false discovery rate (FDR). Using the…

Methodology · Statistics 2024-11-26 Yixiang Luo , William Fithian , Lihua Lei