English
Related papers

Related papers: A Powerful and Precise Feature-level Filter using …

200 papers

The Model-X knockoff procedure has recently emerged as a powerful approach for feature selection with statistical guarantees. The advantage of knockoff is that if we have a good model of the features X, then we can identify salient features…

Machine Learning · Statistics 2019-05-30 Jaime Roquero Gimenez , James Zou

The fixed-X knockoff filter is a flexible framework for variable selection with false discovery rate (FDR) control in linear models with arbitrary design matrices (of full column rank) and it allows for finite-sample selective inference via…

Statistics Theory · Mathematics 2023-11-28 Mehrdad Pournaderi , Yu Xiang

We present a novel method for controlling the $k$-familywise error rate ($k$-FWER) in the linear regression setting using the knockoffs framework first introduced by Barber and Cand\`es. Our procedure, which we also refer to as knockoffs,…

Methodology · Statistics 2015-11-10 Lucas Janson , Weijie Su

Feature selection prepares the AI-readiness of data by eliminating redundant features. Prior research falls into two primary categories: i) Supervised Feature Selection, which identifies the optimal feature subset based on their relevance…

Machine Learning · Computer Science 2024-03-08 Xinyuan Wang , Dongjie Wang , Wangyang Ying , Rui Xie , Haifeng Chen , Yanjie Fu

This paper proposes a model-free and data-adaptive feature screening method for ultra-high dimensional datasets. The proposed method is based on the projection correlation which measures the dependence between two random vectors. This…

Methodology · Statistics 2021-02-16 Wanjun Liu , Yuan Ke , Jingyuan Liu , Runze Li

Healthcare datasets present many challenges to both machine learning and statistics as their data are typically heterogeneous, censored, high-dimensional and have missing information. Feature selection is often used to identify the…

Machine Learning · Computer Science 2022-07-06 Annette Spooner , Gelareh Mohammadi , Perminder S. Sachdev , Henry Brodaty , Arcot Sowmya

We introduce DiffKnock, a diffusion-based knockoff framework for high-dimensional feature selection with finite-sample false discovery rate (FDR) control. DiffKnock addresses two key limitations of existing knockoff methods: preserving…

Methodology · Statistics 2025-10-03 Heng Ge , Qing Lu

Model-X knockoff has garnered significant attention among various feature selection methods due to its guarantees for controlling the false discovery rate (FDR). Since its introduction in parametric design, knockoff techniques have evolved…

Machine Learning · Computer Science 2024-11-11 Hongyu Shen , Yici Yan , Zhizhen Zhao

The recently proposed fixed-X knockoff is a powerful variable selection procedure that controls the false discovery rate (FDR) in any finite-sample setting, yet its theoretical insights are difficult to show beyond Gaussian linear models.…

Methodology · Statistics 2023-11-28 Han Su , Panxu Yuan , Qingyang Sun , Mengxi Yi , Gaorong Li

Controlled feature selection aims to discover the features a response depends on while limiting the false discovery rate (FDR) to a predefined level. Recently, multiple deep-learning-based methods have been proposed to perform controlled…

Machine Learning · Statistics 2022-10-24 Derek Hansen , Brian Manzo , Jeffrey Regier

Out of the participants in a randomized experiment with anticipated heterogeneous treatment effects, is it possible to identify which subjects have a positive treatment effect? While subgroup analysis has received attention, claims about…

Methodology · Statistics 2024-05-14 Boyan Duan , Larry Wasserman , Aaditya Ramdas

High-dimensional feature selection is routinely required to balance statistical power with strict control of multiple-error metrics such as the k-Family-Wise Error Rate (k-FWER) and the False Discovery Proportion (FDP), yet some existing…

Methodology · Statistics 2026-03-03 Xuelin Zhang , Jingxuan Liang , Xinyue Liu , Hong Chen , Biqin Song

Recent discoveries suggest that our gut microbiome plays an important role in our health and wellbeing. However, the gut microbiome data are intricate; for example, the microbial diversity in the gut makes the data high-dimensional. While…

Methodology · Statistics 2021-03-02 Fang Xie , Johannes Lederer

Recently, Barber and Cand\`es laid the theoretical foundation for a general framework for false discovery rate (FDR) control based on the notion of "knockoffs." A closely related FDR control methodology has long been employed in the…

Methodology · Statistics 2022-03-15 Dong Luo , Arya Ebadi , Yilun He , Kristen Emery , William Stafford Noble , Uri Keich

One challenge in exploratory association studies using observational data is that the associations between the predictors and the outcome are potentially weak and rare, and the candidate predictors have complex correlation structures. False…

Methodology · Statistics 2025-01-30 Runqiu Wang , Ran Dai , Hongying Dai , Evan French , Cheng Zheng

Recent large cancer studies have measured somatic alterations in an unprecedented number of tumours. These large datasets allow the identification of cancer-related sets of genetic alterations by identifying relevant combinatorial patterns.…

Quantitative Methods · Quantitative Biology 2019-06-19 Rebecca Sarto Basso , Dorit S. Hochbaum , Fabio Vandin

In many multiple testing applications in genetics, the signs of test statistics provide useful directional information, such as whether genes are potentially up- or down-regulated between two experimental conditions. However, most existing…

Methodology · Statistics 2025-07-22 Zhaoyang Tian , Kun Liang , Pengfei Li

We describe a series of algorithms that efficiently implement Gaussian model-X knockoffs to control the false discovery rate on large scale feature selection problems. Identifying the knockoff distribution requires solving a large scale…

Machine Learning · Computer Science 2020-06-17 Armin Askari , Quentin Rebjock , Alexandre d'Aspremont , Laurent El Ghaoui

We address challenges in variable selection with highly correlated data that are frequently present in finance, economics, but also in complex natural systems as e.g. weather. We develop a robustified version of the knockoff framework,…

Econometrics · Economics 2022-06-14 Konstantin Görgen , Abdolreza Nazemi , Melanie Schienle

Knockoffs are a popular statistical framework that addresses the challenging problem of conditional variable selection in high-dimensional settings with statistical control. Such statistical control is essential for the reliability of…

Methodology · Statistics 2025-04-30 Alexandre Blain , Angel Reyero Lobo , Julia Linhart , Bertrand Thirion , Pierre Neuvial