English

Model-free Feature Screening and FDR Control with Knockoff Features

Methodology 2021-02-16 v3 Machine Learning

Abstract

This paper proposes a model-free and data-adaptive feature screening method for ultra-high dimensional datasets. The proposed method is based on the projection correlation which measures the dependence between two random vectors. This projection correlation based method does not require specifying a regression model and applies to the data in the presence of heavy-tailed errors and multivariate response. It enjoys both sure screening and rank consistency properties under weak assumptions. Further, a two-step approach is proposed to control the false discovery rate (FDR) in feature screening with the help of knockoff features. It can be shown that the proposed two-step approach enjoys both sure screening and FDR control if the pre-specified FDR level α\alpha is greater or equal to 1/s1/s, where ss is the number of active features. The superior empirical performance of the proposed methods is justified by various numerical experiments and real data applications.

Keywords

Cite

@article{arxiv.1908.06597,
  title  = {Model-free Feature Screening and FDR Control with Knockoff Features},
  author = {Wanjun Liu and Yuan Ke and Jingyuan Liu and Runze Li},
  journal= {arXiv preprint arXiv:1908.06597},
  year   = {2021}
}
R2 v1 2026-06-23T10:50:30.414Z