English

GRIP2: A Robust and Powerful Deep Knockoff Method for Feature Selection

Machine Learning 2026-02-03 v1 Machine Learning

Abstract

Identifying truly predictive covariates while strictly controlling false discoveries remains a fundamental challenge in nonlinear, highly correlated, and low signal-to-noise regimes, where deep learning based feature selection methods are most attractive. We propose Group Regularization Importance Persistence in 2 Dimensions (GRIP2), a deep knockoff feature importance statistic that integrates first-layer feature activity over a two-dimensional regularization surface controlling both sparsity strength and sparsification geometry. To approximate this surface integral in a single training run, we introduce efficient block-stochastic sampling, which aggregates feature activity magnitudes across diverse regularization regimes along the optimization trajectory. The resulting statistics are antisymmetric by construction, ensuring finite-sample FDR control. In extensive experiments on synthetic and semi-real data, GRIP2 demonstrates improved robustness to feature correlation and noise level: in high correlation and low signal-to-noise ratio regimes where standard deep learning based feature selectors may struggle, our method retains high power and stability. Finally, on real-world HIV drug resistance data, GRIP2 recovers known resistance-associated mutations with power better than established linear baselines, confirming its reliability in practice.

Keywords

Cite

@article{arxiv.2602.00218,
  title  = {GRIP2: A Robust and Powerful Deep Knockoff Method for Feature Selection},
  author = {Bob Junyi Zou and Lu Tian},
  journal= {arXiv preprint arXiv:2602.00218},
  year   = {2026}
}
R2 v1 2026-07-01T09:28:36.933Z