English

Inference In High-dimensional Single-Index Models Under Symmetric Designs

Statistics Theory 2021-03-02 v3 Other Statistics Statistics Theory

Abstract

The problem of statistical inference for regression coefficients in a high-dimensional single-index model is considered. Under elliptical symmetry, the single index model can be reformulated as a proxy linear model whose regression parameter is identifiable. We construct estimates of the regression coefficients of interest that are similar to the debiased lasso estimates in the standard linear model and exhibit similar properties: root-n-consistency and asymptotic normality. The procedure completely bypasses the estimation of the unknown link function, which can be extremely challenging depending on the underlying structure of the problem. Furthermore, under Gaussianity, we propose more efficient estimates of the coefficients by expanding the link function in the Hermite polynomial basis. Finally, we illustrate our approach via carefully designed simulation experiments.

Keywords

Cite

@article{arxiv.1909.03540,
  title  = {Inference In High-dimensional Single-Index Models Under Symmetric Designs},
  author = {Hamid Eftekhari and Moulinath Banerjee and Ya'acov Ritov},
  journal= {arXiv preprint arXiv:1909.03540},
  year   = {2021}
}

Comments

The current version was published in the Journal of Machine Learning Research, Volume 22. It is available online at https://jmlr.org/papers/v22/19-744.html

R2 v1 2026-06-23T11:09:06.068Z