English

Profile least squares estimators in the monotone single index model

Statistics Theory 2023-01-31 v3 Statistics Theory

Abstract

We consider least squares estimators of the finite regression parameter α\alpha in the single index regression model Y=ψ(αTX)+ϵY=\psi(\alpha^T X)+\epsilon, where XX is a dd-dimensional random vector, \E(YX)=ψ(αTX)\E(Y|X)=\psi(\alpha^T X), and where ψ\psi is monotone. It has been suggested to estimate α\alpha by a profile least squares estimator, minimizing i=1n(Yiψ(αTXi))2\sum_{i=1}^n(Y_i-\psi(\alpha^T X_i))^2 over monotone ψ\psi and α\alpha on the boundary Sd1S_{d-1}of the unit ball. Although this suggestion has been around for a long time, it is still unknown whether the estimate is n\sqrt{n} convergent. We show that a profile least squares estimator, using the same pointwise least squares estimator for fixed α\alpha, but using a different global sum of squares, is n\sqrt{n}-convergent and asymptotically normal. The difference between the corresponding loss functions is studied and also a comparison with other methods is given.

Keywords

Cite

@article{arxiv.2001.05454,
  title  = {Profile least squares estimators in the monotone single index model},
  author = {Fadoua Balabdaoui and Piet Groeneboom},
  journal= {arXiv preprint arXiv:2001.05454},
  year   = {2023}
}

Comments

21 pages, 6 figures