English

Generalized ridge estimator and model selection criterion in multivariate linear regression

Statistics Theory 2016-04-08 v2 Statistics Theory

Abstract

We propose new model selection criteria based on generalized ridge estimators dominating the maximum likelihood estimator under the squared risk and the Kullback-Leibler risk in multivariate linear regression. Our model selection criteria have the following favorite properties: consistency, unbiasedness, uniformly minimum variance. Consistency is proven under an asymptotic structure pnc\frac{p}{n}\to c where nn is the sample size and pp is the parameter dimension of the response variables. In particular, our proposed class of estimators dominates the maximum likelihood estimator under the squared risk even when the model does not include the true model. Experimental results show that the risks of our model selection criteria are smaller than the ones based on the maximum likelihood estimator and that our proposed criteria specify the true model under some conditions.

Keywords

Cite

@article{arxiv.1603.09458,
  title  = {Generalized ridge estimator and model selection criterion in multivariate linear regression},
  author = {Yuichi Mori and Taiji Suzuki},
  journal= {arXiv preprint arXiv:1603.09458},
  year   = {2016}
}

Comments

26 pages, 6 figures

R2 v1 2026-06-22T13:22:04.471Z