A new class of generalized Bayes minimax ridge regression estimators
Abstract
Let y=A\beta+\epsilon, where y is an N\times1 vector of observations, \beta is a p\times1 vector of unknown regression coefficients, A is an N\times p design matrix and \epsilon is a spherically symmetric error term with unknown scale parameter \sigma. We consider estimation of \beta under general quadratic loss functions, and, in particular, extend the work of Strawderman [J. Amer. Statist. Assoc. 73 (1978) 623-627] and Casella [Ann. Statist. 8 (1980) 1036-1056, J. Amer. Statist. Assoc. 80 (1985) 753-758] by finding adaptive minimax estimators (which are, under the normality assumption, also generalized Bayes) of \beta, which have greater numerical stability (i.e., smaller condition number) than the usual least squares estimator. In particular, we give a subclass of such estimators which, surprisingly, has a very simple form. We also show that under certain conditions the generalized Bayes minimax estimators in the normal case are also generalized Bayes and minimax in the general case of spherically symmetric errors.
Keywords
Cite
@article{arxiv.math/0508282,
title = {A new class of generalized Bayes minimax ridge regression estimators},
author = {Yuzo Maruyama and William E. Strawderman},
journal= {arXiv preprint arXiv:math/0508282},
year = {2010}
}
Comments
Published at http://dx.doi.org/10.1214/009053605000000327 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)