English

A new class of generalized Bayes minimax ridge regression estimators

Statistics Theory 2010-09-14 v1 Statistics Theory

Abstract

Let y=A\beta+\epsilon, where y is an N\times1 vector of observations, \beta is a p\times1 vector of unknown regression coefficients, A is an N\times p design matrix and \epsilon is a spherically symmetric error term with unknown scale parameter \sigma. We consider estimation of \beta under general quadratic loss functions, and, in particular, extend the work of Strawderman [J. Amer. Statist. Assoc. 73 (1978) 623-627] and Casella [Ann. Statist. 8 (1980) 1036-1056, J. Amer. Statist. Assoc. 80 (1985) 753-758] by finding adaptive minimax estimators (which are, under the normality assumption, also generalized Bayes) of \beta, which have greater numerical stability (i.e., smaller condition number) than the usual least squares estimator. In particular, we give a subclass of such estimators which, surprisingly, has a very simple form. We also show that under certain conditions the generalized Bayes minimax estimators in the normal case are also generalized Bayes and minimax in the general case of spherically symmetric errors.

Keywords

Cite

@article{arxiv.math/0508282,
  title  = {A new class of generalized Bayes minimax ridge regression estimators},
  author = {Yuzo Maruyama and William E. Strawderman},
  journal= {arXiv preprint arXiv:math/0508282},
  year   = {2010}
}

Comments

Published at http://dx.doi.org/10.1214/009053605000000327 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)