English

MAP model selection in Gaussian regression

Statistics Theory 2010-09-14 v3 Statistics Theory

Abstract

We consider a Bayesian approach to model selection in Gaussian linear regression, where the number of predictors might be much larger than the number of observations. From a frequentist view, the proposed procedure results in the penalized least squares estimation with a complexity penalty associated with a prior on the model size. We investigate the optimality properties of the resulting estimator. We establish the oracle inequality and specify conditions on the prior that imply its asymptotic minimaxity within a wide range of sparse and dense settings for "nearly-orthogonal" and "multicollinear" designs.

Keywords

Cite

@article{arxiv.0912.4387,
  title  = {MAP model selection in Gaussian regression},
  author = {Felix Abramovich and Vadim Grinshtein},
  journal= {arXiv preprint arXiv:0912.4387},
  year   = {2010}
}

Comments

22 pages

R2 v1 2026-06-21T14:27:14.663Z