The Hannan-Quinn Proposition for Linear Regression
Statistics Theory
2010-12-21 v1 Statistics Theory
Abstract
We consider the variable selection problem in linear regression. Suppose that we have a set of random variables such that with and unknown, and is independent of any linear combination of . Given actually emitted examples emitted from , we wish to estimate the true using information criteria in the form of , where is the likelihood with respect to multiplied by -1, and is a positive real sequence. If is too small, we cannot obtain consistency because of overestimation. For autoregression, Hannan-Quinn proved that, in their setting of and , the rate is the minimum satisfying strong consistency. This paper solves the statement affirmative for linear regression as well which has a completely different setting.
Cite
@article{arxiv.1012.4276,
title = {The Hannan-Quinn Proposition for Linear Regression},
author = {Joe Suzuki},
journal= {arXiv preprint arXiv:1012.4276},
year = {2010}
}