Stepwise regression revisited
Abstract
This paper shows that the degree of approximate multicollinearity in a linear regression model increases simply by including independent variables, even if these are not highly linearly related. In the current situation where it is relatively easy to find linear models with a large number of independent variables, it is shown that this issue can lead to the erroneous conclusion that there is a worrying problem of approximate multicollinearity. To avoid this situation, an adjusted variance inflation factor is proposed to compensate the presence of a large number of independent variables in the multiple linear regression model. It is shown that this proposal has a direct impact on variable selection models based on influence relationships, which translates into a new decision criterion in the individual significance contrast to be considered in stepwise regression models or even directly in a multiple linear regression model.
Keywords
Cite
@article{arxiv.2503.04330,
title = {Stepwise regression revisited},
author = {Román Salmerón Gómez and Catalina García García},
journal= {arXiv preprint arXiv:2503.04330},
year = {2025}
}
Comments
22 pages, 2 figures, 7 tables, working paper