English

LASSO extension: using the number of non-zero coefficients to test the global model hypothesis

Methodology 2023-08-01 v1 Quantitative Methods

Abstract

In this paper, we propose a test procedure based on the LASSO methodology to test the global null hypothesis of no dependence between a response variable and pp predictors, where nn observations with n<pn < p are available. The proposed procedure is similar to the F-test for a linear model, which evaluates significance based on the ratio of explained to unexplained variance. However, the F-test is not suitable for models where pnp \geq n. This limitation is due to the fact that when pnp \geq n, the unexplained variance is zero and thus the F-statistic can no longer be calculated. In contrast, the proposed extension of the LASSO methodology overcomes this limitation by using the number of non-zero coefficients in the LASSO model as a test statistic after suitably specifying the regularization parameter. The method allows reliable analysis of high-dimensional datasets with as few as n=40n = 40 observations. The performance of the method is tested by means of a power study.

Keywords

Cite

@article{arxiv.2307.16374,
  title  = {LASSO extension: using the number of non-zero coefficients to test the global model hypothesis},
  author = {Carsten Uhlig and Steffen Uhlig},
  journal= {arXiv preprint arXiv:2307.16374},
  year   = {2023}
}

Comments

9 pages, 2 figures