English

The extension of Pearson correlation coefficient, measuring noise, and selecting features

Mathematical Finance 2024-02-02 v1

Abstract

Not a matter of serious contention, Pearson's correlation coefficient is still the most important statistical association measure. Restricted to just two variables, this measure sometimes doesn't live up to users' needs and expectations. Specifically, a multivariable version of the correlation coefficient can greatly contribute to better assessment of the risk in a multi-asset investment portfolio. Needless to say, the correlation coefficient is derived from another concept: covariance. Even though covariance can be extended naturally by its mathematical formula, such an extension is to no use. Making matters worse, the correlation coefficient can never be extended based on its mathematical definition. In this article, we briefly explore random matrix theory to extend the notion of Pearson's correlation coefficient to an arbitrary number of variables. Then, we show that how useful this measure is at gauging noise, thereby selecting features particularly in classification.

Keywords

Cite

@article{arxiv.2402.00543,
  title  = {The extension of Pearson correlation coefficient, measuring noise, and selecting features},
  author = {Reza Salimi and Kamran Pakizeh},
  journal= {arXiv preprint arXiv:2402.00543},
  year   = {2024}
}

Comments

24 pages, 40 figures

R2 v1 2026-06-28T14:34:26.213Z