English

A measure concentration effect for matrices of high, higher, and even higher dimension

Rings and Algebras 2022-03-16 v4 Numerical Analysis Numerical Analysis

Abstract

Let n>mn>m, and let AA be an (m×n)(m\times n)-matrix of full rank. Then obviously the estimate AxAx\|Ax\|\leq\|A\|\|x\| holds for the euclidean norm of xx and AxAx and the spectral norm as the assigned matrix norm. We study the sets of all xx for which, for fixed δ<1\delta<1, conversely AxδAx\|Ax\|\geq\delta\,\|A\|\|x\| holds. It turns out that these sets fill, in the high-dimensional case, almost the complete space once δ\delta falls below a bound that depends on the extremal singular values of AA and on the ratio of the dimensions. This effect has much to do with the random projection theorem, which plays an important role in the data sciences. As a byproduct, we calculate the probabilities this theorem deals with exactly.

Keywords

Cite

@article{arxiv.2010.13505,
  title  = {A measure concentration effect for matrices of high, higher, and even higher dimension},
  author = {Harry Yserentant},
  journal= {arXiv preprint arXiv:2010.13505},
  year   = {2022}
}

Comments

to appear in SIAM Journal on Matrix Analysis and Applications