English

Sample covariance matrices of heavy-tailed distributions

Probability 2016-06-14 v1

Abstract

Let p>2p>2, B1B\geq 1, NnN\geq n and let XX be a centered nn-dimensional random vector with the identity covariance matrix such that supaSn1EX,apB\sup\limits_{a\in S^{n-1}}{\mathrm E}|\langle X,a\rangle|^p\leq B. Further, let X1,X2,,XNX_1,X_2,\dots,X_N be independent copies of XX, and ΣN:=1Ni=1NXiXiT\Sigma_N:=\frac{1}{N}\sum_{i=1}^N X_i {X_i}^T be the sample covariance matrix. We prove that K1ΣNIn221NmaxiNXi2+(nN)12/plog4Nn+(nN)12/min(p,4)K^{-1}\|\Sigma_N-I_n\|_{2\to 2}\leq\frac{1}{N}\max\limits_{i\leq N}\|X_i\|^2 +\Bigl(\frac{n}{N}\Bigr)^{1-2/p}\log^4\frac{N}{n}+\Bigl(\frac{n}{N}\Bigr)^{1-2/\min(p,4)} with probability at least 11n1-\frac{1}{n}, where K>0K>0 depends only on BB and pp. In particular, for all p>4p>4 we obtain a quantitative Bai-Yin type theorem.

Keywords

Cite

@article{arxiv.1606.03557,
  title  = {Sample covariance matrices of heavy-tailed distributions},
  author = {Konstantin Tikhomirov},
  journal= {arXiv preprint arXiv:1606.03557},
  year   = {2016}
}