English

On the smoothed analysis of the smallest singular value with discrete noise

Probability 2020-09-04 v1 Numerical Analysis Numerical Analysis

Abstract

Let AA be an n×nn\times n real matrix, and let MM be an n×nn\times n random matrix whose entries are i.i.d sub-Gaussian random variables with mean 00 and variance 11. We make two contributions to the study of sn(A+M)s_n(A+M), the smallest singular value of A+MA+M. (1) We show that for all ϵ0\epsilon \geq 0, P[sn(A+M)ϵ]=O(ϵn)+2eΩ(n),\mathbb{P}[s_n(A + M) \leq \epsilon] = O(\epsilon \sqrt{n}) + 2e^{-\Omega(n)}, provided only that AA has Ω(n)\Omega (n) singular values which are O(n)O(\sqrt{n}). This extends a well-known result of Rudelson and Vershynin, which requires all singular values of AA to be O(n)O(\sqrt{n}). (2) We show that any bound of the form supAnC1P[sn(A+M)nC3]nC2\sup_{\|{A}\|\leq n^{C_1}}\mathbb{P}[s_n(A+M)\leq n^{-C_3}] \leq n^{-C_2} must have C3=Ω(C1C2)C_3 = \Omega (C_1 \sqrt{C_2}). This complements a result of Tao and Vu, who proved such a bound with C3=O(C1C2+C1+1)C_3 = O(C_1C_2 + C_1 + 1), and counters their speculation of possibly taking C3=O(C1+C2)C_3 = O(C_1 + C_2).

Keywords

Cite

@article{arxiv.2009.01699,
  title  = {On the smoothed analysis of the smallest singular value with discrete noise},
  author = {Vishesh Jain and Ashwin Sah and Mehtaab Sawhney},
  journal= {arXiv preprint arXiv:2009.01699},
  year   = {2020}
}

Comments

15 pages; comments welcome!