English

The conjugate gradient algorithm on well-conditioned Wishart matrices is almost deterministic

Numerical Analysis 2019-10-04 v3 Computational Complexity Numerical Analysis Probability

Abstract

We prove that the number of iterations required to solve a random positive definite linear system with the conjugate gradient algorithm is almost deterministic for large matrices. We treat the case of Wishart matrices W=XXW = XX^* where XX is n×mn \times m and n/mdn/m \sim d for 0<d<10 < d < 1. Precisely, we prove that for most choices of error tolerance, as the matrix increases in size, the probability that the iteration count deviates from an explicit deterministic value tends to zero. In addition, for a fixed iteration count, we show that the norm of the error vector and the norm of the residual converge exponentially fast in probability, converge in mean and converge almost surely.

Keywords

Cite

@article{arxiv.1901.09007,
  title  = {The conjugate gradient algorithm on well-conditioned Wishart matrices is almost deterministic},
  author = {Percy Deift and Thomas Trogdon},
  journal= {arXiv preprint arXiv:1901.09007},
  year   = {2019}
}
R2 v1 2026-06-23T07:22:31.154Z