English

A generalization of the randomized singular value decomposition

Numerical Analysis 2022-01-24 v3 Machine Learning Numerical Analysis Machine Learning

Abstract

The randomized singular value decomposition (SVD) is a popular and effective algorithm for computing a near-best rank kk approximation of a matrix AA using matrix-vector products with standard Gaussian vectors. Here, we generalize the randomized SVD to multivariate Gaussian vectors, allowing one to incorporate prior knowledge of AA into the algorithm. This enables us to explore the continuous analogue of the randomized SVD for Hilbert--Schmidt (HS) operators using operator-function products with functions drawn from a Gaussian process (GP). We then construct a new covariance kernel for GPs, based on weighted Jacobi polynomials, which allows us to rapidly sample the GP and control the smoothness of the randomly generated functions. Numerical examples on matrices and HS operators demonstrate the applicability of the algorithm.

Keywords

Cite

@article{arxiv.2105.13052,
  title  = {A generalization of the randomized singular value decomposition},
  author = {Nicolas Boullé and Alex Townsend},
  journal= {arXiv preprint arXiv:2105.13052},
  year   = {2022}
}

Comments

Accepted at ICLR 2022

R2 v1 2026-06-24T02:31:22.343Z