English
Related papers

Related papers: Analysis of randomized CholeskyQR for sparse matri…

200 papers

In this work, we focus on Shifted CholeskyQR (SCholeskyQR) for sparse matrices. We provide a new shifted item $s$ for Shifted CholeskyQR3 (SCholeskyQR3) based on the number of non-zero elements (nnze) and the element with the largest…

Numerical Analysis · Mathematics 2025-10-21 Haoran Guan , Yuwei Fan

This article proposes and analyzes several variants of the randomized Cholesky QR factorization of a matrix $X$. Instead of computing the R factor from $X^T X$, as is done by standard methods, we obtain it from a small, efficiently…

Numerical Analysis · Mathematics 2022-10-25 Oleg Balabanov

The Cholesky QR algorithm is an efficient communication-minimizing algorithm for computing the QR factorization of a tall-skinny matrix. Unfortunately it has the inherent numerical instability and breakdown when the matrix is…

Numerical Analysis · Mathematics 2018-10-01 Takeshi Fukaya , Ramaseshan Kannan , Yuji Nakatsukasa , Yusaku Yamamoto , Yuka Yanagisawa

This paper develops and analyzes a new algorithm for QR decomposition with column pivoting (QRCP) of rectangular matrices with many more rows than columns. The algorithm carefully combines methods from randomized numerical linear algebra to…

Numerical Analysis · Mathematics 2025-03-18 Maksim Melnichenko , Oleg Balabanov , Riley Murray , James Demmel , Michael W. Mahoney , Piotr Luszczek

We a present and analyze rpCholesky-QR, a randomized preconditioned Cholesky-QR algorithm for computing the thin QR factorization of real mxn matrices with rank n. rpCholesky-QR has a low orthogonalization error, a residual on the order of…

Numerical Analysis · Mathematics 2024-07-08 James E. Garrison , Ilse C. F. Ipsen

In recent years, randomized algorithms have established themselves as fundamental tools in computational linear algebra, with applications in scientific computing, machine learning, and quantum information science. Many randomized matrix…

Numerical Analysis · Mathematics 2025-12-19 Ethan N. Epperly

CholeskyQR2 and shifted CholeskyQR3 are two state-of-the-art algorithms for computing tall-and-skinny QR factorizations since they attain high performance on current computer architectures. However, to guarantee stability, for some…

Numerical Analysis · Mathematics 2025-09-17 Andrew J. Higgins , Daniel B. Szyld , Erik G. Boman , Ichitaro Yamazaki

The modified Cholesky decomposition is commonly used for precision matrix estimation given a specified order of random variables. However, the order of variables is often not available or cannot be pre-determined. In this work, we propose…

Machine Learning · Statistics 2021-11-23 Xiaoning Kang , Xinwei Deng

In recent years, there has been widespread adoption of machine learning-based approaches to automate the solving of partial differential equations (PDEs). Among these approaches, Gaussian processes (GPs) and kernel methods have garnered…

Numerical Analysis · Mathematics 2024-03-12 Yifan Chen , Houman Owhadi , Florian Schäfer

In this paper we present a novel algorithm developed for computing the QR factorisation of extremely ill-conditioned tall-and-skinny matrices on distributed memory systems. The algorithm is based on the communication-avoiding CholeskyQR2…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Nenad Mijić , Abhiram Kaushik , Davor Davidović

Scalable QR factorization algorithms for solving least squares and eigenvalue problems are critical given the increasing parallelism within modern machines. We introduce a more general parallelization of the CholeskyQR2 algorithm and show…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-18 Edward Hutter , Edgar Solomonik

The sparse Cholesky parametrization of the inverse covariance matrix can be interpreted as a Gaussian Bayesian network; however its counterpart, the covariance Cholesky factor, has received, with few notable exceptions, little attention so…

Machine Learning · Statistics 2020-09-03 Irene Córdoba , Concha Bielza , Pedro Larrañaga , Gherardo Varando

The solution of sparse symmetric positive definite linear systems is an important computational kernel in large-scale scientific and engineering modeling and simulation. We will solve the linear systems using a direct method, in which a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-13 M. Ozan Karsavuran , Esmond G. Ng , Barry W. Peyton

We classify a family of matrices of shift operators that can be factorised in a computationally tractable manner with the Cholesky algorithm. Such matrices arise in the linear quadratic regulator problem, and related areas. We use the…

Optimization and Control · Mathematics 2026-02-04 Julia Adlercreutz , Richard Pates

CholeskyQR is a simple and fast QR decomposition via Cholesky decomposition, while it has been considered highly sensitive to the condition number. In this paper, we provide a randomized preconditioner framework for CholeskyQR algorithm.…

Numerical Analysis · Mathematics 2021-11-25 Yuwei Fan , Yixiao Guo , Ting Lin

Sparse coding--that is, modelling data vectors as sparse linear combinations of basis elements--is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on the large-scale matrix factorization…

Machine Learning · Statistics 2010-02-11 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro

This paper examines a general class of noisy matrix completion tasks where the goal is to estimate a matrix from observations obtained at a subset of its entries, each of which is subject to random noise or corruption. Our specific focus is…

Machine Learning · Statistics 2016-11-18 Akshay Soni , Swayambhoo Jain , Jarvis Haupt , Stefano Gonella

Estimating large covariance matrices has been a longstanding important problem in many applications and has attracted increased attention over several decades. This paper deals with two methods based on pre-existing works to impose sparsity…

Applications · Statistics 2017-12-06 Ahmad W. Bitar , Jean-Philippe Ovarlez , Loong-Fah Cheong

Covariance estimation for high-dimensional datasets is a fundamental problem in modern day statistics with numerous applications. In these high dimensional datasets, the number of variables p is typically larger than the sample size n. A…

Methodology · Statistics 2016-10-11 Kshitij Khare , Sang Oh , Syed Rahman , Bala Rajaratnam

The randomly pivoted partial Cholesky algorithm (RPCholesky) computes a factorized rank-k approximation of an N x N positive-semidefinite (psd) matrix. RPCholesky requires only (k + 1) N entry evaluations and O(k^2 N) additional arithmetic…

Numerical Analysis · Mathematics 2024-10-23 Yifan Chen , Ethan N. Epperly , Joel A. Tropp , Robert J. Webber
‹ Prev 1 2 3 10 Next ›