English
Related papers

Related papers: A randomized preconditioned Cholesky-QR algorithm

200 papers

Algorithms involving Gaussian processes or determinantal point processes typically require computing the determinant of a kernel matrix. Frequently, the latter is computed from the Cholesky decomposition, an algorithm of cubic complexity in…

Computation · Statistics 2021-07-23 Simon Bartels , Wouter Boomsma , Jes Frellsen , Damien Garreau

We consider the solution of full column-rank least squares problems by means of normal equations that are preconditioned, symmetrically or non-symmetrically, with a randomized preconditioner. With an effective preconditioner, the solutions…

Numerical Analysis · Mathematics 2025-12-29 Ilse C. F. Ipsen

In this paper, we concentrate on the backward error and condition number of the indefinite least squares problem. For the normwise backward error of the indefinite least square problem, we adopt the linearization method to derive the tight…

Numerical Analysis · Mathematics 2016-12-21 Huai-An Diao , Tong-Yu Zhou

Square-root Kalman filters propagate state covariances in Cholesky-factor form for numerical stability, and are a natural target for gradient-based parameter learning in state-space models. Their core operation, triangularization of a…

Machine Learning · Statistics 2026-03-17 Adrien Corenflos

LU and Cholesky matrix factorization algorithms are core subroutines used to solve systems of linear equations (SLEs) encountered while solving an optimization problem. Standard factorization algorithms are highly efficient but remain…

Numerical Analysis · Mathematics 2022-07-25 Adolfo R. Escobedo

In this work, we focus on Shifted CholeskyQR (SCholeskyQR) for sparse matrices. We provide a new shifted item $s$ for Shifted CholeskyQR3 (SCholeskyQR3) based on the number of non-zero elements (nnze) and the element with the largest…

Numerical Analysis · Mathematics 2025-10-21 Haoran Guan , Yuwei Fan

Random Feature Methods (RFMs) and their variants such as extreme learning machine finite-basis physics-informed neural networks (ELM-FBPINNs) offer a scalable approach for solving partial differential equations (PDEs) by using localized,…

Numerical Analysis · Mathematics 2025-09-03 Jan Willem van Beek , Victorita Dolean , Ben Moseley

We introduce the $k$-banded Cholesky prior for estimating a high-dimensional bandable precision matrix via the modified Cholesky decomposition. The bandable assumption is imposed on the Cholesky factor of the decomposition. We obtained the…

Statistics Theory · Mathematics 2017-07-06 Kyoungjae Lee , Jaeyong Lee

Estimating large covariance matrices has been a longstanding important problem in many applications and has attracted increased attention over several decades. This paper deals with two methods based on pre-existing works to impose sparsity…

Applications · Statistics 2017-12-06 Ahmad W. Bitar , Jean-Philippe Ovarlez , Loong-Fah Cheong

Konrad Burnik suggests a structure-preserving QR factorization for centrosymmetric matrices, known as QX factorization. In this article, we obtain the explicit expressions for rigorous perturbation bounds of the QX factorization when the…

Numerical Analysis · Mathematics 2025-02-10 Aamir Farooq , Rewayat Khan , Uzma Rani , M. Tariq Rahim

We consider the minimization problem with the truncated quadratic regularization with gradient operator, which is a nonsmooth and nonconvex problem. We cooperated the classical preconditioned iterations for linear equations into the…

Optimization and Control · Mathematics 2021-05-04 Shengxiang Deng , Hongpeng Sun

The solution of a sparse system of linear equations is ubiquitous in scientific applications. Iterative methods, such as the Preconditioned Conjugate Gradient method (PCG), are normally chosen over direct methods due to memory and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-04 Joshua Dennis Booth , Hongyang Sun , Trevor Garnett

CUR matrix decomposition computes the low rank approximation of a given matrix by using the actual rows and columns of the matrix. It has been a very useful tool for handling large matrices. One limitation with the existing algorithms for…

Machine Learning · Computer Science 2014-11-05 Miao Xu , Rong Jin , Zhi-Hua Zhou

This note presents fast Cholesky/LU/QR decomposition algorithms with $O(n^{2.529})$ time complexity when using the fastest known matrix multiplication. The algorithms have potential application, since a quickly made implementation using…

Numerical Analysis · Computer Science 2018-12-06 Cristóbal Camarero

Matrix decomposition is a very important mathematical tool in numerical linear algebra for data processing. In this paper, we introduce a new randomized matrix decomposition algorithm, which is called randomized approximate SVD based on…

Numerical Analysis · Mathematics 2023-05-22 Xiaohui Ni , An-Bao Xu

We consider the solution of large linear systems of equations that arise when two-dimensional singularly perturbed reaction-diffusion equations are discretized. Standard methods for these problems, such as central finite differences, lead…

Numerical Analysis · Mathematics 2015-04-09 Thái Anh Nhan , Niall Madden

We propose a very simple preprocessing algorithm for semidefinite programming. Our algorithm inspects the constraints of the problem, deletes redundant rows and columns in the constraints, and reduces the size of the variable matrix. It…

Optimization and Control · Mathematics 2016-08-09 Preston Faulk , Gabor Pataki , Quoc Tran-Dinh

Randomized Kaczmarz (RK) is a simple and fast solver for consistent overdetermined systems, but it is known to be fragile under noise. We study overdetermined $m\times n$ linear systems with a sparse set of corrupted equations, $ {\bf…

Numerical Analysis · Mathematics 2026-02-16 Sofiia Shvaiko , Longxiu Huang , Elizaveta Rebrova

Randomized methods are becoming increasingly popular in numerical linear algebra. However, few attempts have been made to use them in developing preconditioners. Our interest lies in solving large-scale sparse symmetric positive definite…

Numerical Analysis · Mathematics 2021-11-16 Hussam Al Daas , Tyrone Rees , Jennifer Scott

This paper studies the estimation of large precision matrices and Cholesky factors obtained by observing a Gaussian process at many locations. Under general assumptions on the precision and the observations, we show that the sample…

Statistics Theory · Mathematics 2025-03-25 Jiaheng Chen , Daniel Sanz-Alonso