English
Related papers

Related papers: A randomized preconditioned Cholesky-QR algorithm

200 papers

Linear Regression is a seminal technique in statistics and machine learning, where the objective is to build linear predictive models between a response (i.e., dependent) variable and one or more predictor (i.e., independent) variables. In…

Computational Geometry · Computer Science 2023-07-19 Suraj Shetiya , Shohedul Hasan , Abolfazl Asudeh , Gautam Das

The QR factorization and the SVD are two fundamental matrix decompositions with applications throughout scientific computing and data analysis. For matrices with many more rows than columns, so-called "tall-and-skinny matrices," there is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-08 Austin R. Benson , David F. Gleich , James Demmel

Tile low rank representations of dense matrices partition them into blocks of roughly uniform size, where each off-diagonal tile is compressed and stored as its own low rank factorization. They offer an attractive representation for many…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-27 Wajih Boukaram , Stefano Zampini , George Turkiyyah , David Keyes

Estimation of large sparse covariance matrices is of great importance for statistical analysis, especially in the high-dimensional settings. The traditional approach such as the sample covariance matrix performs poorly due to the high…

Statistics Theory · Mathematics 2023-08-21 Xiaoning Kang , Xinwei Deng

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

Optimization and Control · Mathematics 2021-04-09 Richard Clancy , Stephen Becker

Chebyshev filtered subspace iteration is a well-known algorithm for the solution of (symmetric/Hermitian) algebraic eigenproblems which has been implemented in several application codes~\cite{Kronik:2006ff, abinit:2020} or in stand alone…

Numerical Analysis · Mathematics 2026-03-12 Edoardo Di Napoli , Xinzhe Wu

This paper focuses on exploring the sparsity of the inverse covariance matrix $\bSigma^{-1}$, or the precision matrix. We form blocks of parameters based on each off-diagonal band of the Cholesky factor from its modified Cholesky…

Methodology · Statistics 2008-05-27 Clifford Lam

Last decade witnesses significant methodological and theoretical advances in estimating large precision matrices. In particular, there are scientific applications such as longitudinal data, meteorology and spectroscopy in which the ordering…

Statistics Theory · Mathematics 2019-08-20 Yu Liu , Zhao Ren

The classic rank-revealing QR factorization factorizes a matrix $A$ as $AP=QR$ where $P$ permutes the columns of $A$, $Q$ is an orthogonal matrix, and $R$ is upper triangular with non-increasing diagonal entries. This is called…

Numerical Analysis · Mathematics 2019-05-27 Reid Atcheson

Interior-point methods for linear programming problems require the repeated solution of a linear system of equations. Solving these linear systems is non-trivial due to the severe ill-conditioning of the matrices towards convergence. This…

Optimization and Control · Mathematics 2021-05-05 Jeffrey Cornelis , Wim Vanroose

While the proper orthogonal decomposition (POD) is optimal under certain norms it's also expensive to compute. For large matrix sizes, it is well known that the QR decomposition provides a tractable alternative. Under the assumption that it…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-18 Harbir Antil , Dangxing Chen , Scott E. Field

This paper introduces a randomized Householder QR factorization (RHQR). This factorization can be used to obtain a well conditioned basis of a vector space and thus can be employed in a variety of applications. The RHQR factorization of the…

Numerical Analysis · Mathematics 2024-05-24 Laura Grigori , Edouard Timsit

We design a sublinear-time approximation algorithm for quadratic function minimization problems with a better error bound than the previous algorithm by Hayashi and Yoshida (NIPS'16). Our approximation algorithm can be modified to handle…

Data Structures and Algorithms · Computer Science 2018-06-29 Amit Levi , Yuichi Yoshida

We describe a second-order accurate approach to sparsifying the off-diagonal blocks in the hierarchical approximate factorizations of sparse symmetric positive definite matrices. The norm of the error made by the new approach depends…

Numerical Analysis · Mathematics 2020-08-05 Bazyli Klockiewicz , Léopold Cambier , Ryan Humble , Hamdi Tchelepi , Eric Darve

Restricted skyline (rskyline) query is widely used in multi-criteria decision making. It generalizes the skyline query by additionally considering a set of personalized scoring functions F. Since uncertainty is inherent in datasets for…

Data Structures and Algorithms · Computer Science 2024-01-15 Xiangyu Gao , Jianzhong Li , Dongjing Miao

A fast implicit QR algorithm for eigenvalue computation of low rank corrections of unitary matrices is adjusted to work with matrix pencils arising from polynomial zerofinding problems . The modified QZ algorithm computes the generalized…

Numerical Analysis · Mathematics 2014-10-09 Paola Boito , Yuli Eidelman , Luca Gemignani

The multi-scale factor models are particularly appealing for analyzing matrix- or tensor-valued data, due to their adaptiveness to local geometry and intuitive interpretation. However, the reliance on the binary tree for recursive…

Methodology · Statistics 2020-02-26 Maoran Xu , Leo L. Duan

We present a fast randomized algorithm that computes a low rank LU decomposition. Our algorithm uses random projections type techniques to efficiently compute a low rank approximation of large matrices. The randomized LU algorithm can be…

Numerical Analysis · Mathematics 2016-02-02 Gil Shabat , Yaniv Shmueli , Yariv Aizenbud , Amir Averbuch

Low rank approximation of matrices has been well studied in literature. Singular value decomposition, QR decomposition with column pivoting, rank revealing QR factorization (RRQR), Interpolative decomposition etc are classical deterministic…

Numerical Analysis · Mathematics 2016-06-22 N. Kishore Kumar , Jan Shneider

An observed $K$-dimensional series $\left\{ y_{n}\right\} _{n=1}^{N}$ is expressed in terms of a lower $p$-dimensional latent series called factors $f_{n}$ and random noise $\varepsilon_{n}$. The equation, $y_{n}=Qf_{n}+\varepsilon_{n}$ is…

Computation · Statistics 2018-11-29 Immanuel Manohar