English
Related papers

Related papers: Low-Rank Matrix Approximations with Flip-Flop Spec…

200 papers

We introduce an algorithmic framework for performing QR factorization with column pivoting (QRCP) on general matrices. The framework enables the design of practical QRCP algorithms through user-controlled choices for the core subroutines.…

Mathematical Software · Computer Science 2025-07-02 Maksim Melnichenko , Riley Murray , William Killian , James Demmel , Michael W. Mahoney , Piotr Luszczek , Mark Gates

The development of randomized algorithms for numerical linear algebra, e.g. for computing approximate QR and SVD factorizations, has recently become an intense area of research. This paper studies one of the most frequently discussed…

Numerical Analysis · Computer Science 2013-08-28 Rafi Witten , Emmanuel Candes

In this work, we analyze a sublinear-time algorithm for selecting a few rows and columns of a matrix for low-rank approximation purposes. The algorithm is based on an initial uniformly random selection of rows and columns, followed by a…

Numerical Analysis · Mathematics 2024-02-22 Alice Cortinovis , Lexing Ying

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

The low-rank quaternion matrix approximation has been successfully applied in many applications involving signal processing and color image processing. However, the cost of quaternion models for generating low-rank quaternion matrix…

Numerical Analysis · Mathematics 2024-03-01 Peng-Ling Wu , Kit Ian Kou , Hongmin Cai , Zhaoyuan Yu

This paper develops and analyzes a new algorithm for QR decomposition with column pivoting (QRCP) of rectangular matrices with many more rows than columns. The algorithm carefully combines methods from randomized numerical linear algebra to…

Numerical Analysis · Mathematics 2025-03-18 Maksim Melnichenko , Oleg Balabanov , Riley Murray , James Demmel , Michael W. Mahoney , Piotr Luszczek

Random Feature Methods (RFMs) and their variants such as extreme learning machine finite-basis physics-informed neural networks (ELM-FBPINNs) offer a scalable approach for solving partial differential equations (PDEs) by using localized,…

Numerical Analysis · Mathematics 2025-09-03 Jan Willem van Beek , Victorita Dolean , Ben Moseley

A fundamental problem when adding column pivoting to the Householder QR factorization is that only about half of the computation can be cast in terms of high performing matrix-matrix multiplications, which greatly limits the benefits that…

Numerical Analysis · Mathematics 2016-12-08 Per-Gunnar Martinsson , Gregorio Quintana-Orti , Nathan Heavner , Robert van de Geijn

We introduce a Generalized Randomized QR-decomposition that may be applied to arbitrary products of matrices and their inverses, without needing to explicitly compute the products or inverses. This factorization is a critical part of a…

Numerical Analysis · Mathematics 2019-09-17 Grey Ballard , James Demmel , Ioana Dumitriu , Alexander Rusciano

We consider the problem of computing a QR (or QZ) decomposition of a real, dense, tall and very skinny matrix. That is, the number of columns is tiny compared to the number of rows, rendering most computations completely or partially…

Mathematical Software · Computer Science 2026-03-24 Jonas Thies , Melven Röhrig-Zöllner

Low rank approximation of matrices has been well studied in literature. Singular value decomposition, QR decomposition with column pivoting, rank revealing QR factorization (RRQR), Interpolative decomposition etc are classical deterministic…

Numerical Analysis · Mathematics 2016-06-22 N. Kishore Kumar , Jan Shneider

Standard rank-revealing factorizations such as the singular value decomposition and column pivoted QR factorization are challenging to implement efficiently on a GPU. A major difficulty in this regard is the inability of standard algorithms…

Numerical Analysis · Mathematics 2023-05-23 Nathan Heavner , Chao Chen , Abinand Gopal , Per-Gunnar Martinsson

We present two new algorithms for Householder QR factorization of Block Low-Rank (BLR) matrices: one that performs block-column-wise QR, and another that is based on tiled QR. We show how the block-column-wise algorithm exploits BLR…

Numerical Analysis · Mathematics 2022-08-15 M. Ridwan Apriansyah , Rio Yokota

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

Statistics Theory · Mathematics 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

An efficient, accurate and reliable approximation of a matrix by one of lower rank is a fundamental task in numerical linear algebra and signal processing applications. In this paper, we introduce a new matrix decomposition approach termed…

Numerical Analysis · Computer Science 2018-08-15 Maboud F. Kaloorazi , Rodrigo C. de Lamare

Low-rank plus diagonal (LRPD) decompositions provide a powerful structural model for large covariance matrices, simultaneously capturing global shared factors and localized corrections that arise in covariance estimation, factor analysis,…

Numerical Analysis · Mathematics 2025-12-22 Kingsley Yeon , Mihai Anitescu

This paper presents a randomized quaternion singular value decomposition (QSVD) algorithm for low-rank matrix approximation problems, which are widely used in color face recognition, video compression, and signal processing problems. With…

Numerical Analysis · Mathematics 2021-12-28 Qiaohua Liu , Sitao Ling , Zhigang Jia

Matrix decomposition is a very important mathematical tool in numerical linear algebra for data processing. In this paper, we introduce a new randomized matrix decomposition algorithm, which is called randomized approximate SVD based on…

Numerical Analysis · Mathematics 2023-05-22 Xiaohui Ni , An-Bao Xu

We present parallel and sequential dense QR factorization algorithms for tall and skinny matrices and general rectangular matrices that both minimize communication, and are as stable as Householder QR. The sequential and parallel algorithms…

Numerical Analysis · Mathematics 2008-09-16 James Demmel , Laura Grigori , Mark Hoemmen , Julien Langou

This article proposes and analyzes several variants of the randomized Cholesky QR factorization of a matrix $X$. Instead of computing the R factor from $X^T X$, as is done by standard methods, we obtain it from a small, efficiently…

Numerical Analysis · Mathematics 2022-10-25 Oleg Balabanov