English
Related papers

Related papers: A geometric note on subspace updates and orthogona…

200 papers

We present a new restricted SVD-based CUR (RSVD-CUR) factorization for matrix triplets $(A, B, G)$ that aims to extract meaningful information by providing a low-rank approximation of the three matrices using a subset of their rows and…

Numerical Analysis · Mathematics 2023-06-27 Perfect Y. Gidisu , Michiel E. Hochstenbach

Singular Value Decomposition (SVD) is the basic body of many statistical algorithms and few users question whether SVD is properly handling its job. SVD aims at evaluating the decomposition that best approximates a data matrix, given some…

Applications · Statistics 2007-09-06 William Rey

The Nystr\"{o}m method is routinely used for out-of-sample extension of kernel matrices. We describe how this method can be applied to find the singular value decomposition (SVD) of general matrices and the eigenvalue decomposition (EVD) of…

Numerical Analysis · Computer Science 2013-05-02 Arik Nemtsov , Amir Averbuch , Alon Schclar

We discuss a randomized strong rank-revealing QR factorization that effectively reveals the spectrum of a matrix $\textbf{M}$. This factorization can be used to address problems such as selecting a subset of the columns of $\textbf{M}$,…

Numerical Analysis · Mathematics 2025-03-25 Laura Grigori , Zhipeng Xue

RSVDPACK is a library of functions for computing low rank approximations of matrices. The library includes functions for computing standard (partial) factorizations such as the Singular Value Decomposition (SVD), and also so called…

Numerical Analysis · Mathematics 2016-08-30 Sergey Voronin , Per-Gunnar Martinsson

The unpivoted and pivoted Householder QR factorizations are ubiquitous in numerical linear algebra. A difficulty with pivoted Householder QR is the communication bottleneck introduced by pivoting. In this paper we propose using random…

Numerical Analysis · Mathematics 2017-03-08 Stephen Becker , James Folberth , Laura Grigori

Low-rank approximation of images via singular value decomposition is well-received in the era of big data. However, singular value decomposition (SVD) is only for order-two data, i.e., matrices. It is necessary to flatten a higher order…

Machine Learning · Computer Science 2022-08-26 Liang Liao , Sen Lin , Lun Li , Xiuwei Zhang , Song Zhao , Yan Wang , Xinqiang Wang , Qi Gao , Jingyu Wang

Recent SVD-free matrix factorization formulations have enabled rank minimization for systems with millions of rows and columns, paving the way for matrix completion in extremely large-scale applications, such as seismic data interpolation.…

Machine Learning · Statistics 2014-03-06 Aleksandr Y. Aravkin , Rajiv Kumar , Hassan Mansour , Ben Recht , Felix J. Herrmann

We introduce a Generalized Randomized QR-decomposition that may be applied to arbitrary products of matrices and their inverses, without needing to explicitly compute the products or inverses. This factorization is a critical part of a…

Numerical Analysis · Mathematics 2019-09-17 Grey Ballard , James Demmel , Ioana Dumitriu , Alexander Rusciano

In this paper we introduce a new column selection strategy, named here ``Deviation Maximization", and apply it to compute rank-revealing QR factorizations as an alternative to the well known block version of the QR factorization with the…

Numerical Analysis · Mathematics 2022-06-03 Monica Dessole , Fabio Marcuzzi

We study the robust recovery of a low-rank matrix from sparsely and grossly corrupted Gaussian measurements, with no prior knowledge on the intrinsic rank. We consider the robust matrix factorization approach. We employ a robust $\ell_1$…

Optimization and Control · Mathematics 2021-10-27 Lijun Ding , Liwei Jiang , Yudong Chen , Qing Qu , Zhihui Zhu

Many applications in scientific computing and data science require the computation of a rank-revealing factorization of a large matrix. In many of these instances the classical algorithms for computing the singular value decomposition are…

Numerical Analysis · Mathematics 2018-12-17 Abinand Gopal , Per-Gunnar Martinsson

The generalized singular value decomposition (GSVD) is a valuable tool that has many applications in computational science. However, computing the GSVD for large-scale problems is challenging. Motivated by applications in hyper-differential…

Numerical Analysis · Mathematics 2020-02-10 Arvind K. Saibaba , Joseph Hart , Bart van Bloemen Waanders

We develop two fast algorithms for Hessenberg reduction of a structured matrix $A = D + UV^H$ where $D$ is a real or unitary $n \times n$ diagonal matrix and $U, V \in\mathbb{C}^{n \times k}$. The proposed algorithm for the real case…

Numerical Analysis · Mathematics 2016-12-14 Luca Gemignani , Leonardo Robol

In this paper we establish links between, and new results for, three problems that are not usually considered together. The first is a matrix decomposition problem that arises in areas such as statistical modeling and signal processing:…

Optimization and Control · Mathematics 2013-02-05 James Saunderson , Venkat Chandrasekaran , Pablo A. Parrilo , Alan S. Willsky

For a matrix ${\bf A}$ with linearly independent columns, this work studies to use its normalization $\bar{\bf A}$ and ${\bf A}$ itself to approximate its orthonormalization $\bf V$. We theoretically analyze the order of the approximation…

Rings and Algebras · Mathematics 2017-01-04 Gen Li , Yuantao Gu

For linearly constrained least-squares problems that depend on a vector of parameters, this paper proposes techniques for reducing the number of involved optimization variables. After first eliminating equality constraints in a numerically…

Optimization and Control · Mathematics 2020-12-21 Alberto Bemporad , Gionata Cimini

In 2011, Kilmer and Martin proposed tensor singular value decomposition (T-SVD) for third order tensors. Since then, T-SVD has applications in low rank tensor approximation, tensor recovery, multi-view clustering, multi-view feature…

Numerical Analysis · Mathematics 2021-08-11 Liqun Qi , Chen Ling , Jinejie Liu , Chen Ouyang

The hierarchical matrix framework partitions matrices into subblocks that are either small or of low numerical rank, enabling linear storage complexity and efficient matrix-vector multiplication. This work focuses on the $H^2$-matrix format…

Numerical Analysis · Mathematics 2026-02-02 Anna Yesypenko , Per-Gunnar Martinsson

We present an alternative method for carrying out a principal-component analysis of Wilson coefficients in standard model effective field theory (SMEFT). The method is based on singular-value decomposition (SVD). The SVD method provides…

High Energy Physics - Phenomenology · Physics 2020-07-03 Geoffrey T. Bodwin , Hee Sok Chung