English
Related papers

Related papers: Simpler is better: A comparative study of randomiz…

200 papers

A general framework for solving the subspace clustering problem using the CUR decomposition is presented. The CUR decomposition provides a natural way to construct similarity matrices for data that come from a union of unknown subspaces…

Machine Learning · Computer Science 2018-12-13 Akram Aldroubi , Keaton Hamm , Ahmet Bugra Koku , Ali Sekmen

Column selection is an essential tool for structure-preserving low-rank approximation, with wide-ranging applications across many fields, such as data science, machine learning, and theoretical chemistry. In this work, we develop unified…

Numerical Analysis · Mathematics 2024-08-09 Mark Fornace , Michael Lindsey

CUR and low-rank approximations are among most fundamental subjects of numerical linear algebra, with a wide range of applications to a variety of highly important areas of modern computing, which range from the machine learning theory and…

Numerical Analysis · Mathematics 2016-12-20 Victor Y. Pan

A CUR approximation of a matrix $A$ is a particular type of low-rank approximation $A \approx C U R$, where $C$ and $R$ consist of columns and rows of $A$, respectively. One way to obtain such an approximation is to apply column subset…

Numerical Analysis · Mathematics 2019-08-19 Alice Cortinovis , Daniel Kressner

In this work, we analyze a sublinear-time algorithm for selecting a few rows and columns of a matrix for low-rank approximation purposes. The algorithm is based on an initial uniformly random selection of rows and columns, followed by a…

Numerical Analysis · Mathematics 2024-02-22 Alice Cortinovis , Lexing Ying

The computation of accurate low-rank matrix approximations is central to improving the scalability of various techniques in machine learning, uncertainty quantification, and control. Traditionally, low-rank approximations are constructed…

Numerical Analysis · Mathematics 2025-09-29 Nathaniel Pritchard , Taejun Park , Yuji Nakatsukasa , Per-Gunnar Martinsson

By exploiting the random sampling techniques, this paper derives an efficient randomized algorithm for computing a generalized CUR decomposition, which provides low-rank approximations of both matrices simultaneously in terms of some of…

Numerical Analysis · Mathematics 2023-04-07 Zhengbang Cao , Yimin Wei , Pengpeng Xie

Large deep learning models have achieved remarkable success but are resource-intensive, posing challenges such as memory usage. We introduce CURing, a novel model compression method based on CUR matrix decomposition, which approximates…

Machine Learning · Computer Science 2025-01-13 Sanghyeon Park , Soo-Mook Moon

This paper considers the use of Robust PCA in a CUR decomposition framework and applications thereof. Our main algorithms produce a robust version of column-row factorizations of matrices $\mathbf{D}=\mathbf{L}+\mathbf{S}$ where…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 HanQin Cai , Keaton Hamm , Longxiu Huang , Deanna Needell

Low rank approximation of matrices has been well studied in literature. Singular value decomposition, QR decomposition with column pivoting, rank revealing QR factorization (RRQR), Interpolative decomposition etc are classical deterministic…

Numerical Analysis · Mathematics 2016-06-22 N. Kishore Kumar , Jan Shneider

A CUR factorization is often utilized as a substitute for the singular value decomposition (SVD), especially when a concrete interpretation of the singular vectors is challenging. Moreover, if the original data matrix possesses properties…

Numerical Analysis · Mathematics 2024-06-25 Perfect Y. Gidisu , Michiel E. Hochstenbach

The CUR decomposition of an $m \times n$ matrix $A$ finds an $m \times c$ matrix $C$ with a subset of $c < n$ columns of $A,$ together with an $r \times n$ matrix $R$ with a subset of $r < m$ rows of $A,$ as well as a $c \times r$ low-rank…

Data Structures and Algorithms · Computer Science 2014-07-17 Christos Boutsidis , David P. Woodruff

We derive a CUR matrix factorization based on the Discrete Empirical Interpolation Method (DEIM). For a given matrix $A$, such a factorization provides a low rank approximate decomposition of the form $A \approx C U R$, where $C$ and $R$…

Numerical Analysis · Mathematics 2015-09-22 D. C. Sorensen , M. Embree

Prior optimal CUR decomposition and near optimal column reconstruction methods have been established by combining BSS sampling and adaptive sampling. In this paper, we propose a new approach to the optimal CUR decomposition and near optimal…

Numerical Analysis · Computer Science 2017-02-28 Haishan Ye , Yujun Li , Zhihua Zhang

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on…

Numerical Analysis · Computer Science 2017-03-17 Mostafa Rahmani , George Atia

Robust principal component analysis (RPCA) is a widely used tool for dimension reduction. In this work, we propose a novel non-convex algorithm, coined Iterated Robust CUR (IRCUR), for solving RPCA problems, which dramatically improves the…

Machine Learning · Statistics 2021-02-09 HanQin Cai , Keaton Hamm , Longxiu Huang , Jiaqi Li , Tao Wang

In data analysis, there continues to be a need for interpretable dimensionality reduction methods whereby instrinic meaning associated with the data is retained in the reduced space. Standard approaches such as Principal Component Analysis…

Numerical Analysis · Mathematics 2024-02-13 Maria Emelianenko , Guy B. Oldaker

This paper surveys randomized algorithms in numerical linear algebra for low-rank decompositions of matrices and tensors. The survey begins with a review of classical matrix algorithms that can be accelerated by randomized dimensionality…

Numerical Analysis · Mathematics 2026-01-01 Katherine J. Pearce , Per-Gunnar Martinsson

Rank-revealing matrix decompositions provide an essential tool in spectral analysis of matrices, including the Singular Value Decomposition (SVD) and related low-rank approximation techniques. QR with Column Pivoting (QRCP) is usually…

Mathematical Software · Computer Science 2020-08-12 Jed A. Duersch , Ming Gu

The singular value decomposition (SVD) is commonly used in applications requiring a low rank matrix approximation. However, the singular vectors cannot be interpreted in terms of the original data. For applications requiring this type of…

Numerical Analysis · Mathematics 2025-05-23 Kathryn Linehan , Radu Balan