English
Related papers

Related papers: Optimal CUR Matrix Decompositions

200 papers

We study algorithms for construction of composable coresets for the task of Determinant Maximization under partition constraint. Given a point set $V\subset \mathbb{R}^d$ that is partitioned into $s$ groups $V_1,\cdots, V_s$, and integers…

Data Structures and Algorithms · Computer Science 2025-10-08 Sepideh Mahabadi , Thuy-Duong Vuong

We introduce a "learning-based" algorithm for the low-rank decomposition problem: given an $n \times d$ matrix $A$, and a parameter $k$, compute a rank-$k$ matrix $A'$ that minimizes the approximation loss $\|A-A'\|_F$. The algorithm uses a…

Machine Learning · Computer Science 2019-10-31 Piotr Indyk , Ali Vakilian , Yang Yuan

Given a matrix $M$ (not necessarily nonnegative) and a factorization rank $r$, semi-nonnegative matrix factorization (semi-NMF) looks for a matrix $U$ with $r$ columns and a nonnegative matrix $V$ with $r$ rows such that $UV$ is the best…

Numerical Analysis · Mathematics 2015-10-28 Nicolas Gillis , Abhishek Kumar

The best column approximation in the Frobenius norm with $r$ columns has an error at most $\sqrt{r+1}$ times larger than the truncated singular value decomposition. Reaching this bound in practice involves either expensive random volume…

Numerical Analysis · Mathematics 2023-11-08 Alexander Osinsky

Given vectors $v_1,\dots,v_n\in\mathbb{R}^d$ and a matroid $M=([n],I)$, we study the problem of finding a basis $S$ of $M$ such that $\det(\sum_{i \in S}v_i v_i^\top)$ is maximized. This problem appears in a diverse set of areas such as…

Data Structures and Algorithms · Computer Science 2020-04-20 Vivek Madan , Aleksandar Nikolov , Mohit Singh , Uthaipon Tantipongpipat

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

The U-curve optimization problem is characterized by a decomposable in U-shaped curves cost function over the chains of a Boolean lattice. This problem can be applied to model the classical feature selection problem in Machine Learning.…

Machine Learning · Computer Science 2014-07-24 Marcelo S. Reis , Carlos E. Ferreira , Junior Barrera

Structured Low-Rank Approximation is a problem arising in a wide range of applications in Numerical Analysis and Engineering Sciences. Given an input matrix $M$, the goal is to compute a matrix $M'$ of given rank $r$ in a linear or affine…

Numerical Analysis · Computer Science 2014-10-28 Éric Schost , Pierre-Jean Spaenlehauer

In this work, a novel rank-revealing matrix decomposition algorithm termed Compressed Randomized UTV (CoR-UTV) decomposition along with a CoR-UTV variant aided by the power method technique is proposed. CoR-UTV computes an approximation to…

Data Structures and Algorithms · Computer Science 2019-06-12 M. Kaloorazi , R. C. de Lamare

We study symmetric tensor decompositions, i.e., decompositions of the form $T = \sum_{i=1}^r u_i^{\otimes 3}$ where $T$ is a symmetric tensor of order 3 and $u_i \in \mathbb{C}^n$.In order to obtain efficient decomposition algorithms, it is…

Data Structures and Algorithms · Computer Science 2025-03-12 Pascal Koiran , Subhayan Saha

We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis and they have been studied for many decades.…

Optimization and Control · Mathematics 2023-10-02 Levent Tunçel , Stephen A. Vavasis , Jingye Xu

In recommendation systems, one is interested in the ranking of the predicted items as opposed to other losses such as the mean squared error. Although a variety of ways to evaluate rankings exist in the literature, here we focus on the Area…

Machine Learning · Statistics 2015-08-26 Charanpal Dhanjal , Romaric Gaudel , Stephan Clemencon

We consider the problem of reconstructing a rank-$k$ $n \times n$ matrix $M$ from a sampling of its entries. Under a certain incoherence assumption on $M$ and for the case when both the rank and the condition number of $M$ are bounded, it…

Machine Learning · Statistics 2017-08-23 David Gamarnik , Quan Li , Hongyi Zhang

Many statistical problems involve the estimation of a $\left(d\times d\right)$ orthogonal matrix $\textbf{Q}$. Such an estimation is often challenging due to the orthonormality constraints on $\textbf{Q}$. To cope with this problem, we…

Methodology · Statistics 2019-06-04 Luca Bagnato , Antonio Punzo

Low-rank matrix approximations play a fundamental role in numerical linear algebra and signal processing applications. This paper introduces a novel rank-revealing matrix decomposition algorithm termed Compressed Randomized UTV (CoR-UTV)…

Numerical Analysis · Computer Science 2018-10-18 M. Kaloorazi , R. C. de Lamare

Unitary decomposition is a widely used method to map quantum algorithms to an arbitrary set of quantum gates. Efficient implementation of this decomposition allows for translation of bigger unitary gates into elementary quantum operations,…

Quantum Physics · Physics 2024-03-14 A. M. Krol , A. Sarkar , I. Ashraf , Z. Al-Ars , K. Bertels

We describe an algorithm for sampling a low-rank random matrix $Q$ that best approximates a fixed target matrix $P\in\mathbb{C}^{n\times m}$ in the following sense: $Q$ is unbiased, i.e., $\mathbb{E}[Q] = P$; $\mathsf{rank}(Q)\leq r$; and…

Data Structures and Algorithms · Computer Science 2026-03-18 Leighton Pate Barnes , Stephen Cameron , Benjamin Howard

Symmetric positive semi-definite (SPSD) matrix approximation methods have been extensively used to speed up large-scale eigenvalue computation and kernel learning methods. The standard sketch based method, which we call the prototype model,…

Machine Learning · Computer Science 2016-12-13 Shusen Wang , Zhihua Zhang , Tong Zhang

An approximate sparse recovery system consists of parameters $k,N$, an $m$-by-$N$ measurement matrix, $\Phi$, and a decoding algorithm, $\mathcal{D}$. Given a vector, $x$, the system approximates $x$ by $\widehat x =\mathcal{D}(\Phi x)$,…

Data Structures and Algorithms · Computer Science 2014-02-10 Anna C. Gilbert , Yi Li , Ely Porat , Martin J. Strauss

This paper surveys randomized algorithms in numerical linear algebra for low-rank decompositions of matrices and tensors. The survey begins with a review of classical matrix algorithms that can be accelerated by randomized dimensionality…

Numerical Analysis · Mathematics 2026-01-01 Katherine J. Pearce , Per-Gunnar Martinsson