English
Related papers

Related papers: Stability of Sampling for CUR Decompositions

200 papers

In this letter, we study the deterministic sampling patterns for the completion of low rank matrix, when corrupted with a sparse noise, also known as robust matrix completion. We extend the recent results on the deterministic sampling…

Information Theory · Computer Science 2018-03-14 Morteza Ashraphijuo , Vaneet Aggarwal , Xiaodong Wang

Low-rank matrix completion (LRMC) problems arise in a wide variety of applications. Previous theory mainly provides conditions for completion under missing-at-random samplings. This paper studies deterministic conditions for completion. An…

Machine Learning · Statistics 2016-10-12 Daniel L. Pimentel-Alarcón , Nigel Boston , Robert D. Nowak

In this paper we consider general rank minimization problems with rank appearing in either objective function or constraint. We first establish that a class of special rank minimization problems has closed-form solutions. Using this result,…

Optimization and Control · Mathematics 2012-05-30 Zhaosong Lu , Yong Zhang

Prior optimal CUR decomposition and near optimal column reconstruction methods have been established by combining BSS sampling and adaptive sampling. In this paper, we propose a new approach to the optimal CUR decomposition and near optimal…

Numerical Analysis · Computer Science 2017-02-28 Haishan Ye , Yujun Li , Zhihua Zhang

For a given matrix subspace, how can we find a basis that consists of low-rank matrices? This is a generalization of the sparse vector problem. It turns out that when the subspace is spanned by rank-1 matrices, the matrices can be obtained…

Numerical Analysis · Computer Science 2016-06-29 Yuji Nakatsukasa , Tasuku Soma , André Uschmajew

Least squares method is one of the simplest and most popular techniques applied in data fitting, imaging processing and high dimension data analysis. The classic methods like QR and SVD decomposition for solving least squares problems has a…

Numerical Analysis · Mathematics 2018-06-11 Long Chen , Huiwen Wu

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of…

Machine Learning · Statistics 2010-09-07 Mehryar Mohri , Ameet Talwalkar

In this paper, we tackle two important problems in low-rank learning, which are partial singular value decomposition and numerical rank estimation of huge matrices. By using the concepts of Krylov subspaces such as Golub-Kahan…

Machine Learning · Statistics 2021-09-07 Reza Godaz , Reza Monsefi , Faezeh Toutounian , Reshad Hosseini

Low-rank matrix recovery problems arise naturally as mathematical formulations of various inverse problems, such as matrix completion, blind deconvolution, and phase retrieval. Over the last two decades, a number of works have rigorously…

Information Theory · Computer Science 2021-06-09 Tim Fuchs , David Gross , Peter Jung , Felix Krahmer , Richard Kueng , Dominik Stöger

One popular way to compute the CANDECOMP/PARAFAC (CP) decomposition of a tensor is to transform the problem into a sequence of overdetermined least squares subproblems with Khatri-Rao product (KRP) structure involving factor matrices. In…

Numerical Analysis · Mathematics 2023-01-25 Yajie Yu , Hanyu Li

Certain classes of CUR algorithms, also referred to as cross or pseudoskeleton algorithms, are widely used for low-rank matrix approximation when direct access to all matrix entries is costly. Their key advantage lies in constructing a…

Numerical Analysis · Mathematics 2025-10-02 Grishma Palkar , Hessam Babaee

Compression has emerged as one of the essential deep learning research topics, especially for the edge devices that have limited computation power and storage capacity. Among the main compression techniques, low-rank compression via matrix…

Machine Learning · Computer Science 2021-12-02 Moonjung Eo , Suhyun Kang , Wonjong Rhee

Large deep learning models have achieved remarkable success but are resource-intensive, posing challenges such as memory usage. We introduce CURing, a novel model compression method based on CUR matrix decomposition, which approximates…

Machine Learning · Computer Science 2025-01-13 Sanghyeon Park , Soo-Mook Moon

Based on the column pivoted QR decomposition, we propose some randomized algorithms including pass-efficient ones for the generalized CUR decompositions of matrix pair and matrix triplet. Detailed error analyses of these algorithms are…

Numerical Analysis · Mathematics 2023-03-14 Guihua Zhang , Hanyu Li , Yimin Wei

We consider the problem of developing interpretable and computationally efficient matrix decomposition methods for matrices whose entries have bounded support. Such matrices are found in large-scale DNA methylation studies and many other…

Machine Learning · Computer Science 2024-10-25 Anjali N. Albert , Patrick Flaherty , Aaron Schein

Low-rank approximation of a matrix by means of structured random sampling has been consistently efficient in its extensive empirical studies around the globe, but adequate formal support for this empirical phenomenon has been missing so…

Numerical Analysis · Mathematics 2016-07-21 Victor Pan , John Svadlenka , Liang Zhao

Assume we are given a sum of linear measurements of $s$ different rank-$r$ matrices of the form $y = \sum_{k=1}^{s} \mathcal{A}_k ({X}_k)$. When and under which conditions is it possible to extract (demix) the individual matrices ${X}_k$…

Information Theory · Computer Science 2017-03-30 Thomas Strohmer , Ke Wei

This paper considers the problem of matrix completion when some number of the columns are completely and arbitrarily corrupted, potentially by a malicious adversary. It is well-known that standard algorithms for matrix completion can return…

Machine Learning · Statistics 2016-04-26 Yudong Chen , Huan Xu , Constantine Caramanis , Sujay Sanghavi

Suppose we are given a matrix that is formed by adding an unknown sparse matrix to an unknown low-rank matrix. Our goal is to decompose the given matrix into its sparse and low-rank components. Such a problem arises in a number of…

Optimization and Control · Mathematics 2011-08-09 Venkat Chandrasekaran , Sujay Sanghavi , Pablo A. Parrilo , Alan S. Willsky

Semidefinite programs (SDPs) often arise in relaxations of some NP-hard problems, and if the solution of the SDP obeys certain rank constraints, the relaxation will be tight. Decomposition methods based on chordal sparsity have already been…

Optimization and Control · Mathematics 2020-09-17 Jared Miller , Yang Zheng , Biel Roig-Solvas , Mario Sznaier , Antonis Papachristodoulou