English
Related papers

Related papers: Leveraging Subspace Information for Low-Rank Matri…

200 papers

Low-rank matrix approximation play a ubiquitous role in various applications such as image processing, signal processing, and data analysis. Recently, random algorithms of low-rank matrix approximation have gained widespread adoption due to…

Numerical Analysis · Mathematics 2024-04-29 Weijie Shen , Weiwei Xu , Lei Zhu

We study Sigma-Delta quantization methods coupled with appropriate reconstruction algorithms for digitizing randomly sampled low-rank matrices. We show that the reconstruction error associated with our methods decays polynomially with the…

Information Theory · Computer Science 2018-04-18 Eric Lybrand , Rayan Saab

Recently there is a line of research work proposing to employ Spectral Clustering (SC) to segment (group){Throughout the paper, we use segmentation, clustering, and grouping, and their verb forms, interchangeably.} high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2010-10-11 Yuzhao Ni , Ju Sun , Xiaotong Yuan , Shuicheng Yan , Loong-Fah Cheong

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

Statistics Theory · Mathematics 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

We consider the problem of learning a low-rank matrix, constrained to lie in a linear subspace, and introduce a novel factorization for modeling such matrices. A salient feature of the proposed factorization scheme is it decouples the…

Machine Learning · Statistics 2018-06-18 Pratik Jawanpuria , Bamdev Mishra

Random projection has been widely used in data classification. It maps high-dimensional data into a low-dimensional subspace in order to reduce the computational cost in solving the related optimization problem. While previous studies are…

Machine Learning · Computer Science 2014-02-24 Lijun Zhang , Mehrdad Mahdavi , Rong Jin , Tianbao Yang , Shenghuo Zhu

A novel algorithm for the recovery of low-rank matrices acquired via compressive linear measurements is proposed and analyzed. The algorithm, a variation on the iterative hard thresholding algorithm for low-rank recovery, is designed to…

Numerical Analysis · Mathematics 2018-10-30 Simon Foucart , Srinivas Subramanian

We propose a low-rank transformation-learning framework to robustify subspace clustering. Many high-dimensional data, such as face images and motion sequences, lie in a union of low-dimensional subspaces. The subspace clustering problem has…

Computer Vision and Pattern Recognition · Computer Science 2013-08-02 Qiang Qiu , Guillermo Sapiro

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino

We introduce a "learning-based" algorithm for the low-rank decomposition problem: given an $n \times d$ matrix $A$, and a parameter $k$, compute a rank-$k$ matrix $A'$ that minimizes the approximation loss $\|A-A'\|_F$. The algorithm uses a…

Machine Learning · Computer Science 2019-10-31 Piotr Indyk , Ali Vakilian , Yang Yuan

This paper describes a suite of algorithms for constructing low-rank approximations of an input matrix from a random linear image of the matrix, called a sketch. These methods can preserve structural properties of the input matrix, such as…

Numerical Analysis · Computer Science 2018-01-03 Joel A. Tropp , Alp Yurtsever , Madeleine Udell , Volkan Cevher

Data reconstruction attacks on trained neural networks aim to recover the data on which the network has been trained and pose a significant threat to privacy, especially if the training dataset contains sensitive information. Here, we…

Machine Learning · Computer Science 2026-05-08 Edward Tansley , Roy Makhlouf , Estelle Massart , Coralia Cartis

Restricted isometry property (RIP), essentially stating that the linear measurements are approximately norm-preserving, plays a crucial role in studying low-rank matrix recovery problem. However, RIP fails in the robust setting, when a…

Machine Learning · Computer Science 2021-09-29 Jianhao Ma , Salar Fattahi

In this paper we address the problem of recovering a matrix, with inherent low rank structure, from its lower dimensional projections. This problem is frequently encountered in wide range of areas including pattern recognition, wireless…

Numerical Analysis · Computer Science 2013-12-25 Anupriya Gogna , Ankita Shukla , Angshul Majumdar

In this survey, we provide a detailed review of recent advances in the recovery of continuous domain multidimensional signals from their few non-uniform (multichannel) measurements using structured low-rank matrix completion formulation.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Mathews Jacob , Merry P. Mani , Jong Chul Ye

Recovery of low-rank matrices has recently seen significant activity in many areas of science and engineering, motivated by recent theoretical results for exact reconstruction guarantees and interesting practical applications. A number of…

Machine Learning · Statistics 2011-09-12 S. Derin Babacan , Martin Luessi , Rafael Molina , Aggelos K. Katsaggelos

We introduce a structured low rank matrix completion algorithm to recover a series of images from their under-sampled measurements, where the signal along the parameter dimension at every pixel is described by a linear combination of…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Arvind Balachandrasekaran , Vincent Magnotta , Mathews Jacob

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

Affine rank minimization algorithms typically rely on calculating the gradient of a data error followed by a singular value decomposition at every iteration. Because these two steps are expensive, heuristic approximations are often used to…

Optimization and Control · Mathematics 2013-06-04 Stephen Becker , Volkan Cevher , Anastasios Kyrillidis

Radio maps are important enablers for many applications in wireless networks, ranging from network planning and optimization to fingerprint based localization. Sampling the complete map is prohibitively expensive in practice, so methods for…

Signal Processing · Electrical Eng. & Systems 2020-01-27 Daniel Schäufele , Renato L. G. Cavalcante , Slawomir Stanczak