English
Related papers

Related papers: Fast Multilevel Algorithms for Compressive Princip…

200 papers

This paper considers the problem of recovery of a low-rank matrix in the situation when most of its entries are not observed and a fraction of observed entries are corrupted. The observations are noisy realizations of the sum of a low rank…

Statistics Theory · Mathematics 2016-07-05 Olga Klopp , Karim Lounici , Alexandre B. Tsybakov

We consider the dimensionality-reduction problem (finding a subspace approximation of observed data) for contaminated data in the high dimensional regime, where the number of observations is of the same magnitude as the number of variables…

Machine Learning · Statistics 2010-05-14 Huan Xu , Constantine Caramanis , Shie Mannor

Robust PCA is a widely used statistical procedure to recover a underlying low-rank matrix with grossly corrupted observations. This work considers the problem of robust PCA as a nonconvex optimization problem on the manifold of low-rank…

Machine Learning · Statistics 2017-09-04 Teng Zhang , Yi Yang

Principal component analysis (PCA) requires the computation of a low-rank approximation to a matrix containing the data being analyzed. In many applications of PCA, the best possible accuracy of any rank-deficient approximation is at most a…

Computation · Statistics 2010-06-04 Vladimir Rokhlin , Arthur Szlam , Mark Tygert

Recent advances have shown that implicit bias of gradient descent on over-parameterized models enables the recovery of low-rank matrices from linear measurements, even with no prior knowledge on the intrinsic rank. In contrast, for robust…

Machine Learning · Computer Science 2020-06-17 Chong You , Zhihui Zhu , Qing Qu , Yi Ma

Principal Component Analysis (PCA) is a dimension reduction technique. It produces inconsistent estimators when the dimensionality is moderate to high, which is often the problem in modern large-scale applications where algorithm…

Computation · Statistics 2016-01-29 Qiaoya Zhang , Yiyuan She

We study the robust recovery of a low-rank matrix from sparsely and grossly corrupted Gaussian measurements, with no prior knowledge on the intrinsic rank. We consider the robust matrix factorization approach. We employ a robust $\ell_1$…

Optimization and Control · Mathematics 2021-10-27 Lijun Ding , Liwei Jiang , Yudong Chen , Qing Qu , Zhihui Zhu

The stable principal component pursuit (SPCP) is a non-smooth convex optimization problem, the solution of which enables one to reliably recover the low rank and sparse components of a data matrix which is corrupted by a dense noise matrix,…

Optimization and Control · Mathematics 2015-02-10 Necdet Serhat Aybat , Garud Iyengar

Principal component regression (PCR) is a two-stage procedure: the first stage performs principal component analysis (PCA) and the second stage constructs a regression model whose explanatory variables are replaced by principal components…

Machine Learning · Statistics 2021-11-22 Shuichi Kawano

In this paper we present a comprehensive framework for learning robust low-rank representations by combining and extending recent ideas for learning fast sparse coding regressors with structured non-convex optimization techniques. This…

Machine Learning · Computer Science 2012-10-01 Pablo Sprechmann , Alex M. Bronstein , Guillermo Sapiro

We consider the problem of learning a linear subspace from data corrupted by outliers. Classical approaches are typically designed for the case in which the subspace dimension is small relative to the ambient dimension. Our approach works…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Manolis C. Tsakiris , Rene Vidal

We propose a compressive sensing algorithm that exploits geometric properties of images to recover images of high quality from few measurements. The image reconstruction is done by iterating the two following steps: 1) estimation of normal…

Computer Vision and Pattern Recognition · Computer Science 2015-06-11 Virginia Estellers , Jean-Philippe Thiran , Xavier Bresson

Tensor robust principal component analysis (RPCA), which seeks to separate a low-rank tensor from its sparse corruptions, has been crucial in data science and machine learning where tensor structures are becoming more prevalent. While…

Machine Learning · Statistics 2022-12-23 Harry Dong , Megna Shah , Sean Donegan , Yuejie Chi

In many applications that require matrix solutions of minimal rank, the underlying cost function is non-convex leading to an intractable, NP-hard optimization problem. Consequently, the convex nuclear norm is frequently used as a surrogate…

Machine Learning · Computer Science 2014-08-12 David Wipf

In many applications that require matrix solutions of minimal rank, the underlying cost function is non-convex leading to an intractable, NP-hard optimization problem. Consequently, the convex nuclear norm is frequently used as a surrogate…

Machine Learning · Statistics 2012-07-11 David Wipf

In sparse principal component analysis we are given noisy observations of a low-rank matrix of dimension $n\times p$ and seek to reconstruct it under additional sparsity assumptions. In particular, we assume here each of the principal…

Statistics Theory · Mathematics 2016-04-27 Yash Deshpande , Andrea Montanari

We revisit the problem of robust principal component analysis with features acting as prior side information. To this aim, a novel, elegant, non-convex optimization approach is proposed to decompose a given observation matrix into a…

Machine Learning · Statistics 2017-09-15 Niannan Xue , Jiankang Deng , Yannis Panagakis , Stefanos Zafeiriou

The stable principal component pursuit (SPCP) problem is a non-smooth convex optimization problem, the solution of which has been shown both in theory and in practice to enable one to recover the low rank and sparse components of a matrix…

Optimization and Control · Mathematics 2015-03-19 Necdet Serhat Aybat , Donald Goldfarb , Garud Iyengar

Principal component analysis (PCA) is a widely used unsupervised dimensionality reduction technique in machine learning, applied across various fields such as bioinformatics, computer vision and finance. However, when the response variables…

Applications · Statistics 2025-06-25 Theodosios Papazoglou , Guosheng Yin

Robust low-rank matrix completion (RMC), or robust principal component analysis with partially observed data, has been studied extensively for computer vision, signal processing and machine learning applications. This problem aims to…

Machine Learning · Computer Science 2021-06-09 Minhui Huang , Shiqian Ma , Lifeng Lai
‹ Prev 1 3 4 5 6 7 10 Next ›