English
Related papers

Related papers: Efficient Algorithms for Robust and Stable Princip…

200 papers

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise. The maximum likelihood solution for the model is an eigenvalue problem on the…

Machine Learning · Computer Science 2012-06-22 Alfredo Kalaitzis , Neil Lawrence

The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem…

Information Theory · Computer Science 2013-12-23 Megasthenis Asteris , Dimitris S. Papailiopoulos , George N. Karystinos

We focus on the robust principal component analysis (RPCA) problem, and review a range of old and new convex formulations for the problem and its variants. We then review dual smoothing and level set techniques in convex optimization,…

Machine Learning · Statistics 2016-03-02 Aleksandr Y. Aravkin , Stephen Becker

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd

In the context of online Robust Principle Component Analysis (RPCA) for the video foreground-background separation, we propose a compressive online RPCA with optical flow that separates recursively a sequence of frames into sparse…

Computer Vision and Pattern Recognition · Computer Science 2017-10-26 Srivatsa Prativadibhayankaram , Huynh Van Luong , Thanh-Ha Le , Andre Kaup

Sparse principal component analysis (SPCA) addresses the poor interpretability and variable redundancy often encountered by principal component analysis (PCA) in high-dimensional data. However, SPCA typically imposes uniform penalties on…

Machine Learning · Statistics 2026-03-17 Ying Hu , Hu Yang

Low-rank and sparse decomposition based methods find their use in many applications involving background modeling such as clutter suppression and object tracking. While Robust Principal Component Analysis (RPCA) has achieved great success…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shoaib Imran , Muhammad Tahir , Zubair Khalid , Momin Uppal

The best pair problem aims to find a pair of points that minimize the distance between two disjoint sets. In this paper, we formulate the classical robust principal component analysis (RPCA) as the best pair; which was not considered…

Optimization and Control · Mathematics 2020-12-02 Aritra Dutta , Filip Hanzely , Jingwei Liang , Peter Richtárik

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an…

Machine Learning · Statistics 2011-06-23 Alfredo A. Kalaitzis , Neil D. Lawrence

PCA is one of the most widely used dimension reduction techniques. A related easier problem is "subspace learning" or "subspace estimation". Given relatively clean data, both are easily solved via singular value decomposition (SVD). The…

Information Theory · Computer Science 2020-06-25 Namrata Vaswani , Thierry Bouwmans , Sajid Javed , Praneeth Narayanamurthy

We consider the problem of synthetic aperture radar (SAR) imaging and motion estimation of complex scenes. By complex we mean scenes with multiple targets, stationary and in motion. We use the usual setup with one moving antenna emitting…

Information Theory · Computer Science 2015-03-20 Liliana Borcea , Thomas Callaghan , George Papanicolaou

Sparse principal component analysis with global support (SPCAgs), is the problem of finding the top-$r$ leading principal components such that all these principal components are linear combinations of a common subset of at most $k$…

Optimization and Control · Mathematics 2022-05-11 Santanu S. Dey , Marco Molinaro , Guanyi Wang

One of the key challenges in sensor networks is the extraction of information by fusing data from a multitude of distinct, but possibly unreliable sensors. Recovering information from the maximum number of dependable sensors while…

Machine Learning · Statistics 2015-05-20 Vassilis Kekatos , Georgios B. Giannakis

We study robust PCA for the fully observed setting, which is about separating a low rank matrix $\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from their sum $\boldsymbol{D}=\boldsymbol{L}+\boldsymbol{S}$. In this paper, a new…

Information Theory · Computer Science 2021-06-29 HanQin Cai , Jian-Feng Cai , Ke Wei

Robust Principal Component Analysis (PCA) has received massive attention in recent years. It aims to recover a low-rank matrix and a sparse matrix from their sum. This paper proposes a novel nonconvex Robust PCA algorithm, coined Riemannian…

Machine Learning · Statistics 2023-02-28 Keaton Hamm , Mohamed Meskini , HanQin Cai

Recently the sparse representation based classification (SRC) has been proposed for robust face recognition (FR). In SRC, the testing image is coded as a sparse linear combination of the training samples, and the representation fidelity is…

Computer Vision and Pattern Recognition · Computer Science 2015-06-04 Meng Yang , Lei Zhang , Jian Yang , David Zhang

We perform a finite sample analysis of the detection levels for sparse principal components of a high-dimensional covariance matrix. Our minimax optimal test is based on a sparse eigenvalue statistic. Alas, computing this test is known to…

Statistics Theory · Mathematics 2014-01-30 Quentin Berthet , Philippe Rigollet

Natural scene character recognition is challenging due to the cluttered background, which is hard to separate from text. In this paper, we propose a novel method for robust scene character recognition. Specifically, we first use robust…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Zheng Zhang , Yong Xu , Cheng-Lin Liu

The implementation of conventional sparse principal component analysis (SPCA) on high-dimensional data sets has become a time consuming work. In this paper, a series of subspace projections are constructed efficiently by using Household QR…

Machine Learning · Statistics 2019-12-09 Cong Xu , Min Yang , Jin Zhang

We consider the dimensionality-reduction problem (finding a subspace approximation of observed data) for contaminated data in the high dimensional regime, where the number of observations is of the same magnitude as the number of variables…

Machine Learning · Statistics 2010-05-14 Huan Xu , Constantine Caramanis , Shie Mannor