English
Related papers

Related papers: Low-Rank Principal Eigenmatrix Analysis

200 papers

Based on a new atomic norm, we propose a new convex formulation for sparse matrix factorization problems in which the number of nonzero elements of the factors is assumed fixed and known. The formulation counts sparse PCA with multiple…

Machine Learning · Statistics 2014-12-05 Emile Richard , Guillaume Obozinski , Jean-Philippe Vert

Principal component analysis (PCA), the most popular dimension-reduction technique, has been used to analyze high-dimensional data in many areas. It discovers the homogeneity within the data and creates a reduced feature space to capture as…

Methodology · Statistics 2026-03-24 Daning Bi , Le Chang , Yanrong Yang

Sparse principal component analysis (PCA) and sparse canonical correlation analysis (CCA) are two essential techniques from high-dimensional statistics and machine learning for analyzing large-scale data. Both problems can be formulated as…

Machine Learning · Statistics 2019-03-28 Shixiang Chen , Shiqian Ma , Lingzhou Xue , Hui Zou

Robust principal component analysis (RPCA) can recover low-rank matrices when they are corrupted by sparse noises. In practice, many matrices are, however, of high-rank and hence cannot be recovered by RPCA. We propose a novel method called…

Machine Learning · Computer Science 2019-04-19 Jicong Fan , Tommy W. S. Chow

Sparse versions of principal component analysis (PCA) have imposed themselves as simple, yet powerful ways of selecting relevant features of high-dimensional data in an unsupervised manner. However, when several sparse principal components…

Machine Learning · Statistics 2019-05-22 Charles Bouveyron , Pierre Latouche , Pierre-Alexandre Mattei

We propose a novel linear discriminant analysis approach for the classification of high-dimensional matrix-valued data that commonly arises from imaging studies. Motivated by the equivalence of the conventional linear discriminant analysis…

Methodology · Statistics 2019-05-06 Wei Hu , Weining Shen , Hua Zhou , Dehan Kong

Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.…

Machine Learning · Computer Science 2026-05-05 Mario Sayde , Christopher Khater , Jihad Fahs , Ibrahim Abou-Faycal

This paper proposes a probabilistic model of subspaces based on the probabilistic principal component analysis (PCA). Given a sample of vectors in the embedding space -- commonly known as a snapshot matrix -- this method uses quantities…

Computational Engineering, Finance, and Science · Computer Science 2025-10-07 Akash Yadav , Ruda Zhang

Low-rank approximation of a matrix by means of structured random sampling has been consistently efficient in its extensive empirical studies around the globe, but adequate formal support for this empirical phenomenon has been missing so…

Numerical Analysis · Mathematics 2016-07-21 Victor Pan , John Svadlenka , Liang Zhao

Multivariate binary data is becoming abundant in current biological research. Logistic principal component analysis (PCA) is one of the commonly used tools to explore the relationships inside a multivariate binary data set by exploiting the…

Methodology · Statistics 2020-10-15 Yipeng Song , Johan A. Westerhuis , Age K. Smilde

In many applications that require matrix solutions of minimal rank, the underlying cost function is non-convex leading to an intractable, NP-hard optimization problem. Consequently, the convex nuclear norm is frequently used as a surrogate…

Machine Learning · Computer Science 2014-08-12 David Wipf

In many applications that require matrix solutions of minimal rank, the underlying cost function is non-convex leading to an intractable, NP-hard optimization problem. Consequently, the convex nuclear norm is frequently used as a surrogate…

Machine Learning · Statistics 2012-07-11 David Wipf

In this paper, we study the problem of decomposing a superposition of a low-rank matrix and a sparse matrix when a relatively few linear measurements are available. This problem arises in many data processing tasks such as aligning multiple…

Information Theory · Computer Science 2012-03-01 Arvind Ganesh , Kerui Min , John Wright , Yi Ma

In the course of the last century, Principal Component Analysis (PCA) have become one of the pillars of modern scientific methods. Although PCA is normally addressed as a statistical tool aiming at finding orthogonal directions on which the…

Statistics Theory · Mathematics 2019-07-30 Yariv Aizenbud , Barak Sober

Non-gaussian component analysis (NGCA) introduced in offered a method for high dimensional data analysis allowing for identifying a low-dimensional non-Gaussian component of the whole distribution in an iterative and structure adaptive way.…

Statistics Theory · Mathematics 2009-04-24 Elmar Diederichs , Anatoli Juditsky , Vladimir Spokoiny , Christof Schuette

Principal component analysis (PCA) is a statistical technique commonly used in multivariate data analysis. However, PCA can be difficult to interpret and explain since the principal components (PCs) are linear combinations of the original…

Mathematical Software · Computer Science 2013-12-24 W. Liu , H. Zhang , D. Tao , Y. Wang , K. Lu

Robust principal component analysis (RPCA) has been widely used for recovering low-rank matrices in many data mining and machine learning problems. It separates a data matrix into a low-rank part and a sparse part. The convex approach has…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Chong Peng , Zhao Kang , Qiang Chen

Principal Component Analysis (PCA) finds the best linear representation of data, and is an indispensable tool in many learning and inference tasks. Classically, principal components of a dataset are interpreted as the directions that…

Optimization and Control · Mathematics 2019-12-24 Raphael A. Hauser , Armin Eftekhari

Principal component analysis (PCA) is a well-established tool in machine learning and data processing. The principal axes in PCA were shown to be equivalent to the maximum marginal likelihood estimator of the factor loading matrix in a…

Methodology · Statistics 2019-10-25 Mengyang Gu , Weining Shen

Principal component regression (PCR) is a two-stage procedure: the first stage performs principal component analysis (PCA) and the second stage constructs a regression model whose explanatory variables are replaced by principal components…

Machine Learning · Statistics 2021-11-22 Shuichi Kawano