English
Related papers

Related papers: Graph Regularized PCA

200 papers

We propose graph-based predictable feature analysis (GPFA), a new method for unsupervised learning of predictable features from high-dimensional time series, where high predictability is understood very generically as low variance in the…

Machine Learning · Computer Science 2017-05-12 Björn Weghenkel , Asja Fischer , Laurenz Wiskott

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on…

Methodology · Statistics 2019-11-20 Yixuan Qiu , Jing Lei , Kathryn Roeder

Sparse versions of principal component analysis (PCA) have imposed themselves as simple, yet powerful ways of selecting relevant features of high-dimensional data in an unsupervised manner. However, when several sparse principal components…

Machine Learning · Statistics 2019-05-22 Charles Bouveyron , Pierre Latouche , Pierre-Alexandre Mattei

Probabilistic Circuits (PCs) are a promising avenue for probabilistic modeling. They combine advantages of probabilistic graphical models (PGMs) with those of neural networks (NNs). Crucially, however, they are tractable probabilistic…

Machine Learning · Computer Science 2021-06-07 Anji Liu , Guy Van den Broeck

Most high-dimensional matrix recovery problems are studied under the assumption that the target matrix has certain intrinsic structures. For image data related matrix recovery problems, approximate low-rankness and smoothness are the two…

Machine Learning · Statistics 2021-04-08 Long Feng , Junhui Wang

We study the high-dimensional inference of a rank-one signal corrupted by sparse noise. The noise is modelled as the adjacency matrix of a weighted undirected graph with finite average connectivity in the large size limit. Using the replica…

Machine Learning · Statistics 2025-11-18 Urte Adomaityte , Gabriele Sicuro , Pierpaolo Vivo

Principal component analysis (PCA) has achieved great success in unsupervised learning by identifying covariance correlations among features. If the data collection fails to capture the covariance information, PCA will not be able to…

Computational Physics · Physics 2021-08-24 Ziming Liu , Sitian Qian , Yixuan Wang , Yuxuan Yan , Tianyi Yang

We present a computer-assisted approach to coarse-graining the evolutionary dynamics of a system of nonidentical oscillators coupled through a (fixed) network structure. The existence of a spectral gap for the coupling network graph…

Statistical Mechanics · Physics 2015-05-28 Karthikeyan Rajendran , Ioannis G. Kevrekidis

Sparse Principal Component Analysis (SPCA) is an important technique for high-dimensional data analysis, improving interpretability by imposing sparsity on principal components. However, existing methods often fail to simultaneously…

Machine Learning · Computer Science 2026-03-03 Difei Cheng , Qiao Hu

Principal component analysis (PCA) is arguably the most popular tool in multivariate exploratory data analysis. In this paper, we consider the question of how to handle heterogeneous variables that include continuous, binary, and ordinal.…

Machine Learning · Statistics 2018-08-24 Clifford Anderson-Bergman , Tamara G. Kolda , Kina Kincher-Winoto

Gaussian graphical models represent the underlying graph structure of conditional dependence between random variables which can be determined using their partial correlation or precision matrix. In a high-dimensional setting, the precision…

Applications · Statistics 2016-05-24 Adria Caballe , Natalia Bochkina , Claus Mayer

In the field of data mining, how to deal with high-dimensional data is an inevitable problem. Unsupervised feature selection has attracted more and more attention because it does not rely on labels. The performance of spectral-based…

Machine Learning · Computer Science 2021-01-01 Zhengxin Li , Feiping Nie , Jintang Bian , Xuelong Li

We study the robust principal component analysis (RPCA) problem in a distributed setting. The goal of RPCA is to find an underlying low-rank estimation for a raw data matrix when the data matrix is subject to the corruption of gross sparse…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Wenda Chu

Principal component analysis (PCA) is a key tool in the field of data dimensionality reduction. However, some applications involve heterogeneous data that vary in quality due to noise characteristics associated with each data sample.…

Machine Learning · Statistics 2026-03-18 Javier Salazar Cavazos , Jeffrey A. Fessler , Laura Balzano

In datasets where the number of parameters is fixed and the number of samples is large, principal component analysis (PCA) is a powerful dimension reduction tool. However, in many contemporary datasets, when the number of parameters is…

Probability · Mathematics 2019-02-14 Enrico Au-Yeung , Greg Zanotti

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

Machine Learning · Statistics 2023-08-07 Fan Chen , Karl Rohe

In the context of cancer, internal "checkerboard" structures are normally found in the matrices of gene expression data, which correspond to genes that are significantly up- or down-regulated in patients with specific types of tumors. In…

Genomics · Quantitative Biology 2019-01-23 Jin-Xing Liu , Chun-Mei Feng , Xiang-Zhen Kong , Yong Xu

This paper proposes a novel graph-based framework for robust and interpretable multiclass fault diagnosis in rotating machinery. The method integrates entropy-optimized signal segmentation, time-frequency feature extraction, and…

Artificial Intelligence · Computer Science 2025-08-08 Moirangthem Tiken Singh

We study efficient algorithms for Sparse PCA in standard statistical models (spiked covariance in its Wishart form). Our goal is to achieve optimal recovery guarantees while being resilient to small perturbations. Despite a long history of…

Machine Learning · Computer Science 2020-11-13 Tommaso d'Orsi , Pravesh K. Kothari , Gleb Novikov , David Steurer

Recently, several data analytic techniques based on connection graph laplacian (CGL) ideas have appeared in the literature. At this point, the properties of these methods are starting to be understood in the setting where the data is…

Statistics Theory · Mathematics 2014-05-27 Noureddine El Karoui , Hau-tieng Wu