English
Related papers

Related papers: Non-Gaussian Component Analysis with Log-Density G…

200 papers

Non-negative sparse coding is a method for decomposing multivariate data into non-negative sparse components. In this paper we briefly describe the motivation behind this type of data representation and its relation to standard sparse…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Patrik O. Hoyer

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

We design algorithms for Robust Principal Component Analysis (RPCA) which consists in decomposing a matrix into the sum of a low rank matrix and a sparse matrix. We propose a deep unrolled algorithm based on an accelerated alternating…

Signal Processing · Electrical Eng. & Systems 2023-07-13 Elizabeth Z. C. Tan , Caroline Chaux , Emmanuel Soubies , Vincent Y. F. Tan

Principal component analysis (PCA) is a commonly used pattern analysis method that maps high-dimensional data into a lower-dimensional space maximizing the data variance, that results in the promotion of separability of data. Inspired by…

Signal Processing · Electrical Eng. & Systems 2022-06-20 Xiaoqiang Hua , Yusuke Ono , Linyu Peng , Yuting Xu

Probabilistic Component Latent Analysis (PLCA) is a statistical modeling method for feature extraction from non-negative data. It has been fruitfully applied to various research fields of information retrieval. However, the EM-solved…

Methodology · Statistics 2017-03-16 D. Cazau , G. Nuel

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on…

Methodology · Statistics 2019-11-20 Yixuan Qiu , Jing Lei , Kathryn Roeder

Learning a good distance metric in feature space potentially improves the performance of the KNN classifier and is useful in many real-world applications. Many metric learning algorithms are however based on the point estimation of a…

Computer Vision and Pattern Recognition · Computer Science 2016-04-11 Dong Wang , Xiaoyang Tan

Stochastic Gradient Algorithms (SGAs) are ubiquitous in computational statistics, machine learning and optimisation. Recent years have brought an influx of interest in SGAs, and the non-asymptotic analysis of their bias is by now…

Machine Learning · Statistics 2021-10-01 Mateusz B. Majka , Marc Sabate-Vidales , Łukasz Szpruch

Generalized correlation analysis (GCA) is concerned with uncovering linear relationships across multiple datasets. It generalizes canonical correlation analysis that is designed for two datasets. We study sparse GCA when there are…

Machine Learning · Statistics 2023-02-07 Sheng Gao , Zongming Ma

Accurate representation of non-Gaussian distributions of quantities of interest in nonlinear dynamical systems is critical for estimation, control, and decision-making, but can be challenging when forward propagations are expensive to carry…

Optimization and Control · Mathematics 2026-04-13 Aaron R. Liao , Kenshiro Oguri , Michele D. Carpenter

Commonly used in computer vision and other applications, robust PCA represents an algorithmic attempt to reduce the sensitivity of classical PCA to outliers. The basic idea is to learn a decomposition of some data matrix of interest into…

Computer Vision and Pattern Recognition · Computer Science 2016-10-10 Tae-Hyun Oh , Yasuyuki Matsushita , In So Kweon , David Wipf

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an…

Machine Learning · Statistics 2011-06-23 Alfredo A. Kalaitzis , Neil D. Lawrence

Principal Component Analysis (PCA) is a workhorse of modern data science. While PCA assumes the data conforms to Euclidean geometry, for specific data types, such as hierarchical and cyclic data structures, other spaces are more…

Machine Learning · Statistics 2024-07-11 Puoya Tabaghi , Michael Khanzadeh , Yusu Wang , Sivash Mirarab

Principal Component Analysis (PCA) is a powerful and popular dimensionality reduction technique. However, due to its linear nature, it often fails to capture the complex underlying structure of real-world data. While Kernel PCA (kPCA)…

Machine Learning · Computer Science 2026-02-05 Thomas Uriot , Elise Chung

Sparse principal component analysis (PCA) and sparse canonical correlation analysis (CCA) are two essential techniques from high-dimensional statistics and machine learning for analyzing large-scale data. Both problems can be formulated as…

Machine Learning · Statistics 2019-03-28 Shixiang Chen , Shiqian Ma , Lingzhou Xue , Hui Zou

Principal component analysis (PCA) is very popular to perform dimension reduction. The selection of the number of significant components is essential but often based on some practical heuristics depending on the application. Only few works…

Machine Learning · Statistics 2017-09-19 Clément Elvira , Pierre Chainais , Nicolas Dobigeon

Data processing constitutes a critical component of high-contrast exoplanet imaging. Its role is almost as important as the choice of a coronagraph or a wavefront control system, and it is intertwined with the chosen observing strategy.…

Instrumentation and Methods for Astrophysics · Physics 2016-04-20 C. A. Gomez Gonzalez , O. Absil , P. -A. Absil , M. Van Droogenbroeck , D. Mawet , J. Surdej

Functional principal component analysis (FPCA) could become invalid when data involve non-Gaussian features. Therefore, we aim to develop a general FPCA method to adapt to such non-Gaussian cases. A Kenall's $\tau$ function, which possesses…

Methodology · Statistics 2021-08-18 Rou Zhong , Shishi Liu , Haocheng Li , Jingxiao Zhang

Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, including kernel and deep…

Machine Learning · Computer Science 2016-02-09 Tomer Michaeli , Weiran Wang , Karen Livescu

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf