English
Related papers

Related papers: Bayesian inference for PCA and MUSIC algorithms wi…

200 papers

We present a new straightforward principal component analysis (PCA) method based on the diagonalization of the weighted variance-covariance matrix through two spectral decomposition methods: power iteration and Rayleigh quotient iteration.…

Instrumentation and Methods for Astrophysics · Physics 2014-12-16 Ludovic Delchambre

Principal Component Analysis (PCA) is a well-known multivariate technique used to decorrelate a set of vectors. PCA has been extensively applied in the past to the classification of stellar and galaxy spectra. Here we apply PCA to the…

Astrophysics · Physics 2007-05-23 I. Ferreras , B. Rogers , O. Lahav , .

The design of informatively rich input signals is essential for accurate system identification, yet classical Fisher-information-based methods are inherently local and often inadequate in the presence of significant model uncertainty and…

Statistics Theory · Mathematics 2025-12-15 Piotr Bania , Anna Wójcik

Principal Component Analysis (PCA) minimizes the reconstruction error given a class of linear models of fixed component dimensionality. Probabilistic PCA adds a probabilistic structure by learning the probability distribution of the PCA…

Machine Learning · Computer Science 2022-09-20 Vanessa Böhm , Uroš Seljak

This paper derives fundamental limits on the performance of compressive classification when the source is a mixture of Gaussians. It provides an asymptotic analysis of a Bhattacharya based upper bound on the misclassification probability…

Information Theory · Computer Science 2014-01-28 Hugo Reboredo , Francesco Renna , Robert Calderbank , Miguel R. D. Rodrigues

This paper addresses the problem of separating spectral sources which are linearly mixed with unknown proportions. The main difficulty of the problem is to ensure the full additivity (sum-to-one) of the mixing coefficients and…

Methodology · Statistics 2010-08-30 Nicolas Dobigeon , Said Moussaoui , Jean-Yves Tourneret , Cedric Carteret

When recovering an unknown signal from noisy measurements, the computational difficulty of performing optimal Bayesian MMSE (minimum mean squared error) inference often necessitates the use of maximum a posteriori (MAP) inference, a special…

Machine Learning · Statistics 2016-09-23 Madhu Advani , Surya Ganguli

Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In…

Machine Learning · Statistics 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

An algorithm called MUSIC-like algorithm was originally proposed as an alternative method to the MUltiple SIgnal Classification (MUSIC) algorithm for direction-of-arrival (DOA) estimation. Without requiring explicit model order estimation,…

Signal Processing · Electrical Eng. & Systems 2018-11-20 Narong Borijindargoon , Boon Poh Ng

Computing the conditional mode of a distribution, better known as the $\mathit{maximum\ a\ posteriori}$ (MAP) assignment, is a fundamental task in probabilistic inference. However, MAP estimation is generally intractable, and remains hard…

Machine Learning · Computer Science 2026-01-23 Matthew Shorvon , Frederik Mallmann-Trenn , David S. Watson

Principal component analysis (PCA) is a well-established tool in machine learning and data processing. The principal axes in PCA were shown to be equivalent to the maximum marginal likelihood estimator of the factor loading matrix in a…

Methodology · Statistics 2019-10-25 Mengyang Gu , Weining Shen

Commonly used in computer vision and other applications, robust PCA represents an algorithmic attempt to reduce the sensitivity of classical PCA to outliers. The basic idea is to learn a decomposition of some data matrix of interest into…

Computer Vision and Pattern Recognition · Computer Science 2016-10-10 Tae-Hyun Oh , Yasuyuki Matsushita , In So Kweon , David Wipf

Principal Component Analysis (PCA) is one of the most commonly used statistical methods for data exploration, and for dimensionality reduction wherein the first few principal components account for an appreciable proportion of the…

Methodology · Statistics 2024-01-11 Caren Marzban , Ulvi Yurtsever , Michael Richman

The network traffic matrix is widely used in network operation and management. It is therefore of crucial importance to analyze the components and the structure of the network traffic matrix, for which several mathematical approaches such…

Networking and Internet Architecture · Computer Science 2015-03-19 Zhe Wang , Kai Hu , Ke Xu , Baolin Yin , Xiaowen Dong

Independent component analysis (ICA) studies mixtures of independent latent sources. An ICA model is identifiable if the mixing can be recovered uniquely. It is well-known that ICA is identifiable if and only if at most one source is…

Statistics Theory · Mathematics 2024-01-29 Kexin Wang , Anna Seigal

We analyze the Accelerated Noisy Power Method, an algorithm for Principal Component Analysis in the setting where only inexact matrix-vector products are available, which can arise for instance in decentralized PCA. While previous works…

Machine Learning · Statistics 2026-02-04 Pierre Aguié , Mathieu Even , Laurent Massoulié

Principal Component analysis (PCA) is a useful statistical technique that is commonly used for multivariate analysis of correlated variables. It is usually applied as a dimension reduction method: the top principal components (PCs)…

Principal component analysis (PCA) is a powerful method that can identify patterns in large, complex data sets by constructing low-dimensional order parameters from higher-dimensional feature vectors. There are increasing efforts to use…

Mesoscale and Nanoscale Physics · Physics 2025-11-03 C. J. O. Reichhardt , D. McDermott , C. Reichhardt

We propose using Probabilistic Cellular Automata (PCA) to address inverse problems with the Bayesian approach. In particular, we use PCA to sample from an approximation of the posterior distribution. The peculiar feature of PCA is their…

Computation · Statistics 2026-03-24 Danilo Costarelli , Michele Piconi , Alessio Troiani

Principal component analysis (PCA) is a dimensionality reduction method in data analysis that involves diagonalizing the covariance matrix of the dataset. Recently, quantum algorithms have been formulated for PCA based on diagonalizing a…

Quantum Physics · Physics 2022-10-26 Max Hunter Gordon , M. Cerezo , Lukasz Cincio , Patrick J. Coles