English
Related papers

Related papers: Estimating Sparse Sources from Data Mixtures using…

200 papers

Traditional principal component analysis (PCA) is well known in high-dimensional data analysis, but it requires to express data by a matrix with observations to be continuous. To overcome the limitations, a new method called flexible PCA…

Methodology · Statistics 2021-08-17 Tonglin Zhang , Baijian Yang , Qianqian Song , Jing Su

This paper studies the principal component (PC) method-based estimation of weak factor models with sparse loadings. We uncover an intrinsic near-sparsity preservation property for the PC estimators of loadings, which comes from the…

Econometrics · Economics 2024-11-08 Jie Wei , Yonghui Zhang

The paper considers direction of arrival (DOA) estimation from long-term observations in a noisy environment. In such an environment the noise source might evolve, causing the stationary models to fail. Therefore a heteroscedastic Gaussian…

Signal Processing · Electrical Eng. & Systems 2017-11-13 Peter Gerstoft , Santosh Nannuru , Christoph F. Mecklenbräuker , Geert Leus

Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to…

Machine Learning · Computer Science 2016-11-01 Namrata Vaswani , Han Guo

Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to…

Machine Learning · Computer Science 2016-11-03 Namrata Vaswani , Han Guo

Sparse Canonical Correlation Analysis (SCCA) is a fundamental statistical tool for identifying linear relationships in high-dimensional, multi-view data. While minimax theory establishes an optimal sample complexity scaling additively with…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Mengchu Xu , Jian Wang , Yonina C. Eldar

Sparse Principal Component Analysis (SPCA) and Sparse Linear Regression (SLR) have a wide range of applications and have attracted a tremendous amount of attention in the last two decades as canonical examples of statistical problems in…

Statistics Theory · Mathematics 2018-11-27 Guy Bresler , Sung Min Park , Madalina Persu

Mixtures of probabilistic principal component analysis (MPPCA) is a well-known mixture model extension of principal component analysis (PCA). Similar to PCA, MPPCA assumes the data samples in each mixture contain homoscedastic noise.…

Methodology · Statistics 2023-01-27 Alec S. Xu , Laura Balzano , Jeffrey A. Fessler

Principal component analysis (PCA) is widely used for dimension reduction and embedding of real data in social network analysis, information retrieval, and natural language processing, etc. In this work we propose a fast randomized PCA…

Machine Learning · Computer Science 2018-10-17 Xu Feng , Yuyang Xie , Mingye Song , Wenjian Yu , Jie Tang

We introduce a novel statistic to probe the statistics of phases of Fourier modes in two-dimensions (2D) for weak lensing convergence field $\kappa$. This statistic contains completely independent information compared to that contained in…

Cosmology and Nongalactic Astrophysics · Physics 2022-10-12 D. Munshi , R. Takahashi , J. D. McEwen , T. D. Kitching , F. R. Bouchet

Recently a blind source separation model was suggested for spatial data together with an estimator based on the simultaneous diagonalisation of two scatter matrices. The asymptotic properties of this estimator are derived here and a new…

Statistics Theory · Mathematics 2020-09-01 François Bachoc , Marc G. Genton , Klaus Nordhausen , Anne Ruiz-Gazen , Joni Virta

This paper deals with a source separation strategy based on second-order statistics, namely, on data covariance matrices estimated at several lags. In general, ``blind'' approaches to source separation do not assume any knowledge on the…

Astrophysics · Physics 2009-11-10 L. Bedini , D. Herranz , E. Salerno , C. Baccigalupi , E. E. Kuruouglu , A. Tonazzini

Due to the rapid growth of smart agents such as weakly connected computational nodes and sensors, developing decentralized algorithms that can perform computations on local agents becomes a major research direction. This paper considers the…

Machine Learning · Computer Science 2021-02-09 Haishan Ye , Tong Zhang

The task of blind source separation (BSS) involves separating sources from a mixture without prior knowledge of the sources or the mixing system. Single-channel mixtures and non-linear mixtures are a particularly challenging problem in BSS.…

Signal Processing · Electrical Eng. & Systems 2025-07-24 Matthew B. Webster , Joonnyong Lee

In many scientific disciplines, the features of interest cannot be observed directly, so must instead be inferred from observed behaviour. Latent variable analyses are increasingly employed to systematise these inferences, and Principal…

We investigate the extent to which foreground cleaned CMB maps can be used to estimate the cosmological parameters at small scales. We use the SMICA method, a blind separation technique which works directly at the spectral level. In this…

Cosmology and Nongalactic Astrophysics · Physics 2019-04-17 C. Umiltà , J. F. Cardoso , K. Benabed , M. Le Jeune

Sparse PCA (SPCA) is a fundamental model in machine learning and data analytics, which has witnessed a variety of application areas such as finance, manufacturing, biology, healthcare. To select a prespecified-size principal submatrix from…

Machine Learning · Statistics 2020-08-31 Yongchun Li , Weijun Xie

Stationary subspace analysis (SSA) is a blind source separation framework that decomposes linearly mixed multivariate data into stationary and nonstationary components. We extend SSA to spatially indexed data by introducing spatial…

Methodology · Statistics 2026-05-20 Perttu Saarela , Klaus Nordhausen , Jaakko Pere , Anne M. Ruiz

This work obtains novel finite sample guarantees for Principal Component Analysis (PCA). These hold even when the corrupting noise is non-isotropic, and a part (or all of it) is data-dependent. Because of the latter, in general, the noise…

Machine Learning · Statistics 2017-09-20 Namrata Vaswani , Praneeth Narayanamurthy

We provide a new methodology for statistical recovery of single linear mixtures of piecewise constant signals (sources) with unknown mixing weights and change points in a multiscale fashion. We show exact recovery within an…

Methodology · Statistics 2017-08-31 Merle Behr , Chris Holmes , Axel Munk