English
Related papers

Related papers: Enhancing Blind Source Separation with Dissociativ…

200 papers

Independent component analysis (ICA) is a widely used BSS method that can uniquely achieve source recovery, subject to only scaling and permutation ambiguities, through the assumption of statistical independence on the part of the latent…

Machine Learning · Statistics 2018-01-29 Zois Boukouvalas

For many years, a combination of principal component analysis (PCA) and independent component analysis (ICA) has been used for blind source separation (BSS). However, it remains unclear why these linear methods work well with real-world…

Machine Learning · Statistics 2020-12-15 Takuya Isomura , Taro Toyoizumi

Principal Component Analysis (PCA) is a well known procedure to reduce intrinsic complexity of a dataset, essentially through simplifying the covariance structure or the correlation structure. We introduce a novel algebraic, model-based…

Methodology · Statistics 2021-12-09 Martin Schlather , Felix Reinbott

Principal Component Analysis (PCA) and its nonlinear extension Kernel PCA (KPCA) are widely used across science and industry for data analysis and dimensionality reduction. Modern deep learning tools have achieved great empirical success,…

Machine Learning · Computer Science 2023-02-23 Francesco Tonin , Qinghua Tao , Panagiotis Patrinos , Johan A. K. Suykens

Principal components analysis (PCA) is the optimal linear auto-encoder of data, and it is often used to construct features. Enforcing sparsity on the principal components can promote better generalization, while improving the…

Machine Learning · Computer Science 2015-02-25 Malik Magdon-Ismail , Christos Boutsidis

Given a multivariate data set, sparse principal component analysis (SPCA) aims to extract several linear combinations of the variables that together explain the variance in the data as much as possible, while controlling the number of…

Machine Learning · Statistics 2020-05-08 Peter Richtárik , Majid Jahani , Selin Damla Ahipaşaoğlu , Martin Takáč

Independent component analysis (ICA) is a powerful method for blind source separation based on the assumption that sources are statistically independent. Though ICA has proven useful and has been employed in many applications, complete…

Machine Learning · Statistics 2016-10-21 Zois Boukouvalas , Yuri Levin-Schwartz , Tulay Adali

In many daily-life scenarios, acoustic sources recorded in an enclosure can only be observed with other interfering sources. Hence, convolutive Blind Source Separation (BSS) is a central problem in audio signal processing. Methods based on…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-12 Andreas Brendel , Thomas Haubner , Walter Kellermann

Sparse Principal Component Analysis (SPCA) and Sparse Linear Regression (SLR) have a wide range of applications and have attracted a tremendous amount of attention in the last two decades as canonical examples of statistical problems in…

Statistics Theory · Mathematics 2018-11-27 Guy Bresler , Sung Min Park , Madalina Persu

Sparse Principal Component Analysis (Sparse PCA) is a pivotal tool in data analysis and dimensionality reduction. However, Sparse PCA is a challenging problem in both theory and practice: it is known to be NP-hard and current exact methods…

Machine Learning · Computer Science 2025-03-06 Alberto Del Pia , Dekun Zhou , Yinglun Zhu

This article focuses on the robust principal component analysis (PCA) of high-dimensional data with elliptical distributions. We investigate the PCA of the sample spatial-sign covariance matrix in both nonsparse and sparse contexts,…

Methodology · Statistics 2025-07-08 Ping Zhao , Hongfei Wang , Long Feng

Principal component analysis (PCA) can be significantly limited when there is too few examples of the target data of interest. We propose a transfer learning approach to PCA (TL-PCA) where knowledge from a related source task is used in…

Machine Learning · Computer Science 2024-10-15 Sharon Hendy , Yehuda Dar

We present a method for performing Principal Component Analysis (PCA) on noisy datasets with missing values. Estimates of the measurement error are used to weight the input data such that compared to classic PCA, the resulting eigenvectors…

Instrumentation and Methods for Astrophysics · Physics 2015-06-11 Stephen Bailey

We propose a stable version of Principal Component Analysis (PCA) in the general framework of a separable Hilbert space. It consists in interpreting the projection on the first eigenvectors as a step function applied to the spectrum of the…

Statistics Theory · Mathematics 2017-04-03 Ilaria Giulini

Blind source separation, particularly through independent component analysis (ICA), is widely utilized across various signal processing domains for disentangling underlying components from observed mixed signals, owing to its fully…

Methodology · Statistics 2026-01-06 Qiang Li , Shujian Yu , Liang Ma , Chen Ma , Jingyu Liu , Tulay Adali , Vince D. Calhoun

Sparse principal component analysis (SPCA) is a popular tool for dimensionality reduction in high-dimensional data. However, there is still a lack of theoretically justified Bayesian SPCA methods that can scale well computationally. One of…

Methodology · Statistics 2023-08-08 Bo Y. -C. Ning , Ning Ning

Robust principal component analysis (RPCA) seeks a low-rank component and a sparse component from their summation. Yet, in many applications of interest, the sparse foreground actually replaces, or occludes, elements from the low-rank…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yinjian Wang , Wei Li , Yuanyuan Gui , James E. Fowler , Gemine Vivone

Principal component analysis (PCA) is one of the most widely used dimensionality reduction tools in data analysis. The PCA direction is a linear combination of all features with nonzero loadings -- this impedes interpretability. Sparse PCA…

Optimization and Control · Mathematics 2021-08-18 Santanu S. Dey , Rahul Mazumder , Guanyi Wang

We present a new straightforward principal component analysis (PCA) method based on the diagonalization of the weighted variance-covariance matrix through two spectral decomposition methods: power iteration and Rayleigh quotient iteration.…

Instrumentation and Methods for Astrophysics · Physics 2014-12-16 Ludovic Delchambre

Deep neural networks perform remarkably well on image classification tasks but remain vulnerable to carefully crafted adversarial perturbations. This work revisits linear dimensionality reduction as a simple, data-adapted defense. We…

Machine Learning · Computer Science 2025-10-08 Killian Steunou , Théo Druilhe , Sigurd Saue