English
Related papers

Related papers: Estimating Sparse Sources from Data Mixtures using…

200 papers

Independent component analysis (ICA) is a blind source separation method to recover source signals of interest from their mixtures. Most existing ICA procedures assume independent sampling. Second-order-statistics-based source separation…

Machine Learning · Statistics 2022-12-14 Seonjoo Lee , Haipeng Shen , Young K. Truong

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

Independent component analysis (ICA) is a blind source separation method for linear disentanglement of independent latent sources from observed data. We investigate the special setting of noisy linear ICA where the observations are split…

Machine Learning · Computer Science 2023-03-06 Teodora Pandeva , Patrick Forré

Sparse Principal Component Analysis (SPCA) is an important technique for high-dimensional data analysis, improving interpretability by imposing sparsity on principal components. However, existing methods often fail to simultaneously…

Machine Learning · Computer Science 2026-03-03 Difei Cheng , Qiao Hu

In this paper, we propose a method to address the problem of source estimation for Sparse Component Analysis (SCA) in the presence of additive noise. Our method is a generalization of a recently proposed method (SL0), which has the…

Multimedia · Computer Science 2008-11-19 Hamed Firouzi , Masoud Farivar , Massoud Babaie-Zadeh , Christian Jutten

We revisit the source image estimation problem from blind source separation (BSS). We generalize the traditional minimum distortion principle to maximum likelihood estimation with a model for the residual spectrograms. Because residual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-14 Robin Scheibler

The implementation of conventional sparse principal component analysis (SPCA) on high-dimensional data sets has become a time consuming work. In this paper, a series of subspace projections are constructed efficiently by using Household QR…

Machine Learning · Statistics 2019-12-09 Cong Xu , Min Yang , Jin Zhang

A novel extension of Independent Component and Independent Vector Analysis for blind extraction/separation of one or several sources from time-varying mixtures is proposed. The mixtures are assumed to be separable source-by-source in series…

Signal Processing · Electrical Eng. & Systems 2021-05-12 Zbyněk Koldovský , Václav Kautský , Petr Tichavský

This paper introduces a novel sparse latent factor modeling framework using sparse asymptotic Principal Component Analysis (APCA) to analyze the co-movements of high-dimensional panel data over time. Unlike existing methods based on sparse…

Methodology · Statistics 2025-08-08 Zhaoxing Gao

This paper presents a novel approach to functional principal component analysis (FPCA) in Bayes spaces in the setting where densities are the object of analysis, but only few individual samples from each density are observed. We use the…

Methodology · Statistics 2023-09-21 Lisa Steyer , Sonja Greven

Independent component analysis (ICA) is a powerful method for blind source separation based on the assumption that sources are statistically independent. Though ICA has proven useful and has been employed in many applications, complete…

Machine Learning · Statistics 2016-10-21 Zois Boukouvalas , Yuri Levin-Schwartz , Tulay Adali

Efficient representations of data are essential for processing, exploration, and human understanding, and Principal Component Analysis (PCA) is one of the most common dimensionality reduction techniques used for the analysis of large,…

Computation · Statistics 2023-11-06 Olga Dorabiala , Aleksandr Aravkin , J. Nathan Kutz

Sparse Principal Components Analysis aims to find principal components with few non-zero loadings. We derive such sparse solutions by adding a genuine sparsity requirement to the original Principal Components Analysis (PCA) objective…

Methodology · Statistics 2014-08-19 Giovanni Maria Merola

We study how well one can recover sparse principal components of a data matrix using a sketch formed from a few of its elements. We show that for a wide class of optimization problems, if the sketch is close (in the spectral norm) to the…

Machine Learning · Computer Science 2015-03-16 Abhisek Kundu , Petros Drineas , Malik Magdon-Ismail

Independent component analysis (ICA) has been widely used for blind source separation in many fields such as brain imaging analysis, signal processing and telecommunication. Many statistical techniques based on M-estimates have been…

Methodology · Statistics 2009-09-29 Aiyou Chen , Peter J. Bickel

We consider the Sparse Principal Component Analysis (SPCA) problem under the well-known spiked covariance model. Recent work has shown that the SPCA problem can be reformulated as a Mixed Integer Program (MIP) and can be solved to global…

Methodology · Statistics 2026-04-06 Kayhan Behdin , Rahul Mazumder

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean

We study Principal Component Analysis (PCA) in a setting where a part of the corrupting noise is data-dependent and, as a result, the noise and the true data are correlated. Under a bounded-ness assumption on the true data and the noise,…

Information Theory · Computer Science 2017-11-01 Namrata Vaswani , Praneeth Narayanamurthy

Principal component analysis (PCA) is a widely used method for dimension reduction. In high dimensional data, the "signal" eigenvalues corresponding to weak principal components (PCs) do not necessarily separate from the bulk of the "noise"…

Statistics Theory · Mathematics 2017-10-03 Edgar Dobriban

Blind source separation (BSS) is addressed, using a novel data-driven approach, based on a well-established probabilistic model. The proposed method is specifically designed for separation of multichannel audio mixtures. The algorithm…

Audio and Speech Processing · Electrical Eng. & Systems 2018-02-27 Bracha Laufer-Goldshtein , Ronen Talmon , Sharon Gannot