English
Related papers

Related papers: Overcomplete Independent Component Analysis via SD…

200 papers

Recently, there has been a trend to combine independent component analysis and canonical polyadic decomposition (ICA-CPD) for an enhanced robustness for the computation of CPD, and ICA-CPD could be further converted into CPD of a 5th-order…

Machine Learning · Statistics 2016-12-30 Xiao-Feng Gong , Cheng-Yuan Wang , Ya-Na Hao , Qiu-Hua Lin

Independent Component Analysis (ICA) recently has attracted attention in the statistical literature as an alternative to elliptical models. Whereas k-dimensional elliptical densities depend on one single unspecified radial density, however,…

Methodology · Statistics 2013-12-17 Marc Hallin , Chintan Mehta

Compressive learning forms the exciting intersection between compressed sensing and statistical learning where one exploits forms of sparsity and structure to reduce the memory and/or computational complexity of the learning task. In this…

Machine Learning · Statistics 2021-10-18 Michael P. Sheehan , Mike E. Davies

We study a practical algorithm for sparse principal component analysis (PCA) of incomplete and noisy data. Our algorithm is based on the semidefinite program (SDP) relaxation of the non-convex $l_1$-regularized PCA problem. We provide…

Machine Learning · Statistics 2022-09-16 Hanbyul Lee , Qifan Song , Jean Honorio

Independent component analysis (ICA) is a blind source separation method for linear disentanglement of independent latent sources from observed data. We investigate the special setting of noisy linear ICA where the observations are split…

Machine Learning · Computer Science 2023-03-06 Teodora Pandeva , Patrick Forré

Independent component analysis (ICA) has been used in many applications, including self-interference cancellation for in-band full-duplex wireless systems and anomaly detection in industrial internet of things. This paper presents a…

Signal Processing · Electrical Eng. & Systems 2022-05-03 Hsi-Hung Lu , Chung-An Shen , Mohammed E. Fouda , Ahmed M. Eltawil

Independent component analysis (ICA) estimates a demixing matrix that can recover statistically independent sources from linear mixtures. FastICA is a popular ICA algorithm due to its efficiency, but its performance strongly depends on a…

Signal Processing · Electrical Eng. & Systems 2026-04-27 David Watts , Jonathan H. Manton

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean

Independent Component Analysis (ICA) plays a central role in modern machine learning as a flexible framework for feature extraction. We introduce a horseshoe-type prior with a latent Polya-Gamma scale mixture representation, yielding…

Methodology · Statistics 2025-11-17 Jyotishka Datta , Soham Ghosh , Nicholas G. Polson

Sparse principal component analysis (sPCA) enhances the interpretability of principal components (PCs) by imposing sparsity constraints on loading vectors (LVs). However, when used as a precursor to independent component analysis (ICA) for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Muhammad Usman Khalid

Estimating the leading principal components of data, assuming they are sparse, is a central task in modern high-dimensional statistics. Many algorithms were developed for this sparse PCA problem, from simple diagonal thresholding to…

Statistics Theory · Mathematics 2015-06-04 Robert Krauthgamer , Boaz Nadler , Dan Vilenchik

Machine learning and data analysis now finds both scientific and industrial application in biology, chemistry, geology, medicine, and physics. These applications rely on large quantities of data gathered from automated sensors and user…

Machine Learning · Computer Science 2017-05-26 Joseph Anderson

We consider the framework of Independent Component Analysis (ICA) for the case where the independent sources and their linear mixtures all reside in a Galois field of prime order P. Similarities and differences from the classical ICA…

Information Theory · Computer Science 2010-07-14 Arie Yeredor

The framework of Integral Quadratic Constraints (IQC) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to a semi-definite program (SDP). In the case of over-relaxed Alternating Direction…

Machine Learning · Statistics 2018-03-06 Guilherme França , José Bento

Unsupervised feature learning algorithms based on convolutional formulations of independent components analysis (ICA) have been demonstrated to yield state-of-the-art results in several action recognition benchmarks. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Sotirios P. Chatzis

Independent component analysis (ICA) has been widely used for blind source separation in many fields such as brain imaging analysis, signal processing and telecommunication. Many statistical techniques based on M-estimates have been…

Methodology · Statistics 2009-09-29 Aiyou Chen , Peter J. Bickel

Independent component analysis (ICA) is popular in many applications, including cognitive neuroscience and signal processing. Due to computational constraints, principal component analysis is used for dimension reduction prior to ICA…

Methodology · Statistics 2017-10-03 Benjamin B. Risk , David S. Matteson , David Ruppert

This paper introduces a novel statistical framework for independent component analysis (ICA) of multivariate data. We propose methodology for estimating and testing the existence of mutually independent components for a given dataset, and a…

Methodology · Statistics 2013-06-21 David S. Matteson , Ruey S. Tsay

Sparse PCA (SPCA) is a fundamental model in machine learning and data analytics, which has witnessed a variety of application areas such as finance, manufacturing, biology, healthcare. To select a prespecified-size principal submatrix from…

Machine Learning · Statistics 2020-08-31 Yongchun Li , Weijun Xie