English
Related papers

Related papers: Beyond independent component analysis: identifiabi…

200 papers

We present a new algorithm for Independent Component Analysis (ICA) which has provable performance guarantees. In particular, suppose we are given samples of the form $y = Ax + \eta$ where $A$ is an unknown $n \times n$ matrix and $x$ is a…

Machine Learning · Computer Science 2012-11-13 Sanjeev Arora , Rong Ge , Ankur Moitra , Sushant Sachdeva

Independent component analysis (ICA) estimates a demixing matrix that can recover statistically independent sources from linear mixtures. FastICA is a popular ICA algorithm due to its efficiency, but its performance strongly depends on a…

Signal Processing · Electrical Eng. & Systems 2026-04-27 David Watts , Jonathan H. Manton

Independent component analysis (ICA) has been shown to be useful in many applications. However, most ICA methods are sensitive to data contamination and outliers. In this article we introduce a general minimum U-divergence framework for…

Methodology · Statistics 2012-10-23 Peng-Wen Chen , Hung Hung , Osamu Komori , Su-Yun Huang , Shinto Eguchi

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean

Independent component analysis (ICA) has been a popular dimension reduction tool in statistical machine learning and signal processing. In this paper, we present a convergence analysis for an online tensorial ICA algorithm, by viewing the…

Machine Learning · Computer Science 2021-07-30 Chris Junchi Li , Michael I. Jordan

Independent Component Analysis (ICA) models are very popular semiparametric models in which we observe independent copies of a random vector $X = AS$, where $A$ is a non-singular matrix and $S$ has independent components. We propose a new…

Statistics Theory · Mathematics 2012-06-05 Richard J. Samworth , Ming Yuan

Independent component analysis (ICA) is a widespread data exploration technique, where observed signals are modeled as linear mixtures of independent components. From a machine learning point of view, it amounts to a matrix factorization…

Machine Learning · Statistics 2019-05-28 Pierre Ablin , Alexandre Gramfort , Jean-François Cardoso , Francis Bach

Independent Component Analysis (ICA) - one of the basic tools in data analysis - aims to find a coordinate system in which the components of the data are independent. Most of existing methods are based on the minimization of the function of…

Statistics Theory · Mathematics 2017-02-01 Przemysław Spurek , Jacek Tabor , Przemysław Rola , Michał Ociepka

Independent Component Analysis (ICA) is a dimensionality reduction technique that can boost efficiency of machine learning models that deal with probability density functions, e.g. Bayesian neural networks. Algorithms that implement…

Machine Learning · Computer Science 2017-07-10 Mahdi Nazemi , Shahin Nazarian , Massoud Pedram

Independent component analysis (ICA) has been widely used for blind source separation in many fields such as brain imaging analysis, signal processing and telecommunication. Many statistical techniques based on M-estimates have been…

Methodology · Statistics 2009-09-29 Aiyou Chen , Peter J. Bickel

Reliable measures of statistical dependence could be useful tools for learning independent features and performing tasks like source separation using Independent Component Analysis (ICA). Unfortunately, many of such measures, like the…

Machine Learning · Statistics 2017-10-17 Philemon Brakel , Yoshua Bengio

Spatial Independent Components Analysis (ICA) is increasingly used in the context of functional Magnetic Resonance Imaging (fMRI) to study cognition and brain pathologies. Salient features present in some of the extracted Independent…

Independent Component Analysis (ICA) is a foundational tool for unsupervised representation learning, yet its high-dimensional theory remains largely limited to single-component recovery. We develop an asymptotically exact mean-field theory…

Machine Learning · Statistics 2026-05-12 Eser Ilke Genc , Samet Demir , Zafer Dogan

Independent component analysis (ICA) is a blind source separation method to recover source signals of interest from their mixtures. Most existing ICA procedures assume independent sampling. Second-order-statistics-based source separation…

Machine Learning · Statistics 2022-12-14 Seonjoo Lee , Haipeng Shen , Young K. Truong

Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible without additional…

Machine Learning · Computer Science 2023-11-03 Yujia Zheng , Kun Zhang

Independent component analysis (ICA) aims at decomposing an observed random vector into statistically independent variables. Deflation-based implementations, such as the popular one-unit FastICA algorithm and its variants, extract the…

Machine Learning · Statistics 2016-11-15 Vicente Zarzoso , Pierre Comon

Recently, nonlinear ICA has surfaced as a popular alternative to the many heuristic models used in deep representation learning and disentanglement. An advantage of nonlinear ICA is that a sophisticated identifiability theory has been…

Machine Learning · Statistics 2023-11-29 Hermanni Hälvä , Jonathan So , Richard E. Turner , Aapo Hyvärinen

Latent variable discovery is a central problem in data analysis with a broad range of applications in applied science. In this work, we consider data given as an invertible mixture of two statistically independent components and assume that…

Machine Learning · Statistics 2023-03-08 Uri Shaham , Jonathan Svirsky , Ori Katz , Ronen Talmon

Independent Component Analysis (ICA) uses a measure of non-Gaussianity to identify latent sources from data and estimate their mixing coefficients (Shimizu et al., 2006). Meanwhile, higher-order Orthogonal Machine Learning (OML) exploits…

Machine Learning · Statistics 2026-03-02 Patrik Reizinger , Lester Mackey , Wieland Brendel , Rahul Krishnan

Linear Independent Component Analysis (ICA) is a blind source separation technique that has been used in various domains to identify independent latent sources from observed signals. In order to obtain a higher signal-to-noise ratio, the…

Machine Learning · Computer Science 2023-12-04 Ambroise Heurtebise , Pierre Ablin , Alexandre Gramfort