English
Related papers

Related papers: Optimization and Testing in Linear Non-Gaussian Co…

200 papers

Although approaches to Independent Component Analysis (ICA) based on characteristic function seem theoretically elegant, they may suffer from implementational challenges because of numerical integration steps or selection of tuning…

Methodology · Statistics 2025-11-07 Vincent Starck

A seminal result in the ICA literature states that for $AY = \varepsilon$, if the components of $\varepsilon$ are independent and at most one is Gaussian, then $A$ is identified up to sign and permutation of its rows (Comon, 1994). In this…

Statistics Theory · Mathematics 2024-03-21 Geert Mesters , Piotr Zwiernik

We present a generalization of independent component analysis (ICA), where instead of looking for a linear transform that makes the data components independent, we look for a transform that makes the data components well fit by a…

Machine Learning · Computer Science 2013-01-07 Francis R. Bach , Michael I. Jordan

Linear Independent Component Analysis (ICA) is a blind source separation technique that has been used in various domains to identify independent latent sources from observed signals. In order to obtain a higher signal-to-noise ratio, the…

Machine Learning · Computer Science 2023-12-04 Ambroise Heurtebise , Pierre Ablin , Alexandre Gramfort

Causal discovery based on Independent Component Analysis (ICA) has achieved remarkable success through the LiNGAM framework, which exploits non-Gaussianity and independence of noise variables to identify causal order. However, classical…

Information Theory · Computer Science 2026-01-26 Joe Suzuki

Recently, nonlinear ICA has surfaced as a popular alternative to the many heuristic models used in deep representation learning and disentanglement. An advantage of nonlinear ICA is that a sophisticated identifiability theory has been…

Machine Learning · Statistics 2023-11-29 Hermanni Hälvä , Jonathan So , Richard E. Turner , Aapo Hyvärinen

Nonlinear ICA is a fundamental problem for unsupervised representation learning, emphasizing the capacity to recover the underlying latent variables generating the data (i.e., identifiability). Recently, the very first identifiability…

Machine Learning · Statistics 2019-02-05 Aapo Hyvarinen , Hiroaki Sasaki , Richard E. Turner

Independent component analysis (ICA) aims at decomposing an observed random vector into statistically independent variables. Deflation-based implementations, such as the popular one-unit FastICA algorithm and its variants, extract the…

Machine Learning · Statistics 2016-11-15 Vicente Zarzoso , Pierre Comon

Finding overcomplete latent representations of data has applications in data analysis, signal processing, machine learning, theoretical neuroscience and many other fields. In an overcomplete representation, the number of latent features…

Machine Learning · Computer Science 2021-06-10 Jesse A. Livezey , Alejandro F. Bujan , Friedrich T. Sommer

Independent Component Analysis (ICA) is a popular model for blind signal separation. The ICA model assumes that a number of independent source signals are linearly mixed to form the observed signals. We propose a new algorithm, PEGI (for…

Machine Learning · Computer Science 2015-10-02 James Voss , Mikhail Belkin , Luis Rademacher

We consider the problem of multivariate density estimation when the unknown density is assumed to follow a particular form of dimensionality reduction, a noisy independent factor analysis (IFA) model. In this model the data are generated by…

Applications · Statistics 2009-06-17 Umberto Amato , Anestis Antoniadis , Alexander Samarov , Alexander Tsybakov

Machine learning and data analysis now finds both scientific and industrial application in biology, chemistry, geology, medicine, and physics. These applications rely on large quantities of data gathered from automated sensors and user…

Machine Learning · Computer Science 2017-05-26 Joseph Anderson

Reliable measures of statistical dependence could be useful tools for learning independent features and performing tasks like source separation using Independent Component Analysis (ICA). Unfortunately, many of such measures, like the…

Machine Learning · Statistics 2017-10-17 Philemon Brakel , Yoshua Bengio

Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible without additional…

Machine Learning · Computer Science 2023-11-03 Yujia Zheng , Kun Zhang

Independent component analysis (ICA) is a powerful computational tool for separating independent source signals from their linear mixtures. ICA has been widely applied in neuroimaging studies to identify and characterize underlying brain…

Applications · Statistics 2015-05-01 Ran Shi , Ying Guo

Independent Component Analysis (ICA) is an algorithm originally developed for finding separate sources in a mixed signal, such as a recording of multiple people in the same room speaking at the same time. Unlike Principal Component Analysis…

Computation and Language · Computer Science 2024-09-05 Tomáš Musil , David Mareček

Previous analytical studies of on-line Independent Component Analysis (ICA) learning rules have focussed on asymptotic stability and efficiency. In practice the transient stages of learning will often be more significant in determining the…

Disordered Systems and Neural Networks · Physics 2007-05-23 Magnus Rattray

We apply both distance-based (Jin and Matteson, 2017) and kernel-based (Pfister et al., 2016) mutual dependence measures to independent component analysis (ICA), and generalize dCovICA (Matteson and Tsay, 2017) to MDMICA, minimizing…

Methodology · Statistics 2018-05-18 Ze Jin , David S. Matteson

Modeling non Gaussian and non stationary signals and images has always been one of the most important part of signal and image processing methods. In this paper, first we propose a few new models, all based on using hidden variables for…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari

We develop a new neural network based independent component analysis (ICA) method by directly minimizing the dependence amongst all extracted components. Using the matrix-based R{\'e}nyi's $\alpha$-order entropy functional, our network can…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Hongming Li , Shujian Yu , Jose C. Principe