English
Related papers

Related papers: WICA: nonlinear weighted ICA

200 papers

Independent component analysis is intended to recover the mutually independent components from their linear mixtures. This technique has been widely used in many fields, such as data analysis, signal processing, and machine learning. To…

Machine Learning · Statistics 2022-07-13 Yunpeng Li , ZhaoHui Ye

We present a new algorithm for Independent Component Analysis (ICA) which has provable performance guarantees. In particular, suppose we are given samples of the form $y = Ax + \eta$ where $A$ is an unknown $n \times n$ matrix and $x$ is a…

Machine Learning · Computer Science 2012-11-13 Sanjeev Arora , Rong Ge , Ankur Moitra , Sushant Sachdeva

Independent component analysis (ICA) is a widespread data exploration technique, where observed signals are modeled as linear mixtures of independent components. From a machine learning point of view, it amounts to a matrix factorization…

Machine Learning · Statistics 2019-05-28 Pierre Ablin , Alexandre Gramfort , Jean-François Cardoso , Francis Bach

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean

Independent component analysis (ICA) is the problem of efficiently recovering a matrix $A \in \mathbb{R}^{n\times n}$ from i.i.d. observations of $X=AS$ where $S \in \mathbb{R}^n$ is a random vector with mutually independent coordinates.…

Machine Learning · Computer Science 2015-09-03 Joseph Anderson , Navin Goyal , Anupama Nandi , Luis Rademacher

Independent component analysis (ICA) aims at decomposing an observed random vector into statistically independent variables. Deflation-based implementations, such as the popular one-unit FastICA algorithm and its variants, extract the…

Machine Learning · Statistics 2016-11-15 Vicente Zarzoso , Pierre Comon

Independent component analysis provides a principled framework for unsupervised representation learning, with solid theory on the identifiability of the latent code that generated the data, given only observations of mixtures thereof.…

Machine Learning · Statistics 2022-02-10 Luigi Gresele , Julius von Kügelgen , Vincent Stimper , Bernhard Schölkopf , Michel Besserve

In recent years, several methods have been proposed for the discovery of causal structure from non-experimental data (Spirtes et al. 2000; Pearl 2000). Such methods make various assumptions on the data generating process to facilitate its…

Machine Learning · Computer Science 2012-07-09 Shohei Shimizu , Aapo Hyvarinen , Yutaka Kano , Patrik O. Hoyer

We consider the framework of Independent Component Analysis (ICA) for the case where the independent sources and their linear mixtures all reside in a Galois field of prime order P. Similarities and differences from the classical ICA…

Information Theory · Computer Science 2010-07-14 Arie Yeredor

Independent component analysis (ICA) is a fundamental statistical tool used to reveal hidden generative processes from observed data. However, traditional ICA approaches struggle with the rotational invariance inherent in Gaussian…

Machine Learning · Computer Science 2024-08-21 Ignavier Ng , Yujia Zheng , Xinshuai Dong , Kun Zhang

We propose to use precise estimators of mutual information (MI) to find least dependent components in a linearly mixed signal. On the one hand this seems to lead to better blind source separation than with any other presently available…

Computational Physics · Physics 2007-07-16 Harald Stögbauer , Alexander Kraskov , Sergey A. Astakhov , Peter Grassberger

In the independent component model, the multivariate data is assumed to be a mixture of mutually independent latent components, and in independent component analysis (ICA) the aim is to estimate these latent components. In this paper we…

Statistics Theory · Mathematics 2020-06-23 Jari Miettinen , Markus Matilainen , Klaus Nordhausen , Sara Taskinen

Compressive learning forms the exciting intersection between compressed sensing and statistical learning where one exploits forms of sparsity and structure to reduce the memory and/or computational complexity of the learning task. In this…

Machine Learning · Statistics 2021-10-18 Michael P. Sheehan , Mike E. Davies

In this paper we derive a new framework for independent component analysis (ICA), called measure-transformed ICA (MTICA), that is based on applying a structured transform to the probability distribution of the observation vector, i.e.,…

Methodology · Statistics 2013-12-10 Koby Todros , Alfred O. Hero

A novel extension of Independent Component and Independent Vector Analysis for blind extraction/separation of one or several sources from time-varying mixtures is proposed. The mixtures are assumed to be separable source-by-source in series…

Signal Processing · Electrical Eng. & Systems 2021-05-12 Zbyněk Koldovský , Václav Kautský , Petr Tichavský

Background: Independent Component Analysis (ICA) is a widespread tool for exploration and denoising of electroencephalography (EEG) or magnetoencephalography (MEG) signals. In its most common formulation, ICA assumes that the signal matrix…

Signal Processing · Electrical Eng. & Systems 2020-08-25 Pierre Ablin , Jean-François Cardoso , Alexandre Gramfort

We address the problem of distinguishing cause from effect in bivariate setting. Based on recent developments in nonlinear independent component analysis (ICA), we train nonparametrically general nonlinear causal models that allow…

Machine Learning · Statistics 2021-01-19 Pengzhou Wu , Kenji Fukumizu

Independent Component Analysis (ICA) is an important step in EEG processing for a wide-ranging set of applications. However, ICA requires well-designed studies and data collection practices to yield optimal results. Past studies have…

Signal Processing · Electrical Eng. & Systems 2025-06-13 Gwenevere Frank , Seyed Yahya Shirazi , Jason Palmer , Gert Cauwenberghs , Scott Makeig , Arnaud Delorme

We present a generalization of independent component analysis (ICA), where instead of looking for a linear transform that makes the data components independent, we look for a transform that makes the data components well fit by a…

Machine Learning · Computer Science 2013-01-07 Francis R. Bach , Michael I. Jordan

Machine learning and data analysis now finds both scientific and industrial application in biology, chemistry, geology, medicine, and physics. These applications rely on large quantities of data gathered from automated sensors and user…

Machine Learning · Computer Science 2017-05-26 Joseph Anderson