English
Related papers

Related papers: Nonlinear Independent Component Analysis for Princ…

200 papers

Independent component analysis (ICA) is a widely used method in various applications of signal processing and feature extraction. It extends principal component analysis (PCA) and can extract important and complicated components with small…

Machine Learning · Computer Science 2025-09-17 Yoshitatsu Matsuda , Kazunori Yamaguch

Independent Component Analysis (ICA) is a technique for unsupervised exploration of multi-channel data that is widely used in observational sciences. In its classic form, ICA relies on modeling the data as linear mixtures of non-Gaussian…

Machine Learning · Statistics 2018-08-01 Pierre Ablin , Jean-François Cardoso , Alexandre Gramfort

Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible without additional…

Machine Learning · Computer Science 2023-11-03 Yujia Zheng , Kun Zhang

There is a gap between the theoretical foundations of disentanglement and the practice of modern representation learning. Existing theoretical frameworks, particularly Independent Component Analysis (ICA) and its nonlinear variants, assume…

Machine Learning · Computer Science 2026-05-22 Edmond Cunningham

Independent component analysis (ICA) is a blind source separation method for linear disentanglement of independent latent sources from observed data. We investigate the special setting of noisy linear ICA where the observations are split…

Machine Learning · Computer Science 2023-03-06 Teodora Pandeva , Patrick Forré

Independent component analysis (ICA) is the problem of efficiently recovering a matrix $A \in \mathbb{R}^{n\times n}$ from i.i.d. observations of $X=AS$ where $S \in \mathbb{R}^n$ is a random vector with mutually independent coordinates.…

Machine Learning · Computer Science 2015-09-03 Joseph Anderson , Navin Goyal , Anupama Nandi , Luis Rademacher

In this paper, we investigate the algorithmic stability of unsupervised representation learning with deep generative models, as a function of repeated re-training on the same input data. Algorithms for learning low dimensional linear…

Machine Learning · Computer Science 2022-07-05 Matthew Willetts , Brooks Paige

Independent component analysis (ICA) is popular in many applications, including cognitive neuroscience and signal processing. Due to computational constraints, principal component analysis is used for dimension reduction prior to ICA…

Methodology · Statistics 2017-10-03 Benjamin B. Risk , David S. Matteson , David Ruppert

Nonlinear independent component analysis (ICA) is a general framework for unsupervised representation learning, and aimed at recovering the latent variables in data. Recent practical methods perform nonlinear ICA by solving a series of…

Machine Learning · Computer Science 2019-11-04 Hiroaki Sasaki , Takashi Takenouchi , Ricardo Monti , Aapo Hyvärinen

Compressive learning forms the exciting intersection between compressed sensing and statistical learning where one exploits forms of sparsity and structure to reduce the memory and/or computational complexity of the learning task. In this…

Machine Learning · Statistics 2021-10-18 Michael P. Sheehan , Mike E. Davies

Identifiability is a desirable property of a statistical model: it implies that the true model parameters may be estimated to any desired precision, given sufficient computational resources and data. We study identifiability in the context…

Machine Learning · Statistics 2020-07-09 Geoffrey Roeder , Luke Metz , Diederik P. Kingma

Blind source separation, particularly through independent component analysis (ICA), is widely utilized across various signal processing domains for disentangling underlying components from observed mixed signals, owing to its fully…

Methodology · Statistics 2026-01-06 Qiang Li , Shujian Yu , Liang Ma , Chen Ma , Jingyu Liu , Tulay Adali , Vince D. Calhoun

Independent Component Analysis (ICA) aims to find a coordinate system in which the components of the data are independent. In this paper we construct a new nonlinear ICA model, called WICA, which obtains better and more stable results than…

Machine Learning · Computer Science 2020-12-11 Andrzej Bedychaj , Przemysław Spurek , Aleksandra Nowak , Jacek Tabor

Independent Component Analysis (ICA) models are very popular semiparametric models in which we observe independent copies of a random vector $X = AS$, where $A$ is a non-singular matrix and $S$ has independent components. We propose a new…

Statistics Theory · Mathematics 2012-06-05 Richard J. Samworth , Ming Yuan

Independent Component Analysis (ICA) is an effective unsupervised tool to learn statistically independent representation. However, ICA is not only sensitive to whitening but also difficult to learn an over-complete basis. Consequently, ICA…

Computer Vision and Pattern Recognition · Computer Science 2013-04-10 Yanhui Xiao , Zhenfeng Zhu , Yao Zhao

Independent Component Analysis (ICA) aims to recover independent latent variables from observed mixtures thereof. Causal Representation Learning (CRL) aims instead to infer causally related (thus often statistically dependent) latent…

In recent years, there has been growing interest in jointly analyzing a foreground dataset, representing an experimental group, and a background dataset, representing a control group. The goal of such contrastive investigations is to…

Statistics Theory · Mathematics 2026-01-27 Kexin Wang , Aida Maraj , Anna Seigal

Independent component analysis provides a principled framework for unsupervised representation learning, with solid theory on the identifiability of the latent code that generated the data, given only observations of mixtures thereof.…

Machine Learning · Statistics 2022-02-10 Luigi Gresele , Julius von Kügelgen , Vincent Stimper , Bernhard Schölkopf , Michel Besserve

Contrastive learning is a recent promising approach in unsupervised representation learning where a feature representation of data is learned by solving a pseudo classification problem from unlabelled data. However, it is not…

Machine Learning · Computer Science 2022-08-10 Hiroaki Sasaki , Takashi Takenouchi

Unsupervised feature learning algorithms based on convolutional formulations of independent components analysis (ICA) have been demonstrated to yield state-of-the-art results in several action recognition benchmarks. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Sotirios P. Chatzis