English
Related papers

Related papers: Generalizing Nonlinear ICA Beyond Structural Spars…

200 papers

Independent Component Analysis (ICA) aims to recover independent latent variables from observed mixtures thereof. Causal Representation Learning (CRL) aims instead to infer causally related (thus often statistically dependent) latent…

In recent years, there has been growing interest in jointly analyzing a foreground dataset, representing an experimental group, and a background dataset, representing a control group. The goal of such contrastive investigations is to…

Statistics Theory · Mathematics 2026-01-27 Kexin Wang , Aida Maraj , Anna Seigal

Independent Component Analysis (ICA) models are very popular semiparametric models in which we observe independent copies of a random vector $X = AS$, where $A$ is a non-singular matrix and $S$ has independent components. We propose a new…

Statistics Theory · Mathematics 2012-06-05 Richard J. Samworth , Ming Yuan

Reliable measures of statistical dependence could be useful tools for learning independent features and performing tasks like source separation using Independent Component Analysis (ICA). Unfortunately, many of such measures, like the…

Machine Learning · Statistics 2017-10-17 Philemon Brakel , Yoshua Bengio

Independent Component Analysis (ICA) is a statistical tool that decomposes an observed random vector into components that are as statistically independent as possible. ICA over finite fields is a special case of ICA, in which both the…

Machine Learning · Statistics 2018-11-14 Amichai Painsky , Saharon Rosset , Meir Feder

Independent Component Analysis (ICA) is an effective unsupervised tool to learn statistically independent representation. However, ICA is not only sensitive to whitening but also difficult to learn an over-complete basis. Consequently, ICA…

Computer Vision and Pattern Recognition · Computer Science 2013-04-10 Yanhui Xiao , Zhenfeng Zhu , Yao Zhao

For many years, a combination of principal component analysis (PCA) and independent component analysis (ICA) has been used for blind source separation (BSS). However, it remains unclear why these linear methods work well with real-world…

Machine Learning · Statistics 2020-12-15 Takuya Isomura , Taro Toyoizumi

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean

In this work, we explore Partitioned Independent Component Analysis (PICA), an extension of the well-established Independent Component Analysis (ICA) framework. Traditionally, ICA focuses on extracting a vector of independent source signals…

Statistics Theory · Mathematics 2024-02-16 Marina Garrote-López , Monroe Stephenson

Independent component analysis (ICA) is a method for recovering statistically independent signals from observations of unknown linear combinations of the sources. Some of the most accurate ICA decomposition methods require searching for the…

Machine Learning · Statistics 2016-09-23 Matan Sela , Ron Kimmel

Independent Component Analysis (ICA) offers interpretable semantic components of embeddings. While ICA theory assumes that embeddings can be linearly decomposed into independent components, real-world data often do not satisfy this…

Computation and Language · Computer Science 2024-10-10 Momose Oyama , Hiroaki Yamagiwa , Hidetoshi Shimodaira

Blind source separation, particularly through independent component analysis (ICA), is widely utilized across various signal processing domains for disentangling underlying components from observed mixed signals, owing to its fully…

Methodology · Statistics 2026-01-06 Qiang Li , Shujian Yu , Liang Ma , Chen Ma , Jingyu Liu , Tulay Adali , Vince D. Calhoun

Independent Component Analysis (ICA) is a technique for unsupervised exploration of multi-channel data widely used in observational sciences. In its classical form, ICA relies on modeling the data as a linear mixture of non-Gaussian…

Machine Learning · Statistics 2017-11-30 Pierre Ablin , Jean-François Cardoso , Alexandre Gramfort

This paper extends recent work on nonlinear Independent Component Analysis (ICA) by introducing a theoretical framework for nonlinear Independent Subspace Analysis (ISA) in the presence of auxiliary variables. Observed high dimensional…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Amrith Setlur , Barnabas Poczos , Alan W Black

We study the problem of unsupervised representation learning in slightly misspecified settings, and thus formalize the study of robustness of nonlinear representation learning. We focus on the case where the mixing is close to a local…

Machine Learning · Statistics 2025-03-20 Simon Buchholz , Bernhard Schölkopf

The goal of this paper is to extend independent subspace analysis (ISA) to the case of (i) nonparametric, not strictly stationary source dynamics and (ii) unknown source component dimensions. We make use of functional autoregressive (fAR)…

Methodology · Statistics 2012-01-04 Zoltan Szabo

Independent Mechanism Analysis (IMA) seeks to address non-identifiability in nonlinear Independent Component Analysis (ICA) by assuming that the Jacobian of the mixing function has orthogonal columns. As typical in ICA, previous work…

Machine Learning · Statistics 2023-12-22 Shubhangi Ghosh , Luigi Gresele , Julius von Kügelgen , Michel Besserve , Bernhard Schölkopf

Independent component analysis (ICA) decomposes multivariate data into mutually independent components (ICs). The ICA model is subject to a constraint that at most one of these components is Gaussian, which is required for model…

Methodology · Statistics 2018-05-18 Ze Jin , Benjamin B. Risk , David S. Matteson

Background: Independent Component Analysis (ICA) is a widespread tool for exploration and denoising of electroencephalography (EEG) or magnetoencephalography (MEG) signals. In its most common formulation, ICA assumes that the signal matrix…

Signal Processing · Electrical Eng. & Systems 2020-08-25 Pierre Ablin , Jean-François Cardoso , Alexandre Gramfort

Independent component analysis (ICA) is popular in many applications, including cognitive neuroscience and signal processing. Due to computational constraints, principal component analysis is used for dimension reduction prior to ICA…

Methodology · Statistics 2017-10-03 Benjamin B. Risk , David S. Matteson , David Ruppert