English
Related papers

Related papers: Linear Independent Component Analysis over Finite …

200 papers

We analyze the dynamics of an online algorithm for independent component analysis in the high-dimensional scaling limit. As the ambient dimension tends to infinity, and with proper time scaling, we show that the time-varying joint empirical…

Machine Learning · Computer Science 2017-11-08 Chuang Wang , Yue M. Lu

We consider independent component analysis of binary data. While fundamental in practice, this case has been much less developed than ICA for continuous data. We start by assuming a linear mixing model in a continuous-valued latent space,…

Machine Learning · Computer Science 2022-08-03 Antti Hyttinen , Vitória Barin-Pacela , Aapo Hyvärinen

We propose a new method of independent component analysis (ICA) in order to extract appropriate features from high-dimensional data. In general, matrix factorization methods including ICA have a problem regarding the interpretability of…

Machine Learning · Statistics 2024-10-18 Yusuke Endo , Koujin Takeda

Independent component analysis (ICA), as an approach to the blind source-separation (BSS) problem, has become the de-facto standard in many medical imaging settings. Despite successes and a large ongoing research effort, the limitation of…

Machine Learning · Computer Science 2016-03-23 R. Devon Hjelm , Sergey M. Plis , Vince C. Calhoun

Although approaches to Independent Component Analysis (ICA) based on characteristic function seem theoretically elegant, they may suffer from implementational challenges because of numerical integration steps or selection of tuning…

Methodology · Statistics 2025-11-07 Vincent Starck

We present a generalization of independent component analysis (ICA), where instead of looking for a linear transform that makes the data components independent, we look for a transform that makes the data components well fit by a…

Machine Learning · Computer Science 2013-01-07 Francis R. Bach , Michael I. Jordan

Nonlinear independent component analysis (ICA) is a general framework for unsupervised representation learning, and aimed at recovering the latent variables in data. Recent practical methods perform nonlinear ICA by solving a series of…

Machine Learning · Computer Science 2019-11-04 Hiroaki Sasaki , Takashi Takenouchi , Ricardo Monti , Aapo Hyvärinen

Independent component analysis (ICA) is now a widely used solution for the analysis of multi-subject functional magnetic resonance imaging (fMRI) data. Independent vector analysis (IVA) generalizes ICA to multiple datasets, i.e., to…

Signal Processing · Electrical Eng. & Systems 2023-11-10 Trung Vu , Francisco Laport , Hanlu Yang , Vince D. Calhoun , Tulay Adali

Independent component analysis (ICA) is a blind source separation method to recover source signals of interest from their mixtures. Most existing ICA procedures assume independent sampling. Second-order-statistics-based source separation…

Machine Learning · Statistics 2022-12-14 Seonjoo Lee , Haipeng Shen , Young K. Truong

Blind source separation, particularly through independent component analysis (ICA), is widely utilized across various signal processing domains for disentangling underlying components from observed mixed signals, owing to its fully…

Methodology · Statistics 2026-01-06 Qiang Li , Shujian Yu , Liang Ma , Chen Ma , Jingyu Liu , Tulay Adali , Vince D. Calhoun

In this work, we explore Partitioned Independent Component Analysis (PICA), an extension of the well-established Independent Component Analysis (ICA) framework. Traditionally, ICA focuses on extracting a vector of independent source signals…

Statistics Theory · Mathematics 2024-02-16 Marina Garrote-López , Monroe Stephenson

The brain effortlessly solves blind source separation (BSS) problems, but the algorithm it uses remains elusive. In signal processing, linear BSS problems are often solved by Independent Component Analysis (ICA). To serve as a model of a…

Neural and Evolutionary Computing · Computer Science 2021-11-18 Yanis Bahroun , Dmitri B Chklovskii , Anirvan M Sengupta

We describe a method for unmixing mixtures of freely independent random variables in a manner analogous to the independent component analysis (ICA) based method for unmixing independent random variables from their additive mixtures. Random…

Machine Learning · Computer Science 2022-02-08 Hao Wu , Raj Rao Nadakuditi

Independent Mechanism Analysis (IMA) seeks to address non-identifiability in nonlinear Independent Component Analysis (ICA) by assuming that the Jacobian of the mixing function has orthogonal columns. As typical in ICA, previous work…

Machine Learning · Statistics 2023-12-22 Shubhangi Ghosh , Luigi Gresele , Julius von Kügelgen , Michel Besserve , Bernhard Schölkopf

Independent Component Analysis (ICA) is an effective unsupervised tool to learn statistically independent representation. However, ICA is not only sensitive to whitening but also difficult to learn an over-complete basis. Consequently, ICA…

Computer Vision and Pattern Recognition · Computer Science 2013-04-10 Yanhui Xiao , Zhenfeng Zhu , Yao Zhao

Nonlinear ICA is a fundamental problem for unsupervised representation learning, emphasizing the capacity to recover the underlying latent variables generating the data (i.e., identifiability). Recently, the very first identifiability…

Machine Learning · Statistics 2019-02-05 Aapo Hyvarinen , Hiroaki Sasaki , Richard E. Turner

Recently, nonlinear ICA has surfaced as a popular alternative to the many heuristic models used in deep representation learning and disentanglement. An advantage of nonlinear ICA is that a sophisticated identifiability theory has been…

Machine Learning · Statistics 2023-11-29 Hermanni Hälvä , Jonathan So , Richard E. Turner , Aapo Hyvärinen

Independent component analysis (ICA) is a fundamental statistical tool used to reveal hidden generative processes from observed data. However, traditional ICA approaches struggle with the rotational invariance inherent in Gaussian…

Machine Learning · Computer Science 2024-08-21 Ignavier Ng , Yujia Zheng , Xinshuai Dong , Kun Zhang

We propose an extension of non-parametric multivariate finite mixture models by dropping the standard conditional independence assumption and incorporating the independent component analysis (ICA) structure instead. We formulate an…

Methodology · Statistics 2018-09-11 Xiaotian Zhu , David R. Hunter

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean