English
Related papers

Related papers: Diverse Influence Component Analysis: A Geometric …

200 papers

Independent component analysis (ICA) is a widely used BSS method that can uniquely achieve source recovery, subject to only scaling and permutation ambiguities, through the assumption of statistical independence on the part of the latent…

Machine Learning · Statistics 2018-01-29 Zois Boukouvalas

Independent component analysis (ICA) is a statistical method for transforming an observable multi-dimensional random vector into components that are as statistically independent as possible from each other. Usually the ICA framework assumes…

Machine Learning · Statistics 2018-11-21 Amichai Painsky

Independent component analysis (ICA) is linked up with the problem of estimating a non linear functional of a density, for which optimal estimators are well known. The precision of ICA is analyzed from the viewpoint of functional spaces in…

Statistics Theory · Mathematics 2007-06-13 Pascal Barbedor

Reliable measures of statistical dependence could be useful tools for learning independent features and performing tasks like source separation using Independent Component Analysis (ICA). Unfortunately, many of such measures, like the…

Machine Learning · Statistics 2017-10-17 Philemon Brakel , Yoshua Bengio

Independent Component Analysis (ICA) is a foundational tool for unsupervised representation learning, yet its high-dimensional theory remains largely limited to single-component recovery. We develop an asymptotically exact mean-field theory…

Machine Learning · Statistics 2026-05-12 Eser Ilke Genc , Samet Demir , Zafer Dogan

Principal component analysis (PCA) is a commonly used pattern analysis method that maps high-dimensional data into a lower-dimensional space maximizing the data variance, that results in the promotion of separability of data. Inspired by…

Signal Processing · Electrical Eng. & Systems 2022-06-20 Xiaoqiang Hua , Yusuke Ono , Linyu Peng , Yuting Xu

Independent component analysis (ICA) is a statistical method for transforming an observable multidimensional random vector into components that are as statistically independent as possible from each other.Usually the ICA framework assumes a…

Information Theory · Computer Science 2015-08-21 Amichai Painsky , Saharon Rosset , Meir Feder

We study the problem of unsupervised representation learning in slightly misspecified settings, and thus formalize the study of robustness of nonlinear representation learning. We focus on the case where the mixing is close to a local…

Machine Learning · Statistics 2025-03-20 Simon Buchholz , Bernhard Schölkopf

We present a novel algorithm for overcomplete independent components analysis (ICA), where the number of latent sources k exceeds the dimension p of observed variables. Previous algorithms either suffer from high computational complexity or…

Principal component analysis (PCA) is widely used for feature extraction and dimensionality reduction, with documented merits in diverse tasks involving high-dimensional data. Standard PCA copes with one dataset at a time, but it is…

Machine Learning · Computer Science 2019-01-30 Jia Chen , Gang Wang , Georgios B. Giannakis

Independent Component Analysis (ICA) is an effective unsupervised tool to learn statistically independent representation. However, ICA is not only sensitive to whitening but also difficult to learn an over-complete basis. Consequently, ICA…

Computer Vision and Pattern Recognition · Computer Science 2013-04-10 Yanhui Xiao , Zhenfeng Zhu , Yao Zhao

We consider independent component analysis of binary data. While fundamental in practice, this case has been much less developed than ICA for continuous data. We start by assuming a linear mixing model in a continuous-valued latent space,…

Machine Learning · Computer Science 2022-08-03 Antti Hyttinen , Vitória Barin-Pacela , Aapo Hyvärinen

We introduce a new general identifiable framework for principled disentanglement referred to as Structured Nonlinear Independent Component Analysis (SNICA). Our contribution is to extend the identifiability theory of deep generative models…

Nonlinear ICA is a fundamental problem for unsupervised representation learning, emphasizing the capacity to recover the underlying latent variables generating the data (i.e., identifiability). Recently, the very first identifiability…

Machine Learning · Statistics 2019-02-05 Aapo Hyvarinen , Hiroaki Sasaki , Richard E. Turner

We introduce coroICA, confounding-robust independent component analysis, a novel ICA algorithm which decomposes linearly mixed multivariate observations into independent components that are corrupted (and rendered dependent) by hidden…

Machine Learning · Statistics 2019-10-31 Niklas Pfister , Sebastian Weichwald , Peter Bühlmann , Bernhard Schölkopf

Independent component analysis (ICA) is a widespread data exploration technique, where observed signals are modeled as linear mixtures of independent components. From a machine learning point of view, it amounts to a matrix factorization…

Machine Learning · Statistics 2019-05-28 Pierre Ablin , Alexandre Gramfort , Jean-François Cardoso , Francis Bach

Independent Component Analysis (ICA) is intended to recover the mutually independent sources from their linear mixtures, and F astICA is one of the most successful ICA algorithms. Although it seems reasonable to improve the performance of F…

Machine Learning · Statistics 2022-02-09 YunPeng Li

Finding overcomplete latent representations of data has applications in data analysis, signal processing, machine learning, theoretical neuroscience and many other fields. In an overcomplete representation, the number of latent features…

Machine Learning · Computer Science 2021-06-10 Jesse A. Livezey , Alejandro F. Bujan , Friedrich T. Sommer

Fast Independent Component Analysis (FastICA) is a component separation algorithm based on the levels of non-Gaussianity. Here we apply the FastICA to the component separation problem of the microwave background including carbon monoxide…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-15 Kiyotomo Ichiki , Ryohei Kaji , Hiroaki Yamamoto , Tsutomu T. Takeuchi , Yasuo Fukui

Independent component analysis (ICA) is a blind source separation method for linear disentanglement of independent latent sources from observed data. We investigate the special setting of noisy linear ICA where the observations are split…

Machine Learning · Computer Science 2023-03-06 Teodora Pandeva , Patrick Forré