English
Related papers

Related papers: Generalizing Nonlinear ICA Beyond Structural Spars…

200 papers

We propose an extension of non-parametric multivariate finite mixture models by dropping the standard conditional independence assumption and incorporating the independent component analysis (ICA) structure instead. We formulate an…

Methodology · Statistics 2018-09-11 Xiaotian Zhu , David R. Hunter

Independent Component Analysis (ICA) uses a measure of non-Gaussianity to identify latent sources from data and estimate their mixing coefficients (Shimizu et al., 2006). Meanwhile, higher-order Orthogonal Machine Learning (OML) exploits…

Machine Learning · Statistics 2026-03-02 Patrik Reizinger , Lester Mackey , Wieland Brendel , Rahul Krishnan

A seminal result in the ICA literature states that for $AY = \varepsilon$, if the components of $\varepsilon$ are independent and at most one is Gaussian, then $A$ is identified up to sign and permutation of its rows (Comon, 1994). In this…

Statistics Theory · Mathematics 2024-03-21 Geert Mesters , Piotr Zwiernik

Latent component identification from unknown nonlinear mixtures is a foundational challenge in machine learning, with applications in tasks such as disentangled representation learning and causal inference. Prior work in nonlinear…

Machine Learning · Computer Science 2025-10-22 Hoang-Son Nguyen , Xiao Fu

Unsupervised feature learning algorithms based on convolutional formulations of independent components analysis (ICA) have been demonstrated to yield state-of-the-art results in several action recognition benchmarks. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Sotirios P. Chatzis

Observability is a modelling property that describes the possibility of inferring the internal state of a system from observations of its output. A related property, structural identifiability, refers to the theoretical possibility of…

Quantitative Methods · Quantitative Biology 2018-12-12 Alejandro F. Villaverde

Independent component analysis (ICA) is linked up with the problem of estimating a non linear functional of a density, for which optimal estimators are well known. The precision of ICA is analyzed from the viewpoint of functional spaces in…

Statistics Theory · Mathematics 2007-06-13 Pascal Barbedor

Causal discovery aims to recover causal structures generating the observational data. Despite its success in certain problems, in many real-world scenarios the observed variables are not the target variables of interest, but the imperfect…

Machine Learning · Computer Science 2022-10-21 Haoyue Dai , Peter Spirtes , Kun Zhang

In many daily-life scenarios, acoustic sources recorded in an enclosure can only be observed with other interfering sources. Hence, convolutive Blind Source Separation (BSS) is a central problem in audio signal processing. Methods based on…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-12 Andreas Brendel , Thomas Haubner , Walter Kellermann

Independent component analysis (ICA) has been widely used for blind source separation in many fields such as brain imaging analysis, signal processing and telecommunication. Many statistical techniques based on M-estimates have been…

Methodology · Statistics 2009-09-29 Aiyou Chen , Peter J. Bickel

We present a generalization of independent component analysis (ICA), where instead of looking for a linear transform that makes the data components independent, we look for a transform that makes the data components well fit by a…

Machine Learning · Computer Science 2013-01-07 Francis R. Bach , Michael I. Jordan

Here, a separation theorem about Independent Subspace Analysis (ISA), a generalization of Independent Component Analysis (ICA) is proven. According to the theorem, ISA estimation can be executed in two steps under certain conditions. In the…

Statistics Theory · Mathematics 2007-06-13 Zoltan Szabo , Barnabas Poczos , Andras Lorincz

A novel extension of Independent Component and Independent Vector Analysis for blind extraction/separation of one or several sources from time-varying mixtures is proposed. The mixtures are assumed to be separable source-by-source in series…

Signal Processing · Electrical Eng. & Systems 2021-05-12 Zbyněk Koldovský , Václav Kautský , Petr Tichavský

In the independent component model, the multivariate data is assumed to be a mixture of mutually independent latent components, and in independent component analysis (ICA) the aim is to estimate these latent components. In this paper we…

Statistics Theory · Mathematics 2020-06-23 Jari Miettinen , Markus Matilainen , Klaus Nordhausen , Sara Taskinen

Identifiability is a desirable property of a statistical model: it implies that the true model parameters may be estimated to any desired precision, given sufficient computational resources and data. We study identifiability in the context…

Machine Learning · Statistics 2020-07-09 Geoffrey Roeder , Luke Metz , Diederik P. Kingma

Causal discovery based on Independent Component Analysis (ICA) has achieved remarkable success through the LiNGAM framework, which exploits non-Gaussianity and independence of noise variables to identify causal order. However, classical…

Information Theory · Computer Science 2026-01-26 Joe Suzuki

Independent Component Analysis (ICA) - one of the basic tools in data analysis - aims to find a coordinate system in which the components of the data are independent. In this paper we present Multiple-weighted Independent Component Analysis…

Machine Learning · Computer Science 2019-06-04 Andrzej Bedychaj , Przemysław Spurek , Łukasz Struskim , Jacek Tabor

Identifying latent variables and causal structures from observational data is essential to many real-world applications involving biological data, medical data, and unstructured data such as images and languages. However, this task can be…

Machine Learning · Computer Science 2023-11-01 Lingjing Kong , Biwei Huang , Feng Xie , Eric Xing , Yuejie Chi , Kun Zhang

We present a new algorithm for Independent Component Analysis (ICA) which has provable performance guarantees. In particular, suppose we are given samples of the form $y = Ax + \eta$ where $A$ is an unknown $n \times n$ matrix and $x$ is a…

Machine Learning · Computer Science 2012-11-13 Sanjeev Arora , Rong Ge , Ankur Moitra , Sushant Sachdeva

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer
‹ Prev 1 3 4 5 6 7 10 Next ›