English
Related papers

Related papers: Separation Theorem for Independent Subspace Analys…

200 papers

Finding overcomplete latent representations of data has applications in data analysis, signal processing, machine learning, theoretical neuroscience and many other fields. In an overcomplete representation, the number of latent features…

Machine Learning · Computer Science 2021-06-10 Jesse A. Livezey , Alejandro F. Bujan , Friedrich T. Sommer

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean

Reliable measures of statistical dependence could be useful tools for learning independent features and performing tasks like source separation using Independent Component Analysis (ICA). Unfortunately, many of such measures, like the…

Machine Learning · Statistics 2017-10-17 Philemon Brakel , Yoshua Bengio

Independent component analysis (ICA) decomposes multivariate data into mutually independent components (ICs). The ICA model is subject to a constraint that at most one of these components is Gaussian, which is required for model…

Methodology · Statistics 2018-05-18 Ze Jin , Benjamin B. Risk , David S. Matteson

The brain effortlessly solves blind source separation (BSS) problems, but the algorithm it uses remains elusive. In signal processing, linear BSS problems are often solved by Independent Component Analysis (ICA). To serve as a model of a…

Neural and Evolutionary Computing · Computer Science 2021-11-18 Yanis Bahroun , Dmitri B Chklovskii , Anirvan M Sengupta

The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data.…

Machine Learning · Statistics 2017-07-28 Hiroaki Sasaki , Michael U. Gutmann , Hayaru Shouno , Aapo Hyvärinen

A central problem in unsupervised deep learning is how to find useful representations of high-dimensional data, sometimes called "disentanglement". Most approaches are heuristic and lack a proper theoretical foundation. In linear…

Machine Learning · Computer Science 2023-09-06 Aapo Hyvarinen , Ilyes Khemakhem , Hiroshi Morioka

Independent component analysis (ICA) is now a widely used solution for the analysis of multi-subject functional magnetic resonance imaging (fMRI) data. Independent vector analysis (IVA) generalizes ICA to multiple datasets, i.e., to…

Signal Processing · Electrical Eng. & Systems 2023-11-10 Trung Vu , Francisco Laport , Hanlu Yang , Vince D. Calhoun , Tulay Adali

Independent component analysis (ICA) is a statistical method for transforming an observable multidimensional random vector into components that are as statistically independent as possible from each other.Usually the ICA framework assumes a…

Information Theory · Computer Science 2015-08-21 Amichai Painsky , Saharon Rosset , Meir Feder

Independent Component Analysis (ICA) is an important step in EEG processing for a wide-ranging set of applications. However, ICA requires well-designed studies and data collection practices to yield optimal results. Past studies have…

Signal Processing · Electrical Eng. & Systems 2025-06-13 Gwenevere Frank , Seyed Yahya Shirazi , Jason Palmer , Gert Cauwenberghs , Scott Makeig , Arnaud Delorme

A novel extension of Independent Component and Independent Vector Analysis for blind extraction/separation of one or several sources from time-varying mixtures is proposed. The mixtures are assumed to be separable source-by-source in series…

Signal Processing · Electrical Eng. & Systems 2021-05-12 Zbyněk Koldovský , Václav Kautský , Petr Tichavský

In this work, we establish separation theorems for several subsystems of the Ideal Proof System (IPS), an algebraic proof system introduced by Grochow and Pitassi (J. ACM, 2018). Separation theorems are well-studied in the context of…

Computational Complexity · Computer Science 2026-01-13 Amik Raj Behera , Magnus Rahbek Dalgaard Hansen , Nutan Limaye , Srikanth Srinivasan

Principal Components Analysis (PCA) and Independent Component Analysis (ICA) are used to identify global patterns in solar and space data. PCA seeks orthogonal modes of the two-point correlation matrix constructed from a data set. It…

Astrophysics · Physics 2009-11-13 A. C. Cadavid , J. K. Lawrence , A. Ruzmaikin

In recent years, there has been growing interest in jointly analyzing a foreground dataset, representing an experimental group, and a background dataset, representing a control group. The goal of such contrastive investigations is to…

Statistics Theory · Mathematics 2026-01-27 Kexin Wang , Aida Maraj , Anna Seigal

We consider independent component analysis of binary data. While fundamental in practice, this case has been much less developed than ICA for continuous data. We start by assuming a linear mixing model in a continuous-valued latent space,…

Machine Learning · Computer Science 2022-08-03 Antti Hyttinen , Vitória Barin-Pacela , Aapo Hyvärinen

Word embeddings represent words as multidimensional real vectors, facilitating data analysis and processing, but are often challenging to interpret. Independent Component Analysis (ICA) creates clearer semantic axes by identifying…

Computation and Language · Computer Science 2024-06-19 Rongzhi Li , Takeru Matsuda , Hitomi Yanaka

Independent Component Analysis (ICA) aims to find a coordinate system in which the components of the data are independent. In this paper we construct a new nonlinear ICA model, called WICA, which obtains better and more stable results than…

Machine Learning · Computer Science 2020-12-11 Andrzej Bedychaj , Przemysław Spurek , Aleksandra Nowak , Jacek Tabor

Independent component analysis (ICA) is a powerful computational tool for separating independent source signals from their linear mixtures. ICA has been widely applied in neuroimaging studies to identify and characterize underlying brain…

Applications · Statistics 2015-05-01 Ran Shi , Ying Guo

Independent component analysis (ICA), is a blind source separation method that is becoming increasingly used to separate brain and non-brain related activities in electroencephalographic (EEG) and other electrophysiological recordings. It…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Gwenevere Frank , Scott Makeig , Arnaud Delorme

In the independent component model, the multivariate data is assumed to be a mixture of mutually independent latent components, and in independent component analysis (ICA) the aim is to estimate these latent components. In this paper we…

Statistics Theory · Mathematics 2020-06-23 Jari Miettinen , Markus Matilainen , Klaus Nordhausen , Sara Taskinen