English
Related papers

Related papers: High-Performance FPGA Implementation of Equivarian…

200 papers

Independent component analysis (ICA), is a blind source separation method that is becoming increasingly used to separate brain and non-brain related activities in electroencephalographic (EEG) and other electrophysiological recordings. It…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Gwenevere Frank , Scott Makeig , Arnaud Delorme

Independent Component Analysis (ICA) is a popular model for blind signal separation. The ICA model assumes that a number of independent source signals are linearly mixed to form the observed signals. We propose a new algorithm, PEGI (for…

Machine Learning · Computer Science 2015-10-02 James Voss , Mikhail Belkin , Luis Rademacher

We develop a new neural network based independent component analysis (ICA) method by directly minimizing the dependence amongst all extracted components. Using the matrix-based R{\'e}nyi's $\alpha$-order entropy functional, our network can…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Hongming Li , Shujian Yu , Jose C. Principe

In this paper, we investigate the optimal statistical performance and the impact of computational constraints for independent component analysis (ICA). Our goal is twofold. On the one hand, we characterize the precise role of dimensionality…

Statistics Theory · Mathematics 2023-04-03 Arnab Auddy , Ming Yuan

Independent component analysis (ICA) is the most popular method for blind source separation (BSS) with a diverse set of applications, such as biomedical signal processing, video and image analysis, and communications. Maximum likelihood…

Machine Learning · Statistics 2016-10-25 Zois Boukouvalas , Rami Mowakeaa , Geng-Shen Fu , Tulay Adali

Independent Component Analysis (ICA) is a foundational tool for unsupervised representation learning, yet its high-dimensional theory remains largely limited to single-component recovery. We develop an asymptotically exact mean-field theory…

Machine Learning · Statistics 2026-05-12 Eser Ilke Genc , Samet Demir , Zafer Dogan

Independent component analysis (ICA) is popular in many applications, including cognitive neuroscience and signal processing. Due to computational constraints, principal component analysis is used for dimension reduction prior to ICA…

Methodology · Statistics 2017-10-03 Benjamin B. Risk , David S. Matteson , David Ruppert

Spatial Independent Components Analysis (ICA) is increasingly used in the context of functional Magnetic Resonance Imaging (fMRI) to study cognition and brain pathologies. Salient features present in some of the extracted Independent…

A central problem in unsupervised deep learning is how to find useful representations of high-dimensional data, sometimes called "disentanglement". Most approaches are heuristic and lack a proper theoretical foundation. In linear…

Machine Learning · Computer Science 2023-09-06 Aapo Hyvarinen , Ilyes Khemakhem , Hiroshi Morioka

Independent component analysis (ICA) is a blind source separation method for linear disentanglement of independent latent sources from observed data. We investigate the special setting of noisy linear ICA where the observations are split…

Machine Learning · Computer Science 2023-03-06 Teodora Pandeva , Patrick Forré

Independent component analysis (ICA) is now a widely used solution for the analysis of multi-subject functional magnetic resonance imaging (fMRI) data. Independent vector analysis (IVA) generalizes ICA to multiple datasets, i.e., to…

Signal Processing · Electrical Eng. & Systems 2023-11-10 Trung Vu , Francisco Laport , Hanlu Yang , Vince D. Calhoun , Tulay Adali

Independent component analysis (ICA) is a fundamental problem in the field of signal processing, and numerous algorithms have been developed to address this issue. The core principle of these algorithms is to find a transformation matrix…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Liangliang Zhu , Zhebin Song , Xuesen Zhang , Meibin Qi

We investigate the impact of high-order moments on the learning dynamics of an online Independent Component Analysis (ICA) algorithm under a high-dimensional data model composed of a weighted sum of two non-Gaussian random variables. This…

Machine Learning · Statistics 2025-09-19 M. Oguzhan Gultekin , Samet Demir , Zafer Dogan

Independent component analysis (ICA) is a cornerstone of modern data analysis. Its goal is to recover a latent random vector S with independent components from samples of X=AS where A is an unknown mixing matrix. Critically, all existing…

Machine Learning · Statistics 2018-04-04 Nilin Abrahamsen , Philippe Rigollet

Independent Component Analysis (ICA) aims to find a coordinate system in which the components of the data are independent. In this paper we construct a new nonlinear ICA model, called WICA, which obtains better and more stable results than…

Machine Learning · Computer Science 2020-12-11 Andrzej Bedychaj , Przemysław Spurek , Aleksandra Nowak , Jacek Tabor

Independent component analysis (ICA) decomposes multivariate data into mutually independent components (ICs). The ICA model is subject to a constraint that at most one of these components is Gaussian, which is required for model…

Methodology · Statistics 2018-05-18 Ze Jin , Benjamin B. Risk , David S. Matteson

Independent Component Analysis (ICA) is the problem of learning a square matrix $A$, given samples of $X=AS$, where $S$ is a random vector with independent coordinates. Most existing algorithms are provably efficient only when each $S_i$…

Machine Learning · Computer Science 2017-02-24 Joseph Anderson , Navin Goyal , Anupama Nandi , Luis Rademacher

Independent Component Analysis (ICA) plays a central role in modern machine learning as a flexible framework for feature extraction. We introduce a horseshoe-type prior with a latent Polya-Gamma scale mixture representation, yielding…

Methodology · Statistics 2025-11-17 Jyotishka Datta , Soham Ghosh , Nicholas G. Polson

The extended infomax algorithm for independent component analysis (ICA) can separate sub- and super-Gaussian signals but converges slowly as it uses stochastic gradient optimization. In this paper, an improved extended infomax algorithm is…

Methodology · Statistics 2024-04-10 Nicole Ille

We analyze the dynamics of an online algorithm for independent component analysis in the high-dimensional scaling limit. As the ambient dimension tends to infinity, and with proper time scaling, we show that the time-varying joint empirical…

Machine Learning · Computer Science 2017-11-08 Chuang Wang , Yue M. Lu