English
Related papers

Related papers: Stochastic algorithms with descent guarantees for …

200 papers

Independent Component Analysis (ICA) aims to find a coordinate system in which the components of the data are independent. In this paper we construct a new nonlinear ICA model, called WICA, which obtains better and more stable results than…

Machine Learning · Computer Science 2020-12-11 Andrzej Bedychaj , Przemysław Spurek , Aleksandra Nowak , Jacek Tabor

Recent advances in nonlinear Independent Component Analysis (ICA) provide a principled framework for unsupervised feature learning and disentanglement. The central idea in such works is that the latent components are assumed to be…

Machine Learning · Statistics 2020-06-23 Hermanni Hälvä , Aapo Hyvärinen

Independent component analysis (ICA) studies mixtures of independent latent sources. An ICA model is identifiable if the mixing can be recovered uniquely. It is well-known that ICA is identifiable if and only if at most one source is…

Statistics Theory · Mathematics 2024-01-29 Kexin Wang , Anna Seigal

Independent component analysis (ICA) has often been used as a tool to model natural image statistics by separating multivariate signals in the image into components that are assumed to be independent. However, these estimated components…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Zhimin Chen , Darius Parvin , Maedbh King , Susan Hao

Independent component analysis (ICA) is a fundamental problem in the field of signal processing, and numerous algorithms have been developed to address this issue. The core principle of these algorithms is to find a transformation matrix…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Liangliang Zhu , Zhebin Song , Xuesen Zhang , Meibin Qi

Independent Component Analysis (ICA) is commonly-used in electroencephalogram (EEG) signal processing to remove non-cerebral artifacts from cerebral data. Despite the ubiquity of ICA, the effect of measurement uncertainty on the artifact…

Systems and Control · Electrical Eng. & Systems 2024-10-07 Jennie Couchman , Orestis Kaparounakis , Chatura Samarakoon , Phillip Stanley-Marbell

A central problem in unsupervised deep learning is how to find useful representations of high-dimensional data, sometimes called "disentanglement". Most approaches are heuristic and lack a proper theoretical foundation. In linear…

Machine Learning · Computer Science 2023-09-06 Aapo Hyvarinen , Ilyes Khemakhem , Hiroshi Morioka

Finding overcomplete latent representations of data has applications in data analysis, signal processing, machine learning, theoretical neuroscience and many other fields. In an overcomplete representation, the number of latent features…

Machine Learning · Computer Science 2021-06-10 Jesse A. Livezey , Alejandro F. Bujan , Friedrich T. Sommer

Machine learning and data analysis now finds both scientific and industrial application in biology, chemistry, geology, medicine, and physics. These applications rely on large quantities of data gathered from automated sensors and user…

Machine Learning · Computer Science 2017-05-26 Joseph Anderson

Blind source separation, particularly through independent component analysis (ICA), is widely utilized across various signal processing domains for disentangling underlying components from observed mixed signals, owing to its fully…

Methodology · Statistics 2026-01-06 Qiang Li , Shujian Yu , Liang Ma , Chen Ma , Jingyu Liu , Tulay Adali , Vince D. Calhoun

We study the problem of learning disentangled signals from data using non-linear Independent Component Analysis (ICA). Motivated by advances in self-supervised learning, we propose to learn self-sufficient signals: A recovered signal should…

Machine Learning · Statistics 2025-12-02 Song Liu

Principal component analysis (PCA) has been a prominent tool for high-dimensional data analysis. Online algorithms that estimate the principal component by processing streaming data are of tremendous practical and theoretical interests.…

Optimization and Control · Mathematics 2017-10-09 Chris Junchi Li , Mengdi Wang , Han Liu , Tong Zhang

We analyze the dynamics of an online algorithm for independent component analysis in the high-dimensional scaling limit. As the ambient dimension tends to infinity, and with proper time scaling, we show that the time-varying joint empirical…

Machine Learning · Computer Science 2017-11-08 Chuang Wang , Yue M. Lu

Independent component analysis (ICA) has been used in many applications, including self-interference cancellation for in-band full-duplex wireless systems and anomaly detection in industrial internet of things. This paper presents a…

Signal Processing · Electrical Eng. & Systems 2022-05-03 Hsi-Hung Lu , Chung-An Shen , Mohammed E. Fouda , Ahmed M. Eltawil

Background: Independent Component Analysis (ICA) is a widespread tool for exploration and denoising of electroencephalography (EEG) or magnetoencephalography (MEG) signals. In its most common formulation, ICA assumes that the signal matrix…

Signal Processing · Electrical Eng. & Systems 2020-08-25 Pierre Ablin , Jean-François Cardoso , Alexandre Gramfort

The brain effortlessly solves blind source separation (BSS) problems, but the algorithm it uses remains elusive. In signal processing, linear BSS problems are often solved by Independent Component Analysis (ICA). To serve as a model of a…

Neural and Evolutionary Computing · Computer Science 2021-11-18 Yanis Bahroun , Dmitri B Chklovskii , Anirvan M Sengupta

Blind source separation algorithms such as independent component analysis (ICA) are widely used in the analysis of neuroimaging data. In order to leverage larger sample sizes, different data holders/sites may wish to collaboratively learn…

Independent Component Analysis (ICA) is the problem of learning a square matrix $A$, given samples of $X=AS$, where $S$ is a random vector with independent coordinates. Most existing algorithms are provably efficient only when each $S_i$…

Machine Learning · Computer Science 2017-02-24 Joseph Anderson , Navin Goyal , Anupama Nandi , Luis Rademacher

Nonlinear independent component analysis (ICA) aims to recover the underlying independent latent sources from their observable nonlinear mixtures. How to make the nonlinear ICA model identifiable up to certain trivial indeterminacies is a…

Machine Learning · Computer Science 2024-02-27 Yujia Zheng , Ignavier Ng , Kun Zhang

We describe a method for unmixing mixtures of freely independent random variables in a manner analogous to the independent component analysis (ICA) based method for unmixing independent random variables from their additive mixtures. Random…

Machine Learning · Computer Science 2022-02-08 Hao Wu , Raj Rao Nadakuditi