English
Related papers

Related papers: FastICA with Learned Scores from the Empirical Cha…

200 papers

Nonlinear independent component analysis (ICA) provides an appealing framework for unsupervised feature learning, but the models proposed so far are not identifiable. Here, we first propose a new intuitive principle of unsupervised deep…

Machine Learning · Statistics 2016-05-23 Aapo Hyvarinen , Hiroshi Morioka

In this paper, we investigate the optimal statistical performance and the impact of computational constraints for independent component analysis (ICA). Our goal is twofold. On the one hand, we characterize the precise role of dimensionality…

Statistics Theory · Mathematics 2023-04-03 Arnab Auddy , Ming Yuan

Independent Component Analysis (ICA) has recently been shown to be a promising new path in data analysis and de-trending of exoplanetary time series signals. Such approaches do not require or assume any prior or auxiliary knowledge on the…

Earth and Planetary Astrophysics · Physics 2015-06-15 I. P. Waldmann

We generalize the low-rank decomposition problem, such as principal and independent component analysis (PCA, ICA) for continuous-time vector-valued signals and provide a model-agnostic implicit neural signal representation framework to…

Machine Learning · Computer Science 2025-07-15 Shayan K. Azmoodeh , Krishna Subramani , Paris Smaragdis

Latent component identification from unknown nonlinear mixtures is a foundational challenge in machine learning, with applications in tasks such as disentangled representation learning and causal inference. Prior work in nonlinear…

Machine Learning · Computer Science 2025-10-22 Hoang-Son Nguyen , Xiao Fu

We consider the identifiability theory of probabilistic models and establish sufficient conditions under which the representations learned by a very broad family of conditional energy-based models are unique in function space, up to a…

Machine Learning · Statistics 2020-10-27 Ilyes Khemakhem , Ricardo Pio Monti , Diederik P. Kingma , Aapo Hyvärinen

We consider shared response modeling, a multi-view learning problem where one wants to identify common components from multiple datasets or views. We introduce Shared Independent Component Analysis (ShICA) that models each view as a linear…

Machine Learning · Computer Science 2021-10-27 Hugo Richard , Pierre Ablin , Bertrand Thirion , Alexandre Gramfort , Aapo Hyvärinen

We study the classical problem of recovering a multidimensional source signal from observations of nonlinear mixtures of this signal. We show that this recovery is possible (up to a permutation and monotone scaling of the source's original…

Machine Learning · Statistics 2023-01-18 Alexander Schell , Harald Oberhauser

Independent component analysis (ICA), as a data driven method, has shown to be a powerful tool for functional magnetic resonance imaging (fMRI) data analysis. One drawback of this multivariate approach is, that it is not compatible to the…

Neurons and Cognition · Quantitative Biology 2019-03-25 Simon Wein , Ana Maria Tomé , Markus Goldhacker , Mark W. Greenlee , Elmar W. Lang

Recently, an extension of independent component analysis (ICA) from one to multiple datasets, termed independent vector analysis (IVA), has been the subject of significant research interest. IVA has also been shown to be a generalization of…

Machine Learning · Computer Science 2016-08-11 Matthew Anderson , Geng-Shen Fu , Ronald Phlypo , Tülay Adalı

This paper investigates a general robust one-shot aggregation framework for distributed and federated Independent Component Analysis (ICA) problem. We propose a geometric median-based aggregation algorithm that leverages $k$-means…

Machine Learning · Computer Science 2025-05-28 Dian Jin , Xin Bing , Yuqian Zhang

In this paper we study the theoretical properties of the deflation-based FastICA method, the original symmetric FastICA method, and a modified symmetric FastICA method, here called the squared symmetric FastICA. This modification is…

Statistics Theory · Mathematics 2016-10-24 Jari Miettinen , Klaus Nordhausen , Hannu Oja , Sara Taskinen , Joni Virta

A core task in multi-modal learning is to integrate information from multiple feature spaces (e.g., text and audio), offering modality-invariant essential representations of data. Recent research showed that, classical tools such as {\it…

Machine Learning · Computer Science 2024-10-02 Subash Timilsina , Sagar Shrestha , Xiao Fu

Latent variable discovery is a central problem in data analysis with a broad range of applications in applied science. In this work, we consider data given as an invertible mixture of two statistically independent components and assume that…

Machine Learning · Statistics 2023-03-08 Uri Shaham , Jonathan Svirsky , Ori Katz , Ronen Talmon

Independent component analysis (ICA) is now a widely used solution for the analysis of multi-subject functional magnetic resonance imaging (fMRI) data. Independent vector analysis (IVA) generalizes ICA to multiple datasets, i.e., to…

Signal Processing · Electrical Eng. & Systems 2023-11-10 Trung Vu , Francisco Laport , Hanlu Yang , Vince D. Calhoun , Tulay Adali

Independent component analysis (ICA) is widely used to separate mixed signals and recover statistically independent components. However, in non-human primate neuroimaging studies, most ICA-recovered spatial maps are often dense. To extract…

Applications · Statistics 2025-09-23 Qiang Li , Liang Ma , Masoud Seraji , Shujian Yu , Yun Wang , Jingyu Liu , Vince D. Calhoun

The extended infomax algorithm for independent component analysis (ICA) can separate sub- and super-Gaussian signals but converges slowly as it uses stochastic gradient optimization. In this paper, an improved extended infomax algorithm is…

Methodology · Statistics 2024-04-10 Nicole Ille

We address the problem of distinguishing cause from effect in bivariate setting. Based on recent developments in nonlinear independent component analysis (ICA), we train nonparametrically general nonlinear causal models that allow…

Machine Learning · Statistics 2021-01-19 Pengzhou Wu , Kenji Fukumizu

A recently proposed mutual information based algorithm for decomposing data into least dependent components (MILCA) is applied to spectral analysis, namely to blind recovery of concentrations and pure spectra from their linear mixtures. The…

Data Analysis, Statistics and Probability · Physics 2007-07-13 Sergey A. Astakhov , Harald Stögbauer , Alexander Kraskov , Peter Grassberger

This paper concerns underdetermined linear instantaneous and convolutive blind source separation (BSS), i.e., the case when the number of observed mixed signals is lower than the number of sources.We propose partial BSS methods, which…

Data Analysis, Statistics and Probability · Physics 2008-12-18 J. Thomas , Y. Deville , Shahram Hosseini