English
Related papers

Related papers: Generalized Independent Component Analysis Over Fi…

200 papers

Independent Component Analysis (ICA) is a popular model for blind signal separation. The ICA model assumes that a number of independent source signals are linearly mixed to form the observed signals. We propose a new algorithm, PEGI (for…

Machine Learning · Computer Science 2015-10-02 James Voss , Mikhail Belkin , Luis Rademacher

We study the problem of unsupervised representation learning in slightly misspecified settings, and thus formalize the study of robustness of nonlinear representation learning. We focus on the case where the mixing is close to a local…

Machine Learning · Statistics 2025-03-20 Simon Buchholz , Bernhard Schölkopf

Principal Component Analysis (PCA) is the most widely used tool for linear dimensionality reduction and clustering. Still it is highly sensitive to outliers and does not scale well with respect to the number of data samples. Robust PCA…

Computer Vision and Pattern Recognition · Computer Science 2015-04-24 Nauman Shahid , Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

Subjective classification of galaxies can mislead us in the quest of the origin regarding formation and evolution of galaxies since this is necessarily limited to a few features. The human mind is not able to apprehend the complex…

Cosmology and Nongalactic Astrophysics · Physics 2019-10-09 Tanuka Chattopadhyay , Didier Fraix-Burnet , Saptarshi Mondal

The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data.…

Machine Learning · Statistics 2017-07-28 Hiroaki Sasaki , Michael U. Gutmann , Hayaru Shouno , Aapo Hyvärinen

For statistical analysis of functional Magnetic Resonance Imaging (fMRI) data sets, we propose a data-driven approach based on Independent Component Analysis (ICA) implemented in a new version of the AnalyzeFMRI R package. For fMRI data…

Computation · Statistics 2013-07-22 Cécile Bordier , Michel Dojat , Pierre Lafaye de Micheaux

We apply both distance-based (Jin and Matteson, 2017) and kernel-based (Pfister et al., 2016) mutual dependence measures to independent component analysis (ICA), and generalize dCovICA (Matteson and Tsay, 2017) to MDMICA, minimizing…

Methodology · Statistics 2018-05-18 Ze Jin , David S. Matteson

The framework of variational autoencoders allows us to efficiently learn deep latent-variable models, such that the model's marginal distribution over observed variables fits the data. Often, we're interested in going a step further, and…

Machine Learning · Statistics 2020-12-22 Ilyes Khemakhem , Diederik P. Kingma , Ricardo Pio Monti , Aapo Hyvärinen

Application of independent component analysis (ICA) as an unmixing and image clustering technique for high spatial resolution Raman maps is reported. A hyperspectral map of a fixed human cell was collected by a Raman micro spectrometer in a…

Quantitative Methods · Quantitative Biology 2022-01-02 M. Hamed Mozaffari , Li-Lin Tay

Nonlinear independent component analysis (ICA) provides an appealing framework for unsupervised feature learning, but the models proposed so far are not identifiable. Here, we first propose a new intuitive principle of unsupervised deep…

Machine Learning · Statistics 2016-05-23 Aapo Hyvarinen , Hiroshi Morioka

Independent component analysis (ICA) is a method to extract a set of time-series data using ``statistical independency" of each component. We applied ICA to extract gravitational wave (GW) signals directly from the detector data. Our idea…

General Relativity and Quantum Cosmology · Physics 2025-05-06 Rika Shimomura , Yuuichi Tabe , Hisaaki Shinkai

The goal of this paper is to extend independent subspace analysis (ISA) to the case of (i) nonparametric, not strictly stationary source dynamics and (ii) unknown source component dimensions. We make use of functional autoregressive (fAR)…

Methodology · Statistics 2012-01-04 Zoltan Szabo

We present a new algorithm for Independent Component Analysis (ICA) which has provable performance guarantees. In particular, suppose we are given samples of the form $y = Ax + \eta$ where $A$ is an unknown $n \times n$ matrix and $x$ is a…

Machine Learning · Computer Science 2012-11-13 Sanjeev Arora , Rong Ge , Ankur Moitra , Sushant Sachdeva

A novel extension of Independent Component and Independent Vector Analysis for blind extraction/separation of one or several sources from time-varying mixtures is proposed. The mixtures are assumed to be separable source-by-source in series…

Signal Processing · Electrical Eng. & Systems 2021-05-12 Zbyněk Koldovský , Václav Kautský , Petr Tichavský

We study the problem of learning disentangled signals from data using non-linear Independent Component Analysis (ICA). Motivated by advances in self-supervised learning, we propose to learn self-sufficient signals: A recovered signal should…

Machine Learning · Statistics 2025-12-02 Song Liu

Independent Component Analysis (ICA) plays a central role in modern machine learning as a flexible framework for feature extraction. We introduce a horseshoe-type prior with a latent Polya-Gamma scale mixture representation, yielding…

Methodology · Statistics 2025-11-17 Jyotishka Datta , Soham Ghosh , Nicholas G. Polson

Cosine similarity is widely used to measure the similarity between two embeddings, while interpretations based on angle and correlation coefficient are common. In this study, we focus on the interpretable axes of embeddings transformed by…

Computation and Language · Computer Science 2024-12-18 Hiroaki Yamagiwa , Momose Oyama , Hidetoshi Shimodaira

A seminal result in the ICA literature states that for $AY = \varepsilon$, if the components of $\varepsilon$ are independent and at most one is Gaussian, then $A$ is identified up to sign and permutation of its rows (Comon, 1994). In this…

Statistics Theory · Mathematics 2024-03-21 Geert Mesters , Piotr Zwiernik

The analysis of the wavelength-dependent albedo of exoplanets represents a direct way to provide insight of their atmospheric composition and to constrain theoretical planetary atmosphere modelling. Wavelength-dependent albedo can be…

Instrumentation and Methods for Astrophysics · Physics 2019-10-09 Paolo Di Marcantonio , Carlo Morossi , Mariagrazia Franchini , Holger Lehmann

Independent Vector Analysis (IVA) is a popular extension of Independent Component Analysis (ICA) for joint separation of a set of instantaneous linear mixtures, with a direct application in frequency-domain speaker separation or extraction.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-05 Zbyněk Koldovský , Jaroslav Čmejla , Tülay Adalı , Stephen O'Regan