English
Related papers

Related papers: Learning overcomplete, low coherence dictionaries …

200 papers

Independent component analysis (ICA) is a powerful computational tool for separating independent source signals from their linear mixtures. ICA has been widely applied in neuroimaging studies to identify and characterize underlying brain…

Applications · Statistics 2015-05-01 Ran Shi , Ying Guo

Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible without additional…

Machine Learning · Computer Science 2023-11-03 Yujia Zheng , Kun Zhang

We propose a new method of independent component analysis (ICA) in order to extract appropriate features from high-dimensional data. In general, matrix factorization methods including ICA have a problem regarding the interpretability of…

Machine Learning · Statistics 2024-10-18 Yusuke Endo , Koujin Takeda

Independent Component Analysis (ICA) is a statistical method often used to decompose a complex dataset in its independent sub-parts. It is a powerful technique to solve a typical Blind Source Separation problem. A fast calculation of the…

Astrophysics · Physics 2007-05-23 C. Cecchi , F. Marcucci , G. Tosti

Application of independent component analysis (ICA) as an unmixing and image clustering technique for high spatial resolution Raman maps is reported. A hyperspectral map of a fixed human cell was collected by a Raman micro spectrometer in a…

Quantitative Methods · Quantitative Biology 2022-01-02 M. Hamed Mozaffari , Li-Lin Tay

Independent component analysis (ICA) is linked up with the problem of estimating a non linear functional of a density, for which optimal estimators are well known. The precision of ICA is analyzed from the viewpoint of functional spaces in…

Statistics Theory · Mathematics 2007-06-13 Pascal Barbedor

Independent Mechanism Analysis (IMA) seeks to address non-identifiability in nonlinear Independent Component Analysis (ICA) by assuming that the Jacobian of the mixing function has orthogonal columns. As typical in ICA, previous work…

Machine Learning · Statistics 2023-12-22 Shubhangi Ghosh , Luigi Gresele , Julius von Kügelgen , Michel Besserve , Bernhard Schölkopf

This paper extends recent work on nonlinear Independent Component Analysis (ICA) by introducing a theoretical framework for nonlinear Independent Subspace Analysis (ISA) in the presence of auxiliary variables. Observed high dimensional…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Amrith Setlur , Barnabas Poczos , Alan W Black

This study utilizes Independent Component Analysis (ICA) to unveil a consistent semantic structure within embeddings of words or images. Our approach extracts independent semantic components from the embeddings of a pre-trained model by…

Computation and Language · Computer Science 2023-11-03 Hiroaki Yamagiwa , Momose Oyama , Hidetoshi Shimodaira

We consider linear non-Gaussian structural equation models that involve latent confounding. In this setting, the causal structure is identifiable, but, in general, it is not possible to identify the specific causal effects. Instead, a…

Machine Learning · Statistics 2024-08-12 Daniela Schkoda , Elina Robeva , Mathias Drton

Independent Component Analysis (ICA) - one of the basic tools in data analysis - aims to find a coordinate system in which the components of the data are independent. In this paper we present Multiple-weighted Independent Component Analysis…

Machine Learning · Computer Science 2019-06-04 Andrzej Bedychaj , Przemysław Spurek , Łukasz Struskim , Jacek Tabor

In this paper, we investigate the optimal statistical performance and the impact of computational constraints for independent component analysis (ICA). Our goal is twofold. On the one hand, we characterize the precise role of dimensionality…

Statistics Theory · Mathematics 2023-04-03 Arnab Auddy , Ming Yuan

Independent component analysis (ICA) has been a popular dimension reduction tool in statistical machine learning and signal processing. In this paper, we present a convergence analysis for an online tensorial ICA algorithm, by viewing the…

Machine Learning · Computer Science 2021-07-30 Chris Junchi Li , Michael I. Jordan

Independent component analysis (ICA) is widely used to separate mixed signals and recover statistically independent components. However, in non-human primate neuroimaging studies, most ICA-recovered spatial maps are often dense. To extract…

Applications · Statistics 2025-09-23 Qiang Li , Liang Ma , Masoud Seraji , Shujian Yu , Yun Wang , Jingyu Liu , Vince D. Calhoun

Independent Component Analysis (ICA) offers interpretable semantic components of embeddings. While ICA theory assumes that embeddings can be linearly decomposed into independent components, real-world data often do not satisfy this…

Computation and Language · Computer Science 2024-10-10 Momose Oyama , Hiroaki Yamagiwa , Hidetoshi Shimodaira

Independent Component Analysis (ICA) aims to find a coordinate system in which the components of the data are independent. In this paper we construct a new nonlinear ICA model, called WICA, which obtains better and more stable results than…

Machine Learning · Computer Science 2020-12-11 Andrzej Bedychaj , Przemysław Spurek , Aleksandra Nowak , Jacek Tabor

Identifying the causal relations between interested variables plays a pivotal role in representation learning as it provides deep insights into the dataset. Identifiability, as the central theme of this approach, normally hinges on…

Machine Learning · Computer Science 2024-08-13 Boyang Sun , Ignavier Ng , Guangyi Chen , Yifan Shen , Qirong Ho , Kun Zhang

This paper introduces a novel statistical framework for independent component analysis (ICA) of multivariate data. We propose methodology for estimating and testing the existence of mutually independent components for a given dataset, and a…

Methodology · Statistics 2013-06-21 David S. Matteson , Ruey S. Tsay

Independent component analysis (ICA) is a fundamental statistical tool used to reveal hidden generative processes from observed data. However, traditional ICA approaches struggle with the rotational invariance inherent in Gaussian…

Machine Learning · Computer Science 2024-08-21 Ignavier Ng , Yujia Zheng , Xinshuai Dong , Kun Zhang

In this paper, we investigate the algorithmic stability of unsupervised representation learning with deep generative models, as a function of repeated re-training on the same input data. Algorithms for learning low dimensional linear…

Machine Learning · Computer Science 2022-07-05 Matthew Willetts , Brooks Paige