English
Related papers

Related papers: On the Identifiability of Sparse ICA without Assum…

200 papers

Nonlinear independent component analysis (ICA) provides an appealing framework for unsupervised feature learning, but the models proposed so far are not identifiable. Here, we first propose a new intuitive principle of unsupervised deep…

Machine Learning · Statistics 2016-05-23 Aapo Hyvarinen , Hiroshi Morioka

Nonlinear independent component analysis (nICA) aims at recovering statistically independent latent components that are mixed by unknown nonlinear functions. Central to nICA is the identifiability of the latent components, which had been…

Machine Learning · Computer Science 2022-06-15 Qi Lyu , Xiao Fu

Indirect Inference (I-I) estimation of structural parameters $\theta$ {{requires matching observed and simulated statistics, which are most often generated using an auxiliary model that depends on instrumental parameters $\beta$.}} {The…

Statistics Theory · Mathematics 2019-08-21 David T. Frazier , Eric Renault

Canonical Correlation Analysis (CCA) is a classical tool for finding correlations among the components of two random vectors. In recent years, CCA has been widely applied to the analysis of genomic data, where it is common for researchers…

Machine Learning · Computer Science 2012-06-22 Sivaraman Balakrishnan , Kriti Puniyani , John Lafferty

Canonical Correlation Analysis (CCA) is a classic technique for multi-view data analysis. To overcome the deficiency of linear correlation in practical multi-view learning tasks, various CCA variants were proposed to capture nonlinear…

Machine Learning · Computer Science 2019-07-05 Yaxin Shi , Yuangang Pan , Donna Xu , Ivor Tsang

Principal Components Analysis (PCA) and Independent Component Analysis (ICA) are used to identify global patterns in solar and space data. PCA seeks orthogonal modes of the two-point correlation matrix constructed from a data set. It…

Astrophysics · Physics 2009-11-13 A. C. Cadavid , J. K. Lawrence , A. Ruzmaikin

This article establishes a new and comprehensive estimation and inference theory for principal component analysis (PCA) under the weak factor model that allow for cross-sectional dependent idiosyncratic components under the nearly minimal…

Methodology · Statistics 2024-10-02 Jianqing Fan , Yuling Yan , Yuheng Zheng

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

Blind source separation (BSS) is a key technique in array processing and data analysis, aiming to recover unknown sources from observed mixtures without knowledge of the mixing matrix. Classical independent component analysis (ICA) methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Zhongxuan Li

Recent advances in nonlinear Independent Component Analysis (ICA) provide a principled framework for unsupervised feature learning and disentanglement. The central idea in such works is that the latent components are assumed to be…

Machine Learning · Statistics 2020-06-23 Hermanni Hälvä , Aapo Hyvärinen

Statistical learning relies upon data sampled from a distribution, and we usually do not care what actually generated it in the first place. From the point of view of causal modeling, the structure of each distribution is induced by…

Machine Learning · Computer Science 2018-09-11 Giambattista Parascandolo , Niki Kilbertus , Mateo Rojas-Carulla , Bernhard Schölkopf

Independent component analysis is an unsupervised learning approach for computing the independent components (ICs) from the multivariate signals or data matrix. The ICs are evaluated based on the multiplication of the weight matrix with the…

Inferring dependence structure through undirected graphs is crucial for uncovering the major modes of multivariate interaction among high-dimensional genomic markers that are potentially associated with cancer. Traditionally, conditional…

Methodology · Statistics 2016-04-04 Anindya Bhadra , Arvind Rao , Veerabhadran Baladandayuthapani

Independent Component Analysis (ICA) is intended to recover the mutually independent sources from their linear mixtures, and F astICA is one of the most successful ICA algorithms. Although it seems reasonable to improve the performance of F…

Machine Learning · Statistics 2022-02-09 YunPeng Li

This work presents sparse invariant coordinate selection, SICS, a new method for sparse and robust independent component analysis. SICS is based on classical invariant coordinate selection, which is presented in such a form that a…

Methodology · Statistics 2025-11-05 Lauri Heinonen , Joni Virta

The assumption that data samples are independent and identically distributed (iid) is standard in many areas of statistics and machine learning. Nevertheless, in some settings, such as social networks, infectious disease modeling, and…

Methodology · Statistics 2019-02-06 Eli Sherman , Ilya Shpitser

In this paper the conditions for identifiability, separability and uniqueness of linear complex valued independent component analysis (ICA) models are established. These results extend the well-known conditions for solving real-valued ICA…

Information Theory · Computer Science 2011-11-09 Jan Eriksson , Visa Koivunen

Motivation: Modelling methods that find structure in data are necessary with the current large volumes of genomic data, and there have been various efforts to find subsets of genes exhibiting consistent patterns over subsets of treatments.…

Machine Learning · Computer Science 2016-09-15 Kerstin Bunte , Eemeli Leppäaho , Inka Saarinen , Samuel Kaski

Independent Component Analysis (ICA) is a foundational tool for unsupervised representation learning, yet its high-dimensional theory remains largely limited to single-component recovery. We develop an asymptotically exact mean-field theory…

Machine Learning · Statistics 2026-05-12 Eser Ilke Genc , Samet Demir , Zafer Dogan