English
Related papers

Related papers: Generalizing Nonlinear ICA Beyond Structural Spars…

200 papers

Independent component analysis (ICA) is widely used to separate mixed signals and recover statistically independent components. However, in non-human primate neuroimaging studies, most ICA-recovered spatial maps are often dense. To extract…

Applications · Statistics 2025-09-23 Qiang Li , Liang Ma , Masoud Seraji , Shujian Yu , Yun Wang , Jingyu Liu , Vince D. Calhoun

Sparse principal component analysis (sPCA) enhances the interpretability of principal components (PCs) by imposing sparsity constraints on loading vectors (LVs). However, when used as a precursor to independent component analysis (ICA) for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Muhammad Usman Khalid

A blind source separation method is described to extract sources from data mixtures where the underlying sources are assumed to be sparse and uncorrelated. The approach used is to detect and analyse segments of time where one source exists…

Signal Processing · Electrical Eng. & Systems 2018-02-06 Malcolm Woolfson

We study the identification of causal effects in the presence of different types of constraints (e.g., logical constraints) in addition to the causal graph. These constraints impose restrictions on the models (parameterizations) induced by…

Artificial Intelligence · Computer Science 2025-10-15 Yizuo Chen , Adnan Darwiche

Linear causal models are important tools for modeling causal dependencies and yet in practice, only a subset of the variables can be observed. In this paper, we examine the parameter identifiability of these models by investigating whether…

Machine Learning · Computer Science 2025-02-11 Xinshuai Dong , Ignavier Ng , Biwei Huang , Yuewen Sun , Songyao Jin , Roberto Legaspi , Peter Spirtes , Kun Zhang

Motivation: Modelling methods that find structure in data are necessary with the current large volumes of genomic data, and there have been various efforts to find subsets of genes exhibiting consistent patterns over subsets of treatments.…

Machine Learning · Computer Science 2016-09-15 Kerstin Bunte , Eemeli Leppäaho , Inka Saarinen , Samuel Kaski

We consider an independence feature screening technique for identifying explanatory variables that locally contribute to the response variable in high-dimensional regression analysis. Without requiring a specific parametric form of the…

Statistics Theory · Mathematics 2016-03-31 Jinyuan Chang , Cheng Yong Tang , Yichao Wu

We generalize the low-rank decomposition problem, such as principal and independent component analysis (PCA, ICA) for continuous-time vector-valued signals and provide a model-agnostic implicit neural signal representation framework to…

Machine Learning · Computer Science 2025-07-15 Shayan K. Azmoodeh , Krishna Subramani , Paris Smaragdis

In this paper the conditions for identifiability, separability and uniqueness of linear complex valued independent component analysis (ICA) models are established. These results extend the well-known conditions for solving real-valued ICA…

Information Theory · Computer Science 2011-11-09 Jan Eriksson , Visa Koivunen

Exogenous heterogeneity, for example, in the form of instrumental variables can help us learn a system's underlying causal structure and predict the outcome of unseen intervention experiments. In this paper, we consider linear models in…

Methodology · Statistics 2024-10-21 Niklas Pfister , Jonas Peters

Information criteria (IC) have been widely used in factor models to estimate an unknown number of latent factors. It has recently been shown that IC perform well in Common Correlated Effects (CCE) and related setups in selecting a set of…

Econometrics · Economics 2025-10-07 Jan Ditzen , Ovidijus Stauskas

The problem of separating structured information representing phenomena of differing natures is considered. A structure is assumed to be independent of the others if can be represented in a complementary subspace. When the concomitant…

Mathematical Physics · Physics 2015-05-13 Laura Rebollo-Neira , A. PLastino

Sparse and outlier-robust Principal Component Analysis (PCA) has been a very active field of research recently. Yet, most existing methods apply PCA to a single dataset whereas multi-source data-i.e. multiple related datasets requiring…

Methodology · Statistics 2026-02-26 Patricia Puchhammer , Ines Wilms , Peter Filzmoser

Compressive learning forms the exciting intersection between compressed sensing and statistical learning where one exploits forms of sparsity and structure to reduce the memory and/or computational complexity of the learning task. In this…

Machine Learning · Statistics 2021-10-18 Michael P. Sheehan , Mike E. Davies

Model identification is a crucial problem in chemical industries. In recent years, there has been increasing interest in learning data-driven models utilizing partial knowledge about the system of interest. Most techniques for model…

Machine Learning · Computer Science 2020-07-09 Deepak Maurya , Sivadurgaprasad Chinta , Abhishek Sivaram , Raghunathan Rengaswamy

We develop a new neural network based independent component analysis (ICA) method by directly minimizing the dependence amongst all extracted components. Using the matrix-based R{\'e}nyi's $\alpha$-order entropy functional, our network can…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Hongming Li , Shujian Yu , Jose C. Principe

Multiview analysis aims at extracting shared latent components from data samples that are acquired in different domains, e.g., image, text, and audio. Classic multiview analysis, e.g., canonical correlation analysis (CCA), tackles this…

Machine Learning · Computer Science 2020-06-24 Qi Lyu , Xiao Fu

Independent component analysis (ICA) has often been used as a tool to model natural image statistics by separating multivariate signals in the image into components that are assumed to be independent. However, these estimated components…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Zhimin Chen , Darius Parvin , Maedbh King , Susan Hao

We give under weak assumptions a complete combinatorial characterization of identifiability for linear mixtures of finite alphabet sources, with unknown mixing weights and unknown source signals, but known alphabet. This is based on a…

Methodology · Statistics 2017-09-01 Merle Behr , Axel Munk

A general asymptotic framework is developed for studying consis- tency properties of principal component analysis (PCA). Our frame- work includes several previously studied domains of asymptotics as special cases and allows one to…

Statistics Theory · Mathematics 2016-11-26 Dan Shen , Haipeng Shen , J. S. Marron