English
Related papers

Related papers: Identifiable Feature Learning for Spatial Data wit…

200 papers

Independent component analysis provides a principled framework for unsupervised representation learning, with solid theory on the identifiability of the latent code that generated the data, given only observations of mixtures thereof.…

Machine Learning · Statistics 2022-02-10 Luigi Gresele , Julius von Kügelgen , Vincent Stimper , Bernhard Schölkopf , Michel Besserve

Independent component analysis (ICA) is an unsupervised learning method popular in functional magnetic resonance imaging (fMRI). Group ICA has been used to search for biomarkers in neurological disorders including autism spectrum disorder…

Methodology · Statistics 2021-01-14 Yuxuan Zhao , David S. Matteson , Mary Beth Nebel , Stewart H. Mostofsky , Benjamin Risk

Factor models are widely used to reduce dimensionality in modeling high-dimensional data. However, there remains a need for models that can be reliably fit in modest sample sizes and are identifiable, interpretable, and flexible. To address…

Methodology · Statistics 2025-06-19 Maoran Xu , Steven Winter , Amy H. Herring , David B. Dunson

In this work, we explore Partitioned Independent Component Analysis (PICA), an extension of the well-established Independent Component Analysis (ICA) framework. Traditionally, ICA focuses on extracting a vector of independent source signals…

Statistics Theory · Mathematics 2024-02-16 Marina Garrote-López , Monroe Stephenson

Deep learning has achieved incredible success over the past years, especially in various challenging predictive spatio-temporal analytics (PSTA) tasks, such as disease prediction, climate forecast, and traffic prediction, where intrinsic…

Machine Learning · Computer Science 2020-09-18 Qi Tan , Yang Liu , Jiming Liu

Learning governing dynamics from data is a common goal across the sciences, yet it is only well-posed when the underlying mechanisms are identifiable. In practice, many data-driven methods implicitly assume identifiability; when this…

Machine Learning · Computer Science 2026-05-13 Aybüke Ulusarslan , Niki Kilbertus , Nora Schneider

Independent component analysis (ICA) is a method for recovering statistically independent signals from observations of unknown linear combinations of the sources. Some of the most accurate ICA decomposition methods require searching for the…

Machine Learning · Statistics 2016-09-23 Matan Sela , Ron Kimmel

The interpretability of generative models is considered a key factor in demonstrating their effectiveness and controllability. The generated data are believed to be determined by latent variables that are not directly observable. Therefore,…

Machine Learning · Statistics 2025-08-14 Yuan-Hao Wei , Fu-Hao Deng , Lin-Yong Cui , Yan-Jie Sun

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

We consider the framework of Independent Component Analysis (ICA) for the case where the independent sources and their linear mixtures all reside in a Galois field of prime order P. Similarities and differences from the classical ICA…

Information Theory · Computer Science 2010-07-14 Arie Yeredor

A tacit assumption in classical linear regression problems is the full knowledge of the existing link between the covariates and responses. In Unlinked Linear Regression (ULR) this link is either partially or completely missing. While the…

Statistics Theory · Mathematics 2025-07-22 Fadoua Balabdaoui , Martin Slawski , Jonathan Steffani

This work aims to address the long-established problem of learning diversified representations. To this end, we combine information-theoretic arguments with stochastic competition-based activations, namely Stochastic Local Winner-Takes-All…

Machine Learning · Computer Science 2022-01-12 Konstantinos P. Panousis , Anastasios Antoniadis , Sotirios Chatzis

Root cause analysis (RCA) in networked industrial systems, such as supply chains and power networks, is notoriously difficult due to unknown and dynamically evolving interdependencies among geographically distributed clients. These clients…

Machine Learning · Computer Science 2026-02-26 Ayush Mohanty , Paritosh Ramanan , Nagi Gebraeel

The Independent Component Analysis (ICA) algorithm is implemented as a neural network for separating signals of different origin in astrophysical sky maps. Due to its self-organizing capability, it works without prior assumptions on the…

We consider federated learning of linearly-parameterized nonlinear systems. We establish theoretical guarantees on the effectiveness of federated nonlinear system identification compared to centralized approaches, demonstrating that the…

Machine Learning · Computer Science 2026-04-27 Omkar Tupe , Max Hartman , Lav R. Varshney , Saurav Prakash

Independent component analysis (ICA) has been shown to be useful in many applications. However, most ICA methods are sensitive to data contamination and outliers. In this article we introduce a general minimum U-divergence framework for…

Methodology · Statistics 2012-10-23 Peng-Wen Chen , Hung Hung , Osamu Komori , Su-Yun Huang , Shinto Eguchi

This paper presents a novel approach that leverages domain variability to learn representations that are conditionally invariant to unwanted variability or distractors. Our approach identifies both spurious and invariant latent features…

Machine Learning · Computer Science 2023-07-04 Hananeh Aliee , Ferdinand Kapl , Soroor Hediyeh-Zadeh , Fabian J. Theis

An efficient structural identifiability analysis algorithm is developed in this study for a broad range of network structures. The proposed method adopts the Wright's path coefficient method to generate identifiability equations in forms of…

Molecular Networks · Quantitative Biology 2017-08-25 Yulin Wang , Na Lu , Hongyu Miao

We propose Deep Autoencoding Predictive Components (DAPC) -- a self-supervised representation learning method for sequence data, based on the intuition that useful representations of sequence data should exhibit a simple structure in the…

Machine Learning · Computer Science 2021-03-02 Junwen Bai , Weiran Wang , Yingbo Zhou , Caiming Xiong

Devising and analyzing learning models for spatiotemporal network data is of importance for tasks including forecasting, anomaly detection, and multi-agent coordination, among others. Graph Convolutional Neural Networks (GCNNs) are an…

Machine Learning · Computer Science 2022-07-01 Mohammad Sabbaqi , Elvin Isufi