English
Related papers

Related papers: Disentangling Identifiable Features from Noisy Dat…

200 papers

A significant challenge in many fields of science and engineering is making sense of time-dependent measurement data by recovering governing equations in the form of differential equations. We focus on finding parsimonious ordinary…

Machine Learning · Computer Science 2024-10-04 Doris Voina , Steven Brunton , J. Nathan Kutz

Sequence data is challenging for machine learning approaches, because the lengths of the sequences may vary between samples. In this paper, we present an unsupervised learning model for sequence data, called the Integrated Sequence…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Wenjie Pei , David M. J. Tax

Discovering the complete set of causal relations among a group of variables is a challenging unsupervised learning problem. Often, this challenge is compounded by the fact that there are latent or hidden confounders. When only observational…

Machine Learning · Computer Science 2021-01-19 Anqi Liu , Hao Liu , Tongxin Li , Saeed Karimi-Bidhendi , Yisong Yue , Anima Anandkumar

Independent component analysis is commonly applied to functional magnetic resonance imaging (fMRI) data to extract independent components (ICs) representing functional brain networks. While ICA produces reliable group-level estimates,…

Methodology · Statistics 2020-06-05 Amanda F. Mejia , David Bolin , Yu Ryan Yue , Jiongran Wang , Brian S. Caffo , Mary Beth Nebel

Independent component analysis (ICA) is a statistical method for transforming an observable multidimensional random vector into components that are as statistically independent as possible from each other.Usually the ICA framework assumes a…

Information Theory · Computer Science 2015-08-21 Amichai Painsky , Saharon Rosset , Meir Feder

We consider independent component analysis of binary data. While fundamental in practice, this case has been much less developed than ICA for continuous data. We start by assuming a linear mixing model in a continuous-valued latent space,…

Machine Learning · Computer Science 2022-08-03 Antti Hyttinen , Vitória Barin-Pacela , Aapo Hyvärinen

Suppose we observe data of the form $Y_i = D_i (S_i + \varepsilon_i) \in \mathbb{R}^p$ or $Y_i = D_i S_i + \varepsilon_i \in \mathbb{R}^p$, $i=1,\ldots,n$, where $D_i \in \mathbb{R}^{p\times p}$ are known diagonal matrices, $\varepsilon_i$…

Statistics Theory · Mathematics 2018-11-05 Edgar Dobriban , William Leeb , Amit Singer

In this work, we explore Partitioned Independent Component Analysis (PICA), an extension of the well-established Independent Component Analysis (ICA) framework. Traditionally, ICA focuses on extracting a vector of independent source signals…

Statistics Theory · Mathematics 2024-02-16 Marina Garrote-López , Monroe Stephenson

Representation learning assumes that real-world data is generated by a few semantically meaningful generative factors (i.e., sources of variation) and aims to discover them in the latent space. These factors are expected to be causally…

Machine Learning · Computer Science 2023-10-27 Xiaoyu Liu , Jiaxin Yuan , Bang An , Yuancheng Xu , Yifan Yang , Furong Huang

Nonlinear system identification often involves a fundamental trade-off between interpretability and flexibility, often requiring the incorporation of physical constraints. We propose a unified data-driven framework that combines the…

Machine Learning · Computer Science 2025-09-16 Federico J. Gonzalez , Luis P. Lara

Nearly all identifiability results in unsupervised representation learning inspired by, e.g., independent component analysis, factor analysis, and causal representation learning, rely on assumptions of additive independent noise or…

Machine Learning · Computer Science 2025-03-24 Yujia Zheng , Yang Liu , Jiaxiong Yao , Yingyao Hu , Kun Zhang

We propose a deep learning framework for modeling complex high-dimensional densities called Non-linear Independent Component Estimation (NICE). It is based on the idea that a good representation is one in which the data has a distribution…

Machine Learning · Computer Science 2015-04-13 Laurent Dinh , David Krueger , Yoshua Bengio

Identifiability of statistical models is a key notion in unsupervised representation learning. Recent work of nonlinear independent component analysis (ICA) employs auxiliary data and has established identifiable conditions. This paper…

Machine Learning · Statistics 2024-05-31 Hiroaki Sasaki

Linear Independent Component Analysis (ICA) is a blind source separation technique that has been used in various domains to identify independent latent sources from observed signals. In order to obtain a higher signal-to-noise ratio, the…

Machine Learning · Computer Science 2023-12-04 Ambroise Heurtebise , Pierre Ablin , Alexandre Gramfort

Independent component analysis (ICA) is a computational method for separating a multivariate signal into subcomponents assuming the mutual statistical independence of the non-Gaussian source signals. The classical Independent Components…

Information Theory · Computer Science 2015-05-19 Huy Nguyen , Rong Zheng

Noise subtraction is a crucial process in gravitational wave (GW) data analysis to improve the sensitivity of interferometric detectors. While linear noise coupling has been extensively studied and successfully mitigated using methods such…

Instrumentation and Methods for Astrophysics · Physics 2026-04-22 Jun'ya Kume , Koh Ueno , Tatsuki Washimi , Jun'ichi Yokoyama , Takaaki Yokozawa , Yousuke Itoh

Independent component analysis (ICA) decomposes multivariate data into mutually independent components (ICs). The ICA model is subject to a constraint that at most one of these components is Gaussian, which is required for model…

Methodology · Statistics 2018-05-18 Ze Jin , Benjamin B. Risk , David S. Matteson

Latent component identification from unknown nonlinear mixtures is a foundational challenge in machine learning, with applications in tasks such as disentangled representation learning and causal inference. Prior work in nonlinear…

Machine Learning · Computer Science 2025-10-22 Hoang-Son Nguyen , Xiao Fu

Independent component analysis (ICA) is a statistical method for transforming an observable multi-dimensional random vector into components that are as statistically independent as possible from each other. Usually the ICA framework assumes…

Machine Learning · Statistics 2018-11-21 Amichai Painsky

The sparse identification of nonlinear dynamics (SINDy) is a regression framework for the discovery of parsimonious dynamic models and governing equations from time-series data. As with all system identification methods, noisy measurements…

Signal Processing · Electrical Eng. & Systems 2020-10-01 Kadierdan Kaheman , Steven L. Brunton , J. Nathan Kutz