English
Related papers

Related papers: Independent Mechanism Analysis and the Manifold Hy…

200 papers

The inferential model (IM) framework provides valid prior-free probabilistic inference by focusing on predicting unobserved auxiliary variables. But, efficient IM-based inference can be challenging when the auxiliary variable is of higher…

Statistics Theory · Mathematics 2015-01-20 Ryan Martin , Chuanhai Liu

Causal discovery based on Independent Component Analysis (ICA) has achieved remarkable success through the LiNGAM framework, which exploits non-Gaussianity and independence of noise variables to identify causal order. However, classical…

Information Theory · Computer Science 2026-01-26 Joe Suzuki

The nonlinear vector autoregressive (NVAR) model provides an appealing framework to analyze multivariate time series obtained from a nonlinear dynamical system. However, the innovation (or error), which plays a key role by driving the…

Machine Learning · Statistics 2021-03-01 Hiroshi Morioka , Hermanni Hälvä , Aapo Hyvärinen

We investigate the identifiability of nonlinear Canonical Correlation Analysis (CCA) in a multi-view setup, where each view is generated by an unknown nonlinear map applied to a linear mixture of shared latents and view-private noise.…

Machine Learning · Computer Science 2026-03-02 Zhiwei Han , Stefan Matthes , Hao Shen

We propose an ICA contrast based on the density estimation of the observed signal and its marginals by means of wavelets. The risk of the associated moment estimator is linked with approximation properties in Besov spaces. It is shown to…

Statistics Theory · Mathematics 2007-06-13 Pascal Barbedor

The information bottleneck (IB) principle has been suggested as a way to analyze deep neural networks. The learning dynamics are studied by inspecting the mutual information (MI) between the hidden layers and the input and output. Notably,…

Machine Learning · Computer Science 2022-02-15 Stephan Sloth Lorenzen , Christian Igel , Mads Nielsen

An analysis of the protein content of several crystal forms of proteins has been performed. We apply a new numerical technique, the Independent Component Analysis (ICA), to determine the volume fraction of the asymmetric unit occupied by…

Quantitative Methods · Quantitative Biology 2008-12-02 Antonio Lamura , Massimo Ladisa , Giovanni Nico , Dritan Siliqi

Multiview analysis aims at extracting shared latent components from data samples that are acquired in different domains, e.g., image, text, and audio. Classic multiview analysis, e.g., canonical correlation analysis (CCA), tackles this…

Machine Learning · Computer Science 2020-06-24 Qi Lyu , Xiao Fu

Commercial cellular networks, like the systems based on DS-CDMA, face many types of interferences such as multi-user interference inside each sector in a cell to interoperate interference. Independent Component Analysis (ICA) has been used…

Networking and Internet Architecture · Computer Science 2010-02-18 Sargam Parmar , Bhuvan Unhelkar

Data living on manifolds commonly appear in many applications. Often this results from an inherently latent low-dimensional system being observed through higher dimensional measurements. We show that under certain conditions, it is possible…

Machine Learning · Statistics 2018-07-05 Ariel Schwartz , Ronen Talmon

Discovering the complete set of causal relations among a group of variables is a challenging unsupervised learning problem. Often, this challenge is compounded by the fact that there are latent or hidden confounders. When only observational…

Machine Learning · Computer Science 2021-01-19 Anqi Liu , Hao Liu , Tongxin Li , Saeed Karimi-Bidhendi , Yisong Yue , Anima Anandkumar

Integration of data from multiple omics techniques is becoming increasingly important in biomedical research. Due to non-uniformity and technical limitations in omics platforms, such integrative analyses on multiple omics, which we refer to…

Machine Learning · Computer Science 2021-02-11 Changhee Lee , Mihaela van der Schaar

When estimating finite mixture models, it is common to make assumptions on the mixture components, such as parametric assumptions. In this work, we make no distributional assumptions on the mixture components and instead assume that…

Machine Learning · Statistics 2016-10-14 Robert A. Vandermeulen , Clayton D. Scott

We generalize the low-rank decomposition problem, such as principal and independent component analysis (PCA, ICA) for continuous-time vector-valued signals and provide a model-agnostic implicit neural signal representation framework to…

Machine Learning · Computer Science 2025-07-15 Shayan K. Azmoodeh , Krishna Subramani , Paris Smaragdis

Subjective classification of galaxies can mislead us in the quest of the origin regarding formation and evolution of galaxies since this is necessarily limited to a few features. The human mind is not able to apprehend the complex…

Cosmology and Nongalactic Astrophysics · Physics 2019-10-09 Tanuka Chattopadhyay , Didier Fraix-Burnet , Saptarshi Mondal

Independent Component Analysis (ICA) is a computational technique for revealing latent factors that underlie sets of measurements or signals. It has become a standard technique in functional neuroimaging. In functional neuroimaging, so…

Many recent methods for unsupervised or self-supervised representation learning train feature extractors by maximizing an estimate of the mutual information (MI) between different views of the data. This comes with several immediate…

Machine Learning · Computer Science 2020-01-24 Michael Tschannen , Josip Djolonga , Paul K. Rubenstein , Sylvain Gelly , Mario Lucic

In this paper we construct nonlinear partial differential equations in more than 3 independent variables, possessing a manifold of analytic solutions with high, but not full, dimensionality. For this reason we call them ``partially…

Exactly Solvable and Integrable Systems · Physics 2009-11-11 A. I. Zenchuk , P. M. Santini

We consider the problem of multivariate density estimation when the unknown density is assumed to follow a particular form of dimensionality reduction, a noisy independent factor analysis (IFA) model. In this model the data are generated by…

Applications · Statistics 2009-06-17 Umberto Amato , Anestis Antoniadis , Alexander Samarov , Alexander Tsybakov

This paper introduces a nonparametric copula-based index for detecting the strength and monotonicity structure of linear and nonlinear statistical dependence between pairs of random variables or stochastic signals. Our index, termed Copula…

Machine Learning · Statistics 2020-02-25 Kiran Karra , Lamine Mili