English
Related papers

Related papers: Binary Independent Component Analysis: A Non-stati…

200 papers

We apply belief propagation to a Bayesian bipartite graph composed of discrete independent hidden variables and discrete visible variables. The network is the Discrete counterpart of Independent Component Analysis (DICA) and it is…

Computer Vision and Pattern Recognition · Computer Science 2015-05-27 Francesco A. N. Palmieri , Amedeo Buonanno

Despite major methodological developments, Bayesian inference for Gaussian graphical models remains challenging in high dimension due to the tremendous size of the model space. This article proposes a method to infer the marginal and…

Methodology · Statistics 2018-04-10 Gwenaël G. R. Leday , Sylvia Richardson

The independent component model is a latent variable model where the components of the observed random vector are linear combinations of latent independent variables. The aim is to find an estimate for a transformation matrix back to…

Statistics Theory · Mathematics 2015-05-12 Joni Virta , Klaus Nordhausen , Hannu Oja

We consider testing marginal independence versus conditional independence in a trivariate Gaussian setting. The two models are non-nested and their intersection is a union of two marginal independences. We consider two sequences of such…

Statistics Theory · Mathematics 2020-10-23 F. Richard Guo , Thomas S. Richardson

Estimating causal models from observational data is a crucial task in data analysis. For continuous-valued data, Shimizu et al. have proposed a linear acyclic non-Gaussian model to understand the data generating process, and have shown that…

Machine Learning · Computer Science 2018-02-19 Chao Li , Shohei Shimizu

Unsupervised feature learning algorithms based on convolutional formulations of independent components analysis (ICA) have been demonstrated to yield state-of-the-art results in several action recognition benchmarks. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Sotirios P. Chatzis

This work proposes the application of independent component analysis to the problem of ranking different alternatives by considering criteria that are not necessarily statistically independent. In this case, the observed data (the criteria…

Signal Processing · Electrical Eng. & Systems 2020-12-09 Guilherme D. Pelegrina , Leonardo T. Duarte , João M. T. Romano

Compressive learning forms the exciting intersection between compressed sensing and statistical learning where one exploits forms of sparsity and structure to reduce the memory and/or computational complexity of the learning task. In this…

Machine Learning · Statistics 2021-10-18 Michael P. Sheehan , Mike E. Davies

An extension of the latent class model is presented for clustering categorical data by relaxing the classical "class conditional independence assumption" of variables. This model consists in grouping the variables into inter-independent and…

Computation · Statistics 2015-10-01 Matthieu Marbac , Christophe Biernacki , Vincent Vandewalle

Here, a separation theorem about Independent Subspace Analysis (ISA), a generalization of Independent Component Analysis (ICA) is proven. According to the theorem, ISA estimation can be executed in two steps under certain conditions. In the…

Statistics Theory · Mathematics 2007-06-13 Zoltan Szabo , Barnabas Poczos , Andras Lorincz

We consider the identifiability theory of probabilistic models and establish sufficient conditions under which the representations learned by a very broad family of conditional energy-based models are unique in function space, up to a…

Machine Learning · Statistics 2020-10-27 Ilyes Khemakhem , Ricardo Pio Monti , Diederik P. Kingma , Aapo Hyvärinen

We propose a Bayesian modeling framework for jointly analyzing multiple functional responses of different types (e.g. binary and continuous data). Our approach is based on a multivariate latent Gaussian process and models the dependence…

Methodology · Statistics 2016-01-12 Beth A. Tidemann-Miller , Brian J. Reich , Ana-Maria Staicu

We consider a nonparametric regression model with continuous endogenous independent variables when only discrete instruments are available that are independent of the error term. Although this framework is very relevant for applied…

Econometrics · Economics 2024-10-18 Samuele Centorrino , Frédérique Fève , Jean-Pierre Florens

Finite mixtures are a flexible modeling tool for irregularly shaped densities and samples from heterogeneous populations. When modeling with mixtures using an exchangeable prior on the component features, the component labels are arbitrary…

Methodology · Statistics 2020-07-10 Deborah Kunkel , Mario Peruggia

Gaussian processes (GPs) are commonplace in spatial statistics. Although many non-stationary models have been developed, there is arguably a lack of flexibility compared to equipping each location with its own parameters. However, the…

Machine Learning · Statistics 2018-07-19 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

Partial measurements of relative position are a relatively common event during the observation of visual binary stars. However, these observations are typically discarded when estimating the orbit of a visual pair. In this article we…

Instrumentation and Methods for Astrophysics · Physics 2019-07-10 Ruben M. Claveria , Rene A. Mendez , Jorge F. Silva , Marcos E. Orchard

Existing methods for differentiable structure learning in discrete data typically assume that the data are generated from specific structural equation models. However, these assumptions may not align with the true data-generating process,…

Machine Learning · Computer Science 2025-10-28 Chang Deng , Bryon Aragam

For a continuous random variable $Z$, testing conditional independence $X \perp\!\!\!\perp Y |Z$ is known to be a particularly hard problem. It constitutes a key ingredient of many constraint-based causal discovery algorithms. These…

Statistics Theory · Mathematics 2021-12-21 Philip A. Boeken , Joris M. Mooij

We consider the problem of multivariate density estimation when the unknown density is assumed to follow a particular form of dimensionality reduction, a noisy independent factor analysis (IFA) model. In this model the data are generated by…

Applications · Statistics 2009-06-17 Umberto Amato , Anestis Antoniadis , Alexander Samarov , Alexander Tsybakov

We study the problem of learning disentangled signals from data using non-linear Independent Component Analysis (ICA). Motivated by advances in self-supervised learning, we propose to learn self-sufficient signals: A recovered signal should…

Machine Learning · Statistics 2025-12-02 Song Liu