English
Related papers

Related papers: Estimating multivariate latent-structure models

200 papers

Information theoretic measures (e.g. the Kullback Liebler divergence and Shannon mutual information) have been used for exploring possibly nonlinear multivariate dependencies in high dimension. If these dependencies are assumed to follow a…

Information Theory · Computer Science 2017-07-12 Kevin R. Moon , Morteza Noshad , Salimeh Yasaei Sekeh , Alfred O. Hero

In this work we deal with parameter estimation in a latent variable model, namely the multiple-hidden i.i.d. model, which is derived from multiple alignment algorithms. We first provide a rigorous formalism for the homology structure of k…

Applications · Statistics 2012-02-03 Ana Arribas-Gil

Multivariable parametric models are critical for designing, controlling, and optimizing the performance of engineered systems. The main aim of this paper is to develop a parametric identification strategy that delivers accurate and…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Maarten van der Hulst , Rodrigo González , Koen Classens , Nic Dirkx , Jeroen van de Wijdeven , Tom Oomen

Recently, there has been a surge of interest in using spectral methods for estimating latent variable models. However, it is usually assumed that the distribution of the observations conditioned on the latent variables is either discrete or…

Machine Learning · Statistics 2016-09-22 Kirthevasan Kandasamy , Maruan Al-Shedivat , Eric P. Xing

We introduce multiple hidden Markov models (MHMMs) where an observed multivariate categorical time series depends on an unobservable multivariate Mar- kov chain. MHMMs provide an elegant framework for specifying various independence…

Methodology · Statistics 2013-09-17 Roberto Colombi , Sabrina Giordano

When dealing with spreading processes on networks it can be of the utmost importance to test the reliability of data and identify potential unobserved spreading paths. In this paper we address these problems and propose methods for hidden…

Physics and Society · Physics 2021-08-18 Łukasz G. Gajewski , Jan Chołoniewski , Mateusz Wilinski

Discovering latent representations of the observed world has become increasingly more relevant in data analysis. Much of the effort concentrates on building latent variables which can be used in prediction problems, such as classification…

Machine Learning · Computer Science 2010-01-08 Ricardo Silva

Hierarchical learning models, such as mixture models and Bayesian networks, are widely employed for unsupervised learning tasks, such as clustering analysis. They consist of observable and hidden variables, which represent the given data…

Machine Learning · Statistics 2018-01-08 Keisuke Yamazaki

This paper proposes a logistic undirected network formation model which allows for assortative matching on observed individual characteristics and the presence of edge-wise fixed effects. We model the coefficients of observed…

Econometrics · Economics 2021-03-08 Shujie Ma , Liangjun Su , Yichong Zhang

Multilayer networks have become increasingly ubiquitous across diverse scientific fields, ranging from social sciences and biology to economics and international relations. Despite their broad applications, the inferential theory for…

Methodology · Statistics 2026-02-24 Zhaozhe Liu , Gongjun Xu , Haoran Zhang

We introduce an extension of finite mixture models by incorporating skew-normal distributions within a Hidden Markov Model framework. By assuming a constant transition probability matrix and allowing emission distributions to vary according…

Methodology · Statistics 2025-09-25 Andrea Nigri , Marco Forti , Han Lin Shang

In unsupervised classification, Hidden Markov Models (HMM) are used to account for a neighborhood structure between observations. The emission distributions are often supposed to belong to some parametric family. In this paper, a…

Machine Learning · Statistics 2012-06-25 Stevenn Volant , Caroline Bérard , Marie-Laure Martin-Magniette , Stéphane Robin

Given a set of $K$ probability densities, we consider the multimarginal generative modeling problem of learning a joint distribution that recovers these densities as marginals. The structure of this joint distribution should identify…

Machine Learning · Computer Science 2023-10-06 Michael S. Albergo , Nicholas M. Boffi , Michael Lindsey , Eric Vanden-Eijnden

Learning controllable and generalizable representation of multivariate data with desired structural properties remains a fundamental problem in machine learning. In this paper, we present a novel framework for learning generative models…

Machine Learning · Computer Science 2020-10-05 Ruixiang Zhang , Masanori Koyama , Katsuhiko Ishiguro

In this paper, an original result in terms of a sufficient condition to test identifiability of nonlinear delayed-differential models with constant delays and multi-inputs is given. The identifiability is studied for the linearized system…

Dynamical Systems · Mathematics 2010-09-10 Carine Jauberthie , Louise Travé-Massuyès

We consider unsupervised estimation of mixtures of discrete graphical models, where the class variable corresponding to the mixture components is hidden and each mixture component over the observed variables can have a potentially different…

Machine Learning · Statistics 2012-07-03 A. Anandkumar , D. Hsu , F. Huang , S. M. Kakade

This paper presents a novel method for assessing multiple fault diagnosability and detectability of nonlinear parametrized dynamical models. This method is based on computer algebra algorithms which return precomputed values of algebraic…

Dynamical Systems · Mathematics 2018-07-10 Nathalie Verdière , Sébastien Orange

Many important problems in the real world don't have unique solutions. It is thus important for machine learning models to be capable of proposing different plausible solutions with meaningful probability measures. In this work we introduce…

Machine Learning · Computer Science 2020-07-28 Di Qiu , Lok Ming Lui

Disentangled representation learning aims to uncover latent variables underlying the observed data, and generally speaking, rather strong assumptions are needed to ensure identifiability. Some approaches rely on sufficient changes on the…

Machine Learning · Computer Science 2025-03-04 Zijian Li , Shunxing Fan , Yujia Zheng , Ignavier Ng , Shaoan Xie , Guangyi Chen , Xinshuai Dong , Ruichu Cai , Kun Zhang

In this paper we consider non parametric finite translation mixtures. We prove that all the parameters of the model are identifiable as soon as the matrix that defines the joint distribution of two consecutive latent variables is non…

Statistics Theory · Mathematics 2013-02-12 Elisabeth Gassiat , Judith Rousseau