English
Related papers

Related papers: Cross-covariance modelling via DAGs with hidden va…

200 papers

Bayesian network models with latent variables are widely used in statistics and machine learning. In this paper we provide a complete algebraic characterization of Bayesian network models with latent variables when the observed variables…

Statistics Theory · Mathematics 2022-12-20 Robin J. Evans

Directed acyclic graph (DAG) models, also called Bayesian networks, impose conditional independence constraints on a multivariate probability distribution, and are widely used in probabilistic reasoning, machine learning and causal…

Statistics Theory · Mathematics 2022-12-20 Robin J. Evans

Directed Acyclic Graphs (DAGs) are a standard tool in causal modeling, but their suitability for capturing the complexity of large-scale multimodal data is questionable. In practice, real-world multimodal datasets are often collected from…

Machine Learning · Computer Science 2026-03-03 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Causal models with unobserved variables impose nontrivial constraints on the distributions over the observed variables. When a common cause of two variables is unobserved, it is impossible to uncover the causal relation between them without…

Statistics Theory · Mathematics 2021-12-14 Beata Zjawin , Elie Wolfe , Robert W. Spekkens

The simultaneous grouping of rows and columns is an important technique that is increasingly used in large-scale data analysis. In this paper, we present a novel co-clustering method using co-variables in its construction. It is based on a…

Applications · Statistics 2018-12-21 Serge Iovleff , Seydou Syllla , Cheikh Loucoubar

The estimation of linear causal models (also known as structural equation models) from data is a well-known problem which has received much attention in the past. Most previous work has, however, made an explicit or implicit assumption of…

Artificial Intelligence · Computer Science 2007-05-23 Patrik O. Hoyer , Shohei Shimizu , Antti J. Kerminen

We are interested in modeling networks in which the connectivity among the nodes and node attributes are random variables and interact with each other. We propose a probabilistic model that allows one to formulate jointly a probability…

Probability · Mathematics 2016-09-07 Haiyan Cai

We consider the problem of learning the underlying causal structure among a set of variables, which are assumed to follow a Bayesian network or, more specifically, a linear recursive structural equation model (SEM) with the associated…

Statistics Theory · Mathematics 2025-08-05 Anamitra Chaudhuri , Anirban Bhattacharya , Yang Ni

An old problem in multivariate statistics is that linear Gaussian models are often unidentifiable, i.e. some parameters cannot be uniquely estimated. In factor (component) analysis, an orthogonal rotation of the factors is unidentifiable,…

Machine Learning · Statistics 2023-05-04 Aapo Hyvärinen , Ilyes Khemakhem , Ricardo Monti

Conditions are presented for different types of identifiability of discrete variable models generated over an undirected graph in which one node represents a binary hidden variable. These models can be seen as extensions of the latent class…

Methodology · Statistics 2013-12-12 Elena Stanghellini , Barbara Vantaggi

Many data-science applications involve detecting a shared signal between two high-dimensional variables. Using random matrix theory methods, we determine when such signal can be detected and reconstructed from sample correlations, despite…

Disordered Systems and Neural Networks · Physics 2026-04-07 Arabind Swain , Sean Alexander Ridout , Ilya Nemenman

Graphical models are commonly used to represent conditional dependence relationships between variables. There are multiple methods available for exploring them from high-dimensional data, but almost all of them rely on the assumption that…

Machine Learning · Statistics 2020-04-22 Tianxi Li , Cheng Qian , Elizaveta Levina , Ji Zhu

Learning the structure of dependence relations between variables is a pervasive issue in the statistical literature. A directed acyclic graph (DAG) can represent a set of conditional independences, but different DAGs may encode the same set…

Methodology · Statistics 2021-02-15 Federico Castelletti , Stefano Peluso

Unobserved confounding is one of the greatest challenges for causal discovery. The case in which unobserved variables have a widespread effect on many of the observed ones is particularly difficult because most pairs of variables are…

Machine Learning · Statistics 2021-05-26 Alexis Bellot , Mihaela van der Schaar

Directed graphical models specify noisy functional relationships among a collection of random variables. In the Gaussian case, each such model corresponds to a semi-algebraic set of positive definite covariance matrices. The set is given…

Statistics Theory · Mathematics 2018-07-20 Mathias Drton , Elina Robeva , Luca Weihs

Causal discovery with latent variables is a fundamental task. Yet most existing methods rely on strong structural assumptions, such as enforcing specific indicator patterns for latents or restricting how they can interact with others. We…

Machine Learning · Computer Science 2026-03-06 Haoyue Dai , Immanuel Albrecht , Peter Spirtes , Kun Zhang

Gaussian concentration graph models and covariance graph models are two classes of graphical models that are useful for uncovering latent dependence structures among multivariate variables. In the Bayesian literature, graphs are often…

Statistics Theory · Mathematics 2015-05-08 Hao Wang

We show that the marginal model for a discrete directed acyclic graph (DAG) with hidden variables is distributionally equivalent to another fully observable DAG model if and only if it does not induce any non-trivial inequality constraints.

Statistics Theory · Mathematics 2023-12-06 Robin J. Evans

Causal models seek to unravel the cause-effect relationships among variables from observed data, as opposed to mere mappings among them, as traditional regression models do. This paper introduces a novel causal discovery algorithm designed…

Machine Learning · Computer Science 2024-10-03 Saeed Mohseni-Sehdeh , Walid Saad

We present a selective review of statistical modeling of dynamic networks. We focus on models with latent variables, specifically, the latent space models and the latent class models (or stochastic blockmodels), which investigate both the…

Methodology · Statistics 2018-05-31 Bomin Kim , Kevin Lee , Lingzhou Xue , Xiaoyue Niu