English
Related papers

Related papers: On the toric algebra of graphical models

200 papers

In this work, we present a probabilistic model for directed graphs where nodes have attributes and labels. This model serves as a generative classifier capable of predicting the labels of unseen nodes using either maximum likelihood or…

Machine Learning · Computer Science 2025-01-06 Diego Huerta , Gerardo Arizmendi

We establish conditions under which latent causal graphs are nonparametrically identifiable and can be reconstructed from unknown interventions in the latent space. Our primary focus is the identification of the latent structure in…

Machine Learning · Statistics 2023-11-06 Yibo Jiang , Bryon Aragam

We derive representation theorems for exchangeable distributions on finite and infinite graphs using elementary arguments based on geometric and graph-theoretic concepts. Our results elucidate some of the key differences, and their…

Statistics Theory · Mathematics 2018-09-18 Steffen L. Lauritzen , Alessandro Rinaldo , Kayvan Sadeghi

We establish a bijection between marginal independence models on $n$ random variables and split closed order ideals in the poset of partial set partitions. We also establish that every discrete marginal independence model is toric in cdf…

Statistics Theory · Mathematics 2025-04-02 Francisco Ponce-Carrión , Seth Sullivant

Estimating the parameters of a probabilistic directed graphical model from incomplete data is a long-standing challenge. This is because, in the presence of latent variables, both the likelihood function and posterior distribution are…

Machine Learning · Computer Science 2024-06-04 Vy Vo , Trung Le , Tung-Long Vuong , He Zhao , Edwin Bonilla , Dinh Phung

In graphical modelling, a bi-directed graph encodes marginal independences among random variables that are identified with the vertices of the graph. We show how to transform a bi-directed graph into a maximal ancestral graph that (i)…

Statistics Theory · Mathematics 2008-03-25 Mathias Drton , Thomas S. Richardson

Numerical nonlinear algebra is applied to maximum likelihood estimation for Gaussian models defined by linear constraints on the covariance matrix. We examine the generic case as well as special models (e.g. Toeplitz, sparse, trees) that…

Computation · Statistics 2020-10-07 Bernd Sturmfels , Sascha Timme , Piotr Zwiernik

This paper considers the maximum likelihood estimation of factor models of high dimension, where the number of variables (N) is comparable with or even greater than the number of observations (T). An inferential theory is developed. We…

Statistics Theory · Mathematics 2012-05-31 Jushan Bai , Kunpeng Li

We propose a method for inference in generalised linear mixed models (GLMMs) and several extensions of these models. First, we extend the GLMM by allowing the distribution of the random components to be non-Gaussian, that is, assuming an…

Methodology · Statistics 2021-07-27 Jeanett S. Pelck , Rodrigo Labouriau

We propose and study properties of maximum likelihood estimators in the class of conditional transformation models. Based on a suitable explicit parameterisation of the unconditional or conditional transformation function, we establish a…

Methodology · Statistics 2019-10-22 Torsten Hothorn , Lisa Möst , Peter Bühlmann

We consider graphs that represent pairwise marginal independencies amongst a set of variables (for instance, the zero entries of a covariance matrix for normal data). We characterize the directed acyclic graphs (DAGs) that faithfully…

Artificial Intelligence · Computer Science 2015-08-04 Johannes Textor , Alexander Idelberger , Maciej Liśkiewicz

Probabilistic generative models can be used for compression, denoising, inpainting, texture synthesis, semi-supervised learning, unsupervised feature learning, and other tasks. Given this wide range of applications, it is not surprising…

Machine Learning · Statistics 2016-04-26 Lucas Theis , Aäron van den Oord , Matthias Bethge

We introduce a novel class of labeled directed acyclic graph (LDAG) models for finite sets of discrete variables. LDAGs generalize earlier proposals for allowing local structures in the conditional probability distribution of a node, such…

Machine Learning · Statistics 2014-11-12 Johan Pensar , Henrik Nyman , Timo Koski , Jukka Corander

We develop estimation for potentially high-dimensional additive structural equation models. A key component of our approach is to decouple order search among the variables from feature or edge selection in a directed acyclic graph encoding…

Methodology · Statistics 2014-12-02 Peter Bühlmann , Jonas Peters , Jan Ernest

Implicit probabilistic models are models defined naturally in terms of a sampling procedure and often induces a likelihood function that cannot be expressed explicitly. We develop a simple method for estimating parameters in implicit models…

Machine Learning · Computer Science 2018-10-23 Ke Li , Jitendra Malik

Pearl's d-separation is a foundational notion to study conditional independence between random variables. We define the topological conditional separation and we show that it is equivalent to the d-separation, extended beyond acyclic…

Discrete Mathematics · Computer Science 2021-08-09 Michel de Lara , Jean-Philippe Chancelier , Benjamin Heymann

Gaussian graphical models have become a well-recognized tool for the analysis of conditional independencies within a set of continuous random variables. From an inferential point of view, it is important to realize that they are composite…

Statistics Theory · Mathematics 2013-10-30 Jan Draisma , Sonja Kuhnt , Piotr Zwiernik

We obtain a necessary and sufficient condition under which random-coefficient discrete choice models, such as mixed-logit models, are rich enough to approximate any nonparametric random utility models arbitrarily well across choice sets.…

Theoretical Economics · Economics 2023-12-12 Haoge Chang , Yusuke Narita , Kota Saito

Pearl and Verma developed d-separation as a widely used graphical criterion to reason about the conditional independencies that are implied by the causal structure of a Bayesian network. As acyclic ground probabilistic logic programs…

Logic in Computer Science · Computer Science 2023-08-31 Kilian Rückschloß , Felix Weitkämper

We bound features of counterfactual choices in the nonparametric random utility model of demand, i.e. if observable choices are repeated cross-sections and one allows for unrestricted, unobserved heterogeneity. In this setting, tight bounds…

Econometrics · Economics 2019-05-21 Yuichi Kitamura , Jörg Stoye