English
Related papers

Related papers: Sparse Nested Markov models with Log-linear Parame…

200 papers

We present an algorithm to identify sparse dependence structure in continuous and non-Gaussian probability distributions, given a corresponding set of data. The conditional independence structure of an arbitrary distribution can be…

Machine Learning · Computer Science 2017-11-07 Rebecca E. Morrison , Ricardo Baptista , Youssef Marzouk

Learning graphical structures based on Directed Acyclic Graphs (DAGs) is a challenging problem, partly owing to the large search space of possible graphs. A recent line of work formulates the structure learning problem as a continuous…

Machine Learning · Computer Science 2021-01-12 Ignavier Ng , AmirEmad Ghassami , Kun Zhang

Causal models in statistics are often described using acyclic directed mixed graphs (ADMGs), which contain directed and bidirected edges and no directed cycles. This article surveys various interpretations of ADMGs, discusses their…

Statistics Theory · Mathematics 2025-03-28 Qingyuan Zhao

Graphical models are popular statistical tools which are used to represent dependent or causal complex systems. Statistically equivalent causal or directed graphical models are said to belong to a Markov equivalent class. It is of great…

Machine Learning · Statistics 2014-01-30 Yangbo He , Jinzhu Jia , Bin Yu

Linear mixed models are a versatile statistical tool to study data by accounting for fixed effects and random effects from multiple sources of variability. In many situations, a large number of candidate fixed effects is available and it is…

Methodology · Statistics 2022-09-09 Emanuele Degani , Luca Maestrini , Dorota Toczydłowska , Matt P. Wand

Directed graphical models specify noisy functional relationships among a collection of random variables. In the Gaussian case, each such model corresponds to a semi-algebraic set of positive definite covariance matrices. The set is given…

Statistics Theory · Mathematics 2018-07-20 Mathias Drton , Elina Robeva , Luca Weihs

Log-linear models are a classical tool for the analysis of contingency tables. In particular, the subclass of graphical log-linear models provides a general framework for modelling conditional independences. However, with the exception of…

Statistics Theory · Mathematics 2010-03-04 Mathias Drton , Thomas S. Richardson

We propose a novel score-based approach to learning a directed acyclic graph (DAG) from observational data. We adapt a recently proposed continuous constrained optimization formulation to allow for nonlinear relationships between variables…

Machine Learning · Computer Science 2020-02-19 Sébastien Lachapelle , Philippe Brouillard , Tristan Deleu , Simon Lacoste-Julien

Our concern is selecting the concentration matrix's nonzero coefficients for a sparse Gaussian graphical model in a high-dimensional setting. This corresponds to estimating the graph of conditional dependencies between the variables. We…

Methodology · Statistics 2010-04-05 Christophe Ambroise , Julien Chiquet , Catherine Matias

Datasets in engineering domains are often small, sparsely labeled, and contain numerical as well as categorical conditions. Additionally. computational resources are typically limited in practical applications which hinders the adoption of…

Machine Learning · Computer Science 2025-05-23 Phillip Mueller , Jannik Wiese , Sebastian Mueller , Lars Mikelsons

Acyclic directed mixed graphs, also known as semi-Markov models represent the conditional independence structure induced on an observed margin by a DAG model with latent variables. In this paper we present a factorization criterion for…

Artificial Intelligence · Computer Science 2014-06-27 Thomas S. Richardson

Bayesian networks, with structure given by a directed acyclic graph (DAG), are a popular class of graphical models. However, learning Bayesian networks from discrete or categorical data is particularly challenging, due to the large…

Methodology · Statistics 2018-02-06 Jiaying Gu , Fei Fu , Qing Zhou

We present a graphical approach to deriving inequality constraints for directed acyclic graph (DAG) models, where some variables are unobserved. In particular we show that the observed distribution of a discrete model is always restricted…

Statistics Theory · Mathematics 2012-09-14 Robin J. Evans

We consider the problem of aggregating models learned from sequestered, possibly heterogeneous datasets. Exploiting tools from Bayesian nonparametrics, we develop a general meta-modeling framework that learns shared global latent structures…

Machine Learning · Statistics 2019-11-04 Mikhail Yurochkin , Mayank Agarwal , Soumya Ghosh , Kristjan Greenewald , Trong Nghia Hoang

In this paper we consider sparse and identifiable linear latent variable (factor) and linear Bayesian network models for parsimonious analysis of multivariate data. We propose a computationally efficient method for joint parameter and model…

Machine Learning · Statistics 2011-06-24 Ricardo Henao , Ole Winther

Neural network design has utilized flexible nonlinear processes which can mimic biological systems, but has suffered from a lack of traceability in the resulting network. Graphical probabilistic models ground network design in probabilistic…

Machine Learning · Computer Science 2015-06-19 Kenric P. Nelson , Madalina Barbu , Brian J. Scannell

Undirected probabilistic graphical models represent the conditional dependencies, or Markov properties, of a collection of random variables. Knowing the sparsity of such a graphical model is valuable for modeling multivariate distributions…

Machine Learning · Statistics 2023-02-28 Ricardo Baptista , Youssef Marzouk , Rebecca E. Morrison , Olivier Zahm

We present some nonparametric methods for graphical modeling. In the discrete case, where the data are binary or drawn from a finite alphabet, Markov random fields are already essentially nonparametric, since the cliques can take only a…

Machine Learning · Statistics 2013-01-08 John Lafferty , Han Liu , Larry Wasserman

We initiate the study of counting Markov Equivalence Classes (MEC) under logical constraints. MECs are equivalence classes of Directed Acyclic Graphs (DAGs) that encode the same conditional independence structure among the random variables…

Logic in Computer Science · Computer Science 2024-05-24 Davide Bizzaro , Luciano Serafini , Sagar Malhotra

In this paper, we propose a simple, versatile model for learning the structure and parameters of multivariate distributions from a data set. Learning a Markov network from a given data set is not a simple problem, because Markov networks…

Machine Learning · Computer Science 2012-06-19 Kazuya Takabatake , Shotaro Akaho