English

Parameter Priors for Directed Acyclic Graphical Models and the Characterization of Several Probability Distributions

Machine Learning 2021-07-01 v2 Machine Learning Statistics Theory Statistics Theory

Abstract

We develop simple methods for constructing parameter priors for model choice among Directed Acyclic Graphical (DAG) models. In particular, we introduce several assumptions that permit the construction of parameter priors for a large number of DAG models from a small set of assessments. We then present a method for directly computing the marginal likelihood of every DAG model given a random sample with no missing observations. We apply this methodology to Gaussian DAG models which consist of a recursive set of linear regression models. We show that the only parameter prior for complete Gaussian DAG models that satisfies our assumptions is the normal-Wishart distribution. Our analysis is based on the following new characterization of the Wishart distribution: let WW be an n×nn \times n, n3n \ge 3, positive-definite symmetric matrix of random variables and f(W)f(W) be a pdf of WW. Then, f(W)(W) is a Wishart distribution if and only if W11W12W221W12W_{11} - W_{12} W_{22}^{-1} W'_{12} is independent of {W12,W22}\{W_{12},W_{22}\} for every block partitioning W11,W12,W12,W22W_{11},W_{12}, W'_{12}, W_{22} of WW. Similar characterizations of the normal and normal-Wishart distributions are provided as well.

Keywords

Cite

@article{arxiv.2105.03248,
  title  = {Parameter Priors for Directed Acyclic Graphical Models and the Characterization of Several Probability Distributions},
  author = {Dan Geiger and David Heckerman},
  journal= {arXiv preprint arXiv:2105.03248},
  year   = {2021}
}

Comments

This version has improved pointers to the literature. arXiv admin note: substantial text overlap with arXiv:1301.6697

R2 v1 2026-06-24T01:52:34.677Z