English

Conditional probability logic, lifted bayesian networks and almost sure quantifier elimination

Logic 2021-08-19 v3

Abstract

We introduce a formal logical language, called conditional probability logic (CPL), which extends first-order logic and which can express probabilities, conditional probabilities and which can compare conditional probabilities. Intuitively speaking, although formal details are different, CPL can express the same kind of statements as some languages which have been considered in the artificial intelligence community. We also consider a way of making precise the notion of lifted Bayesian network, where this notion is a type of (lifted) probabilistic graphical model used in machine learning, data mining and artificial intelligence. A lifted Bayesian network (in the sense defined here) determines, in a natural way, a probability distribution on the set of all structures (in the sense of first-order logic) with a common finite domain DD. Our main result is that for every "noncritical" CPL-formula φ(xˉ)\varphi(\bar{x}) there is a quantifier-free formula φ(xˉ)\varphi^*(\bar{x}) which is "almost surely" equivalent to φ(xˉ)\varphi(\bar{x}) as the cardinality of DD tends towards infinity. This is relevant for the problem of making probabilistic inferences on large domains DD, because (a) the problem of evaluating, by "brute force", the probability of φ(xˉ)\varphi(\bar{x}) being true for some sequence dˉ\bar{d} of elements from DD has, in general, (highly) exponential time complexity in the cardinality of DD, and (b) the corresponding probability for the quantifier-free φ(xˉ)\varphi^*(\bar{x}) depends only on the lifted Bayesian network and not on DD. The main result has two corollaries, one of which is a convergence law (and zero-one law) for noncritial CPL-formulas.

Keywords

Cite

@article{arxiv.2004.01649,
  title  = {Conditional probability logic, lifted bayesian networks and almost sure quantifier elimination},
  author = {Vera Koponen},
  journal= {arXiv preprint arXiv:2004.01649},
  year   = {2021}
}

Comments

This version of the article corrects an embarrassing typo in the journal version (in Theoretical Computer Science) of the article, as well as some other typos. The main correction is that '1 - e^{-cn}' in Theorem 3.15 in the journal version has been replaced with 'e^{-cn}' (which is the intended expression) in this version

R2 v1 2026-06-23T14:38:32.165Z