English

Qualitative Mechanism Independence

Information Theory 2025-01-28 v1 math.IT

Abstract

We define what it means for a joint probability distribution to be compatible with a set of independent causal mechanisms, at a qualitative level -- or, more precisely, with a directed hypergraph A{\mathcal{A}}, which is the qualitative structure of a probabilistic dependency graph (PDG). When A{\mathcal{A}} represents a qualitative Bayesian network, QIM-compatibility with A{\mathcal{A}} reduces to satisfying the appropriate conditional independencies. But giving semantics to hypergraphs using QIM-compatibility lets us do much more. For one thing, we can capture functional dependencies. For another, we can capture important aspects of causality using compatibility: we can use compatibility to understand cyclic causal graphs, and to demonstrate structural compatibility, we must essentially produce a causal model. Finally, QIM-compatibility has deep connections to information theory. Applying our notion to cyclic structures helps to clarify a longstanding conceptual issue in information theory.

Keywords

Cite

@article{arxiv.2501.15488,
  title  = {Qualitative Mechanism Independence},
  author = {Oliver E Richardson and Spencer Peters and Joseph Y Halpern},
  journal= {arXiv preprint arXiv:2501.15488},
  year   = {2025}
}

Comments

NeurIPS 2024

R2 v1 2026-06-28T21:18:11.350Z