English

Interaction Measures, Partition Lattices and Kernel Tests for High-Order Interactions

Machine Learning 2023-11-08 v3 Machine Learning Statistics Theory Statistics Theory

Abstract

Models that rely solely on pairwise relationships often fail to capture the complete statistical structure of the complex multivariate data found in diverse domains, such as socio-economic, ecological, or biomedical systems. Non-trivial dependencies between groups of more than two variables can play a significant role in the analysis and modelling of such systems, yet extracting such high-order interactions from data remains challenging. Here, we introduce a hierarchy of dd-order (d2d \geq 2) interaction measures, increasingly inclusive of possible factorisations of the joint probability distribution, and define non-parametric, kernel-based tests to establish systematically the statistical significance of dd-order interactions. We also establish mathematical links with lattice theory, which elucidate the derivation of the interaction measures and their composite permutation tests; clarify the connection of simplicial complexes with kernel matrix centring; and provide a means to enhance computational efficiency. We illustrate our results numerically with validations on synthetic data, and through an application to neuroimaging data.

Keywords

Cite

@article{arxiv.2306.00904,
  title  = {Interaction Measures, Partition Lattices and Kernel Tests for High-Order Interactions},
  author = {Zhaolu Liu and Robert L. Peach and Pedro A. M. Mediano and Mauricio Barahona},
  journal= {arXiv preprint arXiv:2306.00904},
  year   = {2023}
}

Comments

22 pages, 9 figures

R2 v1 2026-06-28T10:53:39.619Z