English

Optimal Prediction-Augmented Algorithms for Testing Independence of Distributions

Machine Learning 2026-03-06 v1 Data Structures and Algorithms Machine Learning

Abstract

Independence testing is a fundamental problem in statistical inference: given samples from a joint distribution pp over multiple random variables, the goal is to determine whether pp is a product distribution or is ϵ\epsilon-far from all product distributions in total variation distance. In the non-parametric finite-sample regime, this task is notoriously expensive, as the minimax sample complexity scales polynomially with the support size. In this work, we move beyond these worst-case limitations by leveraging the framework of \textit{augmented distribution testing}. We design independence testers that incorporate auxiliary, but potentially untrustworthy, predictive information. Our framework ensures that the tester remains robust, maintaining worst-case validity regardless of the prediction's quality, while significantly improving sample efficiency when the prediction is accurate. Our main contributions include: (i) a bivariate independence tester for discrete distributions that adaptively reduces sample complexity based on the prediction error; (ii) a generalization to the high-dimensional multivariate setting for testing the independence of dd random variables; and (iii) matching minimax lower bounds demonstrating that our testers achieve optimal sample complexity.

Keywords

Cite

@article{arxiv.2603.04635,
  title  = {Optimal Prediction-Augmented Algorithms for Testing Independence of Distributions},
  author = {Maryam Aliakbarpour and Alireza Azizi and Ria Stevens},
  journal= {arXiv preprint arXiv:2603.04635},
  year   = {2026}
}
R2 v1 2026-07-01T11:04:01.184Z