English

A new measure of dependence: Integrated $R^2$

Statistics Theory 2026-01-14 v5 Information Theory math.IT Probability Methodology Statistics Theory

Abstract

We introduce a novel measure of dependence that captures the extent to which a random variable YY is determined by a random vector XX. The measure equals zero precisely when YY and XX are independent, and it attains one exactly when YY is almost surely a measurable function of XX. We further extend this framework to define a measure of conditional dependence between YY and XX given ZZ. We propose a simple and interpretable estimator with computational complexity comparable to classical correlation coefficients, including those of Pearson, Spearman, and Chatterjee. Leveraging this dependence measure, we develop a tuning-free, model-agnostic variable selection procedure and establish its consistency under appropriate sparsity conditions. Extensive experiments on synthetic and real datasets highlight the strong empirical performance of our methodology and demonstrate substantial gains over existing approaches.

Keywords

Cite

@article{arxiv.2505.18146,
  title  = {A new measure of dependence: Integrated $R^2$},
  author = {Mona Azadkia and Pouya Roudaki},
  journal= {arXiv preprint arXiv:2505.18146},
  year   = {2026}
}

Comments

corrected citations