English

On relative universality, regression operator, and conditional independence

Statistics Theory 2025-04-16 v1 Methodology Machine Learning Statistics Theory

Abstract

The notion of relative universality with respect to a {\sigma}-field was introduced to establish the unbiasedness and Fisher consistency of an estimator in nonlinear sufficient dimension reduction. However, there is a gap in the proof of this result in the existing literature. The existing definition of relative universality seems to be too strong for the proof to be valid. In this note we modify the definition of relative universality using the concept of \k{o}-measurability, and rigorously establish the mentioned unbiasedness and Fisher consistency. The significance of this result is beyond its original context of sufficient dimension reduction, because relative universality allows us to use the regression operator to fully characterize conditional independence, a crucially important statistical relation that sits at the core of many areas and methodologies in statistics and machine learning, such as dimension reduction, graphical models, probability embedding, causal inference, and Bayesian estimation.

Keywords

Cite

@article{arxiv.2504.11044,
  title  = {On relative universality, regression operator, and conditional independence},
  author = {Bing Li and Ben Jones and Andreas Artemiou},
  journal= {arXiv preprint arXiv:2504.11044},
  year   = {2025}
}

Comments

19 pages

R2 v1 2026-06-28T22:58:54.151Z