English

Exact Distribution-Free Hypothesis Tests for the Regression Function of Binary Classification via Conditional Kernel Mean Embeddings

Machine Learning 2022-06-22 v2 Machine Learning

Abstract

In this paper we suggest two statistical hypothesis tests for the regression function of binary classification based on conditional kernel mean embeddings. The regression function is a fundamental object in classification as it determines both the Bayes optimal classifier and the misclassification probabilities. A resampling based framework is presented and combined with consistent point estimators of the conditional kernel mean map, in order to construct distribution-free hypothesis tests. These tests are introduced in a flexible manner allowing us to control the exact probability of type I error for any sample size. We also prove that both proposed techniques are consistent under weak statistical assumptions, i.e., the type II error probabilities pointwise converge to zero.

Keywords

Cite

@article{arxiv.2103.05126,
  title  = {Exact Distribution-Free Hypothesis Tests for the Regression Function of Binary Classification via Conditional Kernel Mean Embeddings},
  author = {Ambrus Tamás and Balázs Csanád Csáji},
  journal= {arXiv preprint arXiv:2103.05126},
  year   = {2022}
}
R2 v1 2026-06-23T23:54:02.281Z