English

Minimax Estimation of Kernel Stein Discrepancy: Trace versus Hilbert-Schmidt Scales

Statistics Theory 2026-07-03 v1 Machine Learning

Abstract

Kernel Stein Discrepancy (KSD) compares a sample to a fixed target distribution known only through its score, and is widely used for goodness-of-fit testing, sample quality assessment, and approximate inference. We study the estimation of KSD(P0,P)\operatorname{KSD}(P_0,P) from nn independent observations and identify the sharp spectral constant governing the minimax risk: it is the Hilbert-Schmidt norm of the Stein covariance operator CC_\star, giving the minimax scale CHS/n\sqrt{\|C_\star\|_{\mathrm{HS}}/n}. This scale is attained by the positive-part square-root U-statistic, whereas the standard plug-in V-statistic remains at the trace scale tr(C)/n\sqrt{\operatorname{tr}(C_\star)/n} and is therefore suboptimal by the fourth root of the effective rank of CC_\star; for a Gaussian target with a fixed-bandwidth Gaussian kernel this factor is exponential in the dimension.

Cite

@article{arxiv.2607.03367,
  title  = {Minimax Estimation of Kernel Stein Discrepancy: Trace versus Hilbert-Schmidt Scales},
  author = {Davit Gogolashvili},
  journal= {arXiv preprint arXiv:2607.03367},
  year   = {2026}
}