English

Mean Testing under Truncation beyond Gaussian

Machine Learning 2026-05-05 v1 Machine Learning Statistics Theory Statistics Theory

Abstract

We characterize the fundamental limits of high-dimensional mean testing under arbitrary truncation, where samples are drawn from the conditional distribution P(S)P(\cdot \mid S) for an unknown truncation set SS that may hide up to an ε\varepsilon-fraction of the probability mass. For distributions with pp-th directional moments of magnitude at most νP,p\nu_{P,p}, truncation induces a bias of order O(νP,pε11/p)O(\nu_{P,p}\varepsilon^{1-1/p}). This bias creates a sharp information-theoretic detectability floor: when the signal α\alpha falls below this threshold, the null and alternative hypotheses are indistinguishable even with infinite data. Above this floor, we prove that a simple second-order test achieving near-optimal sample complexity n=O ⁣(ΣP(α4νP,pε11/p)2d)n = O\!\left(\frac{\|\Sigma_P\|}{(\alpha-4\nu_{P,p}\varepsilon^{1-1/p})^2}\sqrt{d}\right). We further identify a structural escape from this finite-moment bias barrier. Under a directional median regularity assumption, truncation bias improves to linear order O(ε)O(\varepsilon). This reveals an intermediate regime in which estimation requires Θ(d)\Theta(d) samples for uniform recovery, while testing recovers the classical Θ(d)\Theta(\sqrt d) rate once truncation bias is eliminated. Together, our results provide a unified framework for mean testing under truncation, connecting finite-moment, sub-Gaussian, and median-regular structural regimes.

Keywords

Cite

@article{arxiv.2605.01335,
  title  = {Mean Testing under Truncation beyond Gaussian},
  author = {Yuhao Wang and Roberto Imbuzeiro Oliveira and Themis Gouleakis},
  journal= {arXiv preprint arXiv:2605.01335},
  year   = {2026}
}
R2 v1 2026-07-01T12:46:29.112Z