English

Efficient Statistics, in High Dimensions, from Truncated Samples

Statistics Theory 2020-10-26 v2 Data Structures and Algorithms Machine Learning Computation Machine Learning Statistics Theory

Abstract

We provide an efficient algorithm for the classical problem, going back to Galton, Pearson, and Fisher, of estimating, with arbitrary accuracy the parameters of a multivariate normal distribution from truncated samples. Truncated samples from a dd-variate normal N(μ,Σ){\cal N}(\mathbf{\mu},\mathbf{\Sigma}) means a samples is only revealed if it falls in some subset SRdS \subseteq \mathbb{R}^d; otherwise the samples are hidden and their count in proportion to the revealed samples is also hidden. We show that the mean μ\mathbf{\mu} and covariance matrix Σ\mathbf{\Sigma} can be estimated with arbitrary accuracy in polynomial-time, as long as we have oracle access to SS, and SS has non-trivial measure under the unknown dd-variate normal distribution. Additionally we show that without oracle access to SS, any non-trivial estimation is impossible.

Keywords

Cite

@article{arxiv.1809.03986,
  title  = {Efficient Statistics, in High Dimensions, from Truncated Samples},
  author = {Constantinos Daskalakis and Themis Gouleakis and Christos Tzamos and Manolis Zampetakis},
  journal= {arXiv preprint arXiv:1809.03986},
  year   = {2020}
}

Comments

Appeared at 59th Annual IEEE Symposium on Foundations of Computer Science (FOCS), 2018

R2 v1 2026-06-23T04:02:38.672Z