English

On the Efficient Implementation of High Accuracy Optimality of Profile Maximum Likelihood

Machine Learning 2022-10-14 v1 Data Structures and Algorithms Information Theory Machine Learning math.IT Computation

Abstract

We provide an efficient unified plug-in approach for estimating symmetric properties of distributions given nn independent samples. Our estimator is based on profile-maximum-likelihood (PML) and is sample optimal for estimating various symmetric properties when the estimation error ϵn1/3\epsilon \gg n^{-1/3}. This result improves upon the previous best accuracy threshold of ϵn1/4\epsilon \gg n^{-1/4} achievable by polynomial time computable PML-based universal estimators [ACSS21, ACSS20]. Our estimator reaches a theoretical limit for universal symmetric property estimation as [Han21] shows that a broad class of universal estimators (containing many well known approaches including ours) cannot be sample optimal for every 11-Lipschitz property when ϵn1/3\epsilon \ll n^{-1/3}.

Keywords

Cite

@article{arxiv.2210.06728,
  title  = {On the Efficient Implementation of High Accuracy Optimality of Profile Maximum Likelihood},
  author = {Moses Charikar and Zhihao Jiang and Kirankumar Shiragur and Aaron Sidford},
  journal= {arXiv preprint arXiv:2210.06728},
  year   = {2022}
}

Comments

Accepted at NeurIPS 2022

R2 v1 2026-06-28T03:30:48.173Z