On the Efficient Implementation of High Accuracy Optimality of Profile Maximum Likelihood
Machine Learning
2022-10-14 v1 Data Structures and Algorithms
Information Theory
Machine Learning
math.IT
Computation
Abstract
We provide an efficient unified plug-in approach for estimating symmetric properties of distributions given independent samples. Our estimator is based on profile-maximum-likelihood (PML) and is sample optimal for estimating various symmetric properties when the estimation error . This result improves upon the previous best accuracy threshold of achievable by polynomial time computable PML-based universal estimators [ACSS21, ACSS20]. Our estimator reaches a theoretical limit for universal symmetric property estimation as [Han21] shows that a broad class of universal estimators (containing many well known approaches including ours) cannot be sample optimal for every -Lipschitz property when .
Cite
@article{arxiv.2210.06728,
title = {On the Efficient Implementation of High Accuracy Optimality of Profile Maximum Likelihood},
author = {Moses Charikar and Zhihao Jiang and Kirankumar Shiragur and Aaron Sidford},
journal= {arXiv preprint arXiv:2210.06728},
year = {2022}
}
Comments
Accepted at NeurIPS 2022