English

On learning parametric distributions from quantized samples

Information Theory 2022-07-22 v2 Machine Learning math.IT Statistics Theory Statistics Theory

Abstract

We consider the problem of learning parametric distributions from their quantized samples in a network. Specifically, nn agents or sensors observe independent samples of an unknown parametric distribution; and each of them uses kk bits to describe its observed sample to a central processor whose goal is to estimate the unknown distribution. First, we establish a generalization of the well-known van Trees inequality to general LpL_p-norms, with p>1p > 1, in terms of Generalized Fisher information. Then, we develop minimax lower bounds on the estimation error for two losses: general LpL_p-norms and the related Wasserstein loss from optimal transport.

Keywords

Cite

@article{arxiv.2105.12019,
  title  = {On learning parametric distributions from quantized samples},
  author = {Septimia Sarbu and Abdellatif Zaidi},
  journal= {arXiv preprint arXiv:2105.12019},
  year   = {2022}
}

Comments

Short version accepted for publication at the IEEE Information Theory Symposium (ISIT) 2021; this version contains the detailed proofs with some minor corrections

R2 v1 2026-06-24T02:27:14.367Z