On learning parametric distributions from quantized samples
Abstract
We consider the problem of learning parametric distributions from their quantized samples in a network. Specifically, agents or sensors observe independent samples of an unknown parametric distribution; and each of them uses bits to describe its observed sample to a central processor whose goal is to estimate the unknown distribution. First, we establish a generalization of the well-known van Trees inequality to general -norms, with , in terms of Generalized Fisher information. Then, we develop minimax lower bounds on the estimation error for two losses: general -norms and the related Wasserstein loss from optimal transport.
Cite
@article{arxiv.2105.12019,
title = {On learning parametric distributions from quantized samples},
author = {Septimia Sarbu and Abdellatif Zaidi},
journal= {arXiv preprint arXiv:2105.12019},
year = {2022}
}
Comments
Short version accepted for publication at the IEEE Information Theory Symposium (ISIT) 2021; this version contains the detailed proofs with some minor corrections