English

Distributed Simulation of Continuous Random Variables

Information Theory 2018-12-11 v4 math.IT

Abstract

We establish the first known upper bound on the exact and Wyner's common information of nn continuous random variables in terms of the dual total correlation between them (which is a generalization of mutual information). In particular, we show that when the pdf of the random variables is log-concave, there is a constant gap of n2loge+9nlognn^{2}\log e+9n\log n between this upper bound and the dual total correlation lower bound that does not depend on the distribution. The upper bound is obtained using a computationally efficient dyadic decomposition scheme for constructing a discrete common randomness variable WW from which the nn random variables can be simulated in a distributed manner. We then bound the entropy of WW using a new measure, which we refer to as the erosion entropy.

Keywords

Cite

@article{arxiv.1601.05875,
  title  = {Distributed Simulation of Continuous Random Variables},
  author = {Cheuk Ting Li and Abbas El Gamal},
  journal= {arXiv preprint arXiv:1601.05875},
  year   = {2018}
}

Comments

21 pages, 6 figures, presented in part at IEEE International Symposium on Information Theory, Barcelona, July 2016

R2 v1 2026-06-22T12:34:37.304Z