English

One-Bit Distributed Mean Estimation with Unknown Variance

Information Theory 2025-10-10 v3 math.IT Statistics Theory Statistics Theory

Abstract

In this work, we study the problem of distributed mean estimation with 11-bit communication constraints when the variance is unknown. We focus on the specific case where each user has access to one i.i.d. sample drawn from a distribution that belongs to a scale-location family, and is limited to sending just a single bit of information to a central server whose goal is to estimate the mean. We propose simple non-adaptive and adaptive protocols that are shown to be asymptotically normal. We derive bounds on the asymptotic (in the number of users) Mean Squared Error (MSE) achieved by these protocols. For a class of symmetric log-concave distributions, we derive matching lower bounds for the MSE achieved by adaptive protocols, proving the optimality of our scheme. Furthermore, we develop a lower bound on the MSE for non-adaptive protocols that applies to any symmetric strictly log-concave distribution by means of a refined squared Hellinger distance analysis. Through this, we show that for many common distributions including a subclass of the generalized Gaussian family, the asymptotic minimax MSE achieved by the best non-adaptive protocol is higher than that achieved by our simple adaptive protocol. Our simulation results confirm a positive gap between the adaptive and non-adaptive settings, aligning with the theoretical bounds.

Keywords

Cite

@article{arxiv.2501.18502,
  title  = {One-Bit Distributed Mean Estimation with Unknown Variance},
  author = {Ritesh Kumar and Shashank Vatedka},
  journal= {arXiv preprint arXiv:2501.18502},
  year   = {2025}
}

Comments

40 pages, significantly updated version. This includes a lower bound for the asymptotic MSE achieved by non-adaptive protocols for a general class of log-concave distributions

R2 v1 2026-06-28T21:25:59.239Z