English

Order-Optimal Sequential 1-Bit Mean Estimation in General Tail Regimes

Machine Learning 2026-05-25 v2 Information Theory Machine Learning math.IT Statistics Theory Statistics Theory

Abstract

In this paper, we study the problem of mean estimation under 1-bit communication constraints. We propose a novel adaptive mean estimator based solely on randomized threshold queries, where each 1-bit outcome indicates whether a given sample exceeds a sequentially chosen threshold. Our estimator is (ϵ,δ)(\epsilon, \delta)-PAC for any distribution with a bounded mean μ[λ,λ]\mu \in [-\lambda, \lambda] and a bounded kk-th central moment E[Xμk]σk\mathbb{E}[|X-\mu|^k] \le \sigma^k for any fixed k>1k > 1. Moreover, our sample complexity is order-optimal in all such tail regimes, i.e., for every such kk value. For k2k \neq 2, our estimator's sample complexity matches the unquantized minimax lower bounds plus an unavoidable O(log(λ/σ))O(\log(\lambda/\sigma)) localization cost. For the finite-variance case (k=2k=2), our estimator's sample complexity has an extra multiplicative O(log(σ/ϵ))O(\log(\sigma/\epsilon)) penalty, and we establish a novel information-theoretic lower bound showing that this penalty is a fundamental limit of 1-bit quantization. We also establish a significant adaptivity gap: for both threshold queries and more general interval queries, the sample complexity of any non-adaptive estimator must scale linearly with the search space parameter λ/σ\lambda/\sigma, rendering it vastly less sample efficient than our adaptive approach. Finally, we present algorithmic variants that (i) handle an unknown sampling budget, (ii) adapt to an unknown scale parameter σ\sigma given (possibly loose) bounds, (iii) require only two stages of adaptivity to achieve order-optimal sample complexity at the expense of more general 1-bit queries, and (iv) leverage multiple local samples per 1-bit query to proportionally reduce communication costs.

Keywords

Cite

@article{arxiv.2604.07796,
  title  = {Order-Optimal Sequential 1-Bit Mean Estimation in General Tail Regimes},
  author = {Ivan Lau and Jonathan Scarlett},
  journal= {arXiv preprint arXiv:2604.07796},
  year   = {2026}
}

Comments

This article substantially extends the AISTATS version, arXiv:2509.21940

R2 v1 2026-07-01T12:00:31.821Z