English

Pairwise-Independent Dithering for Single-Stage Hadamard Quantization

Data Structures and Algorithms 2026-08-03 v1

Abstract

Quantizing high-dimensional vectors is fundamental to similarity search, distributed learning, and model compression. Feng, Indyk, Kapralov, Krachun, and Prokhorov established sharp guarantees for an unbiased dithered quantizer based on a randomized Hadamard transform [FIK+26]. Their 1/d1/d-scale inner-product estimator, however, uses a second randomized transform and residual quantization, increasing both communication and the leading constant in the proved bound. We show that this extra stage is unnecessary: pairwise-independent dithers across Hadamard coordinates suffice. The resulting unbiased single-stage estimator uses bb bits per coordinate and achieves E ⁣[y,x^x2](3π32+o(1))y22d4b, \mathbb{E}\!\left[ \left|\left\langle y,\widehat{x}-x\right\rangle\right|^2 \right] \leq \left(\frac{3\pi\sqrt{3}}{2}+o(1)\right) \frac{\lVert y\rVert_2^2}{d\,4^b}, as bb\to\infty, with a dimension-free o(1)o(1) term uniform over unit inputs and fixed queries. Compared with the two-stage construction of Feng et al., it eliminates the residual-stage O(d)O(d)-bit payload and reduces the leading upper-bound constant by a factor of approximately 5.935.93. The proof was first obtained using a fully automated Gemini-based agentic system developed internally at Google. The authors have verified the proof and edited it for clarity of presentation.

Cite

@article{arxiv.2608.02564,
  title  = {Pairwise-Independent Dithering for Single-Stage Hadamard Quantization},
  author = {Honghao Lin and Vahab Mirrokni and David P. Woodruff},
  journal= {arXiv preprint arXiv:2608.02564},
  year   = {2026}
}