English

Conformal Sparsification for Bandwidth-Efficient Edge-Cloud Speculative Decoding

Machine Learning 2025-10-14 v1 Artificial Intelligence Information Theory math.IT

Abstract

Edge-cloud speculative decoding (SD) accelerates inference by having a cloud-based large language model (LLM) that verifies draft tokens generated by a resource-constrained small language model (SLM) at the edge. A central bottleneck is the limited bandwidth of the edge-cloud link, which necessitates efficient compression of draft token distributions. We first derive an information-theoretic bound that decomposes the token rejection rate into contributions from SLM-LLM distribution mismatch and from quantization distortion. Guided by this analysis, we propose the Sparse Quantize-and-Sample SD (SQS-SD) framework, which exploits distributional sparsity through structured sparsification and lattice-based quantization. Within this framework, K-SQS applies fixed top-K truncation, while C-SQS adaptively adjusts the retained token set via online conformal prediction to ensure bounded deviation from the dense distribution. Empirical results confirm that both approaches improve end-to-end latency and rejection rates in complimentary operating regimes.

Keywords

Cite

@article{arxiv.2510.09942,
  title  = {Conformal Sparsification for Bandwidth-Efficient Edge-Cloud Speculative Decoding},
  author = {Payel Bhattacharjee and Fengwei Tian and Meiyu Zhong and Guangyi Zhang and Osvaldo Simeone and Ravi Tandon},
  journal= {arXiv preprint arXiv:2510.09942},
  year   = {2025}
}

Comments

39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: AI and ML for Next-Generation Wireless Communications and Networking (AI4NextG)