English

Accelerating OpenPangu Inference on NPU via Speculative Decoding

Distributed, Parallel, and Cluster Computing 2026-03-05 v1

Abstract

To mitigate the Memory Wall bottleneck encountered by Large Language Models (LLMs) during inference on \textbf{NPU} hardware, and addressing the scarcity of native support for mainstream speculative decoding algorithms on domestic infrastructure, this study presents an end-to-end speculative inference acceleration scheme for OpenPangu-7B.

Keywords

Cite

@article{arxiv.2603.03383,
  title  = {Accelerating OpenPangu Inference on NPU via Speculative Decoding},
  author = {Yuntao Dai and Jing Wu and Hang Gu and Teng Wang},
  journal= {arXiv preprint arXiv:2603.03383},
  year   = {2026}
}
R2 v1 2026-07-01T11:01:53.565Z