English

Beacon: Post-Training Quantization with Integrated Grid Selection

Machine Learning 2026-02-18 v2 Artificial Intelligence

Abstract

Quantization is a widely used compression technique for reducing the memory and computation costs of large pre-trained models. A key challenge in per-channel post-training quantization (PTQ) is selecting appropriate scaling factors to replace weight values with values from a scaled integer grid. Existing methods typically fix the scale at the outset via heuristic tuning or grid search. We propose Beacon, a simple and effective algorithm that eliminates the need for such manual tuning. Beacon performs per-channel PTQ directly using an unscaled grid and automatically determines the optimal scaling factors by exploiting the geometry of scalar quantization. It does not rely on back-propagation or large calibration sets. Despite its simplicity and tuning-free nature, Beacon achieves competitive performance compared to state-of-the-art methods, making it a practical solution for efficient model deployment.

Keywords

Cite

@article{arxiv.2508.20293,
  title  = {Beacon: Post-Training Quantization with Integrated Grid Selection},
  author = {Shihao Zhang and Rayan Saab},
  journal= {arXiv preprint arXiv:2508.20293},
  year   = {2026}
}
R2 v1 2026-07-01T05:09:22.805Z