English

Post-Training BatchNorm Recalibration

Machine Learning 2020-10-13 v1

Abstract

We revisit non-blocking simultaneous multithreading (NB-SMT) introduced previously by Shomron and Weiser (2020). NB-SMT trades accuracy for performance by occasionally "squeezing" more than one thread into a shared multiply-and-accumulate (MAC) unit. However, the method of accommodating more than one thread in a shared MAC unit may contribute noise to the computations, thereby changing the internal statistics of the model. We show that substantial model performance can be recouped by post-training recalibration of the batch normalization layers' running mean and running variance statistics, given the presence of NB-SMT.

Keywords

Cite

@article{arxiv.2010.05625,
  title  = {Post-Training BatchNorm Recalibration},
  author = {Gil Shomron and Uri Weiser},
  journal= {arXiv preprint arXiv:2010.05625},
  year   = {2020}
}
R2 v1 2026-06-23T19:16:27.845Z