English

Fast calculation of inverse square root with the use of magic constant $-$ analytical approach

Mathematical Software 2016-03-16 v1

Abstract

We present a mathematical analysis of transformations used in fast calculation of inverse square root for single-precision floating-point numbers. Optimal values of the so called magic constants are derived in a systematic way, minimizing either absolute or relative errors at subsequent stages of the discussed algorithm.

Keywords

Cite

@article{arxiv.1603.04483,
  title  = {Fast calculation of inverse square root with the use of magic constant $-$ analytical approach},
  author = {Leonid V. Moroz and Cezary J. Walczyk and Andriy Hrynchyshyn and Vijay Holimath and Jan L. Cieśliński},
  journal= {arXiv preprint arXiv:1603.04483},
  year   = {2016}
}

Comments

17 pages, 8 figures