English

Encoding of probability distributions for Asymmetric Numeral Systems

Information Theory 2022-07-05 v4 math.IT

Abstract

Many data compressors regularly encode probability distributions for entropy coding - requiring minimal description length type of optimizations. Canonical prefix/Huffman coding usually just writes lengths of bit sequences, this way approximating probabilities with powers-of-2. Operating on more accurate probabilities usually allows for better compression ratios, and is possible e.g. using arithmetic coding and Asymmetric Numeral Systems family. Especially the multiplication-free tabled variant of the latter (tANS) builds automaton often replacing Huffman coding due to better compression at similar computational cost - e.g. in popular Facebook Zstandard and Apple LZFSE compressors. There is discussed encoding of probability distributions for such applications, especially using Pyramid Vector Quantizer(PVQ)-based approach with deformation, bucket approximation, prefix trees, improving accuracy with additional bits, also tuned symbol spread for tANS.

Keywords

Cite

@article{arxiv.2106.06438,
  title  = {Encoding of probability distributions for Asymmetric Numeral Systems},
  author = {Jarek Duda},
  journal= {arXiv preprint arXiv:2106.06438},
  year   = {2022}
}

Comments

7 pages, 6 figures

R2 v1 2026-06-24T03:06:21.731Z