English

A Gallager-Type Redundancy Bound for Binary Shannon-Fano Coding

Information Theory 2026-07-05 v1 Probability

Abstract

Kraj\v{c}i, Liu, Mike\v{s}, and Moser proved in 2015 that the redundancy of binary Shannon-Fano coding is always below one bit. We sharpen this to a bound depending on the largest source probability p1p_1: an explicit seven-piece envelope R<f(p1)R<f(p_1). The envelope equals the exact supremum of RR given p1p_1 for every p112p_1\ge\tfrac12 and on a subinterval below 13\tfrac13, and gives the cap R<5256log25=0.5651R<\tfrac52-\tfrac56\log_2 5=0.5651 for p1<12p_1<\tfrac12. It is the first p1p_1-dependent redundancy bound for Fano codes. The method is more sophisticated than the approach typical for Huffman codes: Fano trees are built top-down by contiguous balanced splits and lack the sibling property. From the R<1R<1 theorem the rest follows from the Fano recursion, through a min-corrected affine potential and a no-burial lemma. Every scalar inequality in the proof reduces to a comparison of integer powers.

Cite

@article{arxiv.2607.04192,
  title  = {A Gallager-Type Redundancy Bound for Binary Shannon-Fano Coding},
  author = {Kamila Szewczyk},
  journal= {arXiv preprint arXiv:2607.04192},
  year   = {2026}
}

Comments

16 pages