A Gallager-Type Redundancy Bound for Binary Shannon-Fano Coding
Abstract
Kraj\v{c}i, Liu, Mike\v{s}, and Moser proved in 2015 that the redundancy of binary Shannon-Fano coding is always below one bit. We sharpen this to a bound depending on the largest source probability : an explicit seven-piece envelope . The envelope equals the exact supremum of given for every and on a subinterval below , and gives the cap for . It is the first -dependent redundancy bound for Fano codes. The method is more sophisticated than the approach typical for Huffman codes: Fano trees are built top-down by contiguous balanced splits and lack the sibling property. From the theorem the rest follows from the Fano recursion, through a min-corrected affine potential and a no-burial lemma. Every scalar inequality in the proof reduces to a comparison of integer powers.
Cite
@article{arxiv.2607.04192,
title = {A Gallager-Type Redundancy Bound for Binary Shannon-Fano Coding},
author = {Kamila Szewczyk},
journal= {arXiv preprint arXiv:2607.04192},
year = {2026}
}
Comments
16 pages