English

Pareto-type finite-block optimality for source codes: a constrained Markov example

Information Theory 2026-05-06 v1 math.IT

Abstract

We study a Pareto-type notion of finite-block optimality for injective source codes, where two codes are compared through the full sequence of expected block lengths. As a concrete and fully analyzable test case, we revisit the four-symbol constrained Markov source introduced by Dalai and Leonardi in their "meaningful example'' on constrained-source decodability. For each admissible nonempty string u=x1mAX+u=x_1^m \in \mathscr{A} \subset \mathscr{X}^+, let K(u):=log2P(X1m=u) K(u):=-\log_2 \mathbb{P}(X_1^m=u) denote its information cost. We construct a canonical injective binary mapping C:A{0,1}+C:\mathscr{A} \to \{0,1\}^+ by ordering admissible strings by increasing K(u)K(u), then by length and lexicographic order, and assigning binary strings in shortlex order. For the length-nn block X1nX_1^n we prove E[C(X1)]=32,E[C(X1n)]<32n(n2). \mathbb{E}[|C(X_1)|]=\tfrac32, \qquad \mathbb{E}[|C(X_1^n)|]<\tfrac32\,n\quad (n\ge 2). Moreover, for every fixed 0<c<218π 0<c<\frac{\sqrt2}{18\sqrt\pi} we have E[C(X1n)]32ncn \mathbb{E}[|C(X_1^n)|]\le \tfrac32\,n-\frac{c}{\sqrt n} for all sufficiently large nn. Thus, for this source, the reversible Dalai-Leonardi code is not Pareto-optimal with respect to finite-block average length. The proof is based on an exact enumeration of admissible strings by information cost and on a shortlex gap identity implying that each cost class splits evenly between lengths K(u)1K(u)-1 and K(u)K(u). The example is simple, but it already exhibits the kind of finite-block Pareto comparison that seems natural for injective source coding under source constraints.

Keywords

Cite

@article{arxiv.2605.03552,
  title  = {Pareto-type finite-block optimality for source codes: a constrained Markov example},
  author = {Stefano Della Fiore},
  journal= {arXiv preprint arXiv:2605.03552},
  year   = {2026}
}
R2 v1 2026-07-01T12:50:32.209Z