English

Large Deviation Analysis for the Reverse Shannon Theorem

Information Theory 2025-06-06 v2 math.IT

Abstract

Channel simulation is to simulate a noisy channel using noiseless channels with unlimited shared randomness. This can be interpreted as the reverse problem to Shannon's noisy coding theorem. In contrast to previous works, our approach employs R\'enyi divergence (with the parameter α(0,)\alpha\in(0,\infty)) to measure the level of approximation. Specifically, we obtain the reverse Shannon theorem under the R\'enyi divergence, which characterizes the R\'enyi simulation rate, the minimum communication cost rate required for the R\'enyi divergence vanishing asymptotically. We also investigate the behaviors of the R\'enyi divergence when the communication cost rate is above or below the R\'enyi simulation rate. When the communication cost rate is above the R\'enyi simulation rate, we provide a complete characterization of the convergence exponent, called the reliability function. When the communication cost rate is below the R\'enyi simulation rate, we determine the linear increasing rate for the R\'enyi divergence with parameter α(0,]\alpha\in(0,\infty], which implies the strong converse exponent for the α\alpha-order fidelity.

Keywords

Cite

@article{arxiv.2410.07984,
  title  = {Large Deviation Analysis for the Reverse Shannon Theorem},
  author = {Shi-Bing Li and Ke Li and Lei Yu},
  journal= {arXiv preprint arXiv:2410.07984},
  year   = {2025}
}

Comments

See also concurrent and independent works arXiv:2410.07051 and arXiv:2410.10770. V1: prelimilary version. V2: presentation significantly improved, errors and typos fixed

R2 v1 2026-06-28T19:16:19.684Z