English

A Revisit to Rate-distortion Theory via Optimal Weak Transport

Information Theory 2025-01-27 v3 math.IT

Abstract

This paper revisits the rate-distortion theory from the perspective of optimal weak transport, as recently introduced by Gozlan et al. While the conditions for optimality and the existence of solutions are well-understood in the case of discrete alphabets, the extension to abstract alphabets requires more intricate analysis. Within the framework of weak transport problems, we derive a parametric representation of the rate-distortion function, thereby connecting the rate-distortion function with the Schr\"odinger bridge problem, and establish necessary conditions for its optimality. As a byproduct of our analysis, we reproduce K. Rose's conclusions regarding the achievability of Shannon lower bound concisely, without reliance on variational calculus.

Keywords

Cite

@article{arxiv.2501.09362,
  title  = {A Revisit to Rate-distortion Theory via Optimal Weak Transport},
  author = {Jiayang Zou and Luyao Fan and Jiayang Gao and Jia Wang},
  journal= {arXiv preprint arXiv:2501.09362},
  year   = {2025}
}

Comments

12 pages