On a Relation Between the Rate-Distortion Function and Optimal Transport
Information Theory
2023-07-04 v1 Machine Learning
math.IT
Abstract
We discuss a relationship between rate-distortion and optimal transport (OT) theory, even though they seem to be unrelated at first glance. In particular, we show that a function defined via an extremal entropic OT distance is equivalent to the rate-distortion function. We numerically verify this result as well as previous results that connect the Monge and Kantorovich problems to optimal scalar quantization. Thus, we unify solving scalar quantization and rate-distortion functions in an alternative fashion by using their respective optimal transport solvers.
Keywords
Cite
@article{arxiv.2307.00246,
title = {On a Relation Between the Rate-Distortion Function and Optimal Transport},
author = {Eric Lei and Hamed Hassani and Shirin Saeedi Bidokhti},
journal= {arXiv preprint arXiv:2307.00246},
year = {2023}
}
Comments
Published as a Tiny Paper at ICLR 2023; invited to present