Information Bottleneck on General Alphabets
Information Theory
2018-05-02 v2 math.IT
Abstract
We prove rigorously a source coding theorem that can probably be considered folklore, a generalization to arbitrary alphabets of a problem motivated by the Information Bottleneck method. For general random variables , we show essentially that for some , a function with rate limit and exists if and only if there is a random variable such that the Markov chain holds, and . The proof relies on the well established discrete case and showcases a technique for lifting discrete coding theorems to arbitrary alphabets.
Keywords
Cite
@article{arxiv.1801.01050,
title = {Information Bottleneck on General Alphabets},
author = {Georg Pichler and Günther Koliander},
journal= {arXiv preprint arXiv:1801.01050},
year = {2018}
}
Comments
extended version, presented at ISIT 2018, Vail, CO