A Class of Nonbinary Symmetric Information Bottleneck Problems
Information Theory
2021-10-05 v1 math.IT
Abstract
We study two dual settings of information processing. Let be a Markov chain with fixed joint probability mass function and a mutual information constraint on the pair . For the first problem, known as Information Bottleneck, we aim to maximize the mutual information between the random variables and , while for the second problem, termed as Privacy Funnel, our goal is to minimize it. In particular, we analyze the scenario for which is the input, and is the output of modulo-additive noise channel. We provide analytical characterization of the optimal information rates and the achieving distributions.
Cite
@article{arxiv.2110.00985,
title = {A Class of Nonbinary Symmetric Information Bottleneck Problems},
author = {Michael Dikshtein and Shlomo Shamai},
journal= {arXiv preprint arXiv:2110.00985},
year = {2021}
}
Comments
7 pages, 4 figures, Submitted to the 2022 International Zurich Seminar on Information and Communication