English

A Class of Nonbinary Symmetric Information Bottleneck Problems

Information Theory 2021-10-05 v1 math.IT

Abstract

We study two dual settings of information processing. Let YXW \mathsf{Y} \rightarrow \mathsf{X} \rightarrow \mathsf{W} be a Markov chain with fixed joint probability mass function PXY \mathsf{P}_{\mathsf{X}\mathsf{Y}} and a mutual information constraint on the pair (W,X) (\mathsf{W},\mathsf{X}) . For the first problem, known as Information Bottleneck, we aim to maximize the mutual information between the random variables Y \mathsf{Y} and W \mathsf{W} , while for the second problem, termed as Privacy Funnel, our goal is to minimize it. In particular, we analyze the scenario for which X \mathsf{X} is the input, and Y \mathsf{Y} is the output of modulo-additive noise channel. We provide analytical characterization of the optimal information rates and the achieving distributions.

Keywords

Cite

@article{arxiv.2110.00985,
  title  = {A Class of Nonbinary Symmetric Information Bottleneck Problems},
  author = {Michael Dikshtein and Shlomo Shamai},
  journal= {arXiv preprint arXiv:2110.00985},
  year   = {2021}
}

Comments

7 pages, 4 figures, Submitted to the 2022 International Zurich Seminar on Information and Communication

R2 v1 2026-06-24T06:35:03.956Z