English

Information Bottleneck under Perfect Privacy

Information Theory 2026-08-11 v1 Machine Learning

Abstract

In this work, we study the information bottleneck under perfect privacy, with particular emphasis on the active-rate regime, where the representation-rate constraint is binding and directly limits the achievable utility. The goal is to construct a representation that preserves utility-relevant information while remaining statistically independent of a sensitive variable. This exact independence requirement introduces an additional constraint beyond the classical rate-relevance tradeoff and must be explicitly incorporated into the optimization. To this end, we develop an alternating direction method of multipliers (ADMM)-based method tailored to the resulting problem structure. Under suitable regularity conditions, we establish global convergence of the generated sequence, characterize its convergence rate through the Kurdyka-Lojasiewicz exponent, and extend the analysis to inexact block updates.

Keywords

Cite

@article{arxiv.2608.11003,
  title  = {Information Bottleneck under Perfect Privacy},
  author = {Junle Zhong and Mohamad Assaad and Sreejith Sreekumar},
  journal= {arXiv preprint arXiv:2608.11003},
  year   = {2026}
}