Information Bottleneck under Perfect Privacy
Abstract
In this work, we study the information bottleneck under perfect privacy, with particular emphasis on the active-rate regime, where the representation-rate constraint is binding and directly limits the achievable utility. The goal is to construct a representation that preserves utility-relevant information while remaining statistically independent of a sensitive variable. This exact independence requirement introduces an additional constraint beyond the classical rate-relevance tradeoff and must be explicitly incorporated into the optimization. To this end, we develop an alternating direction method of multipliers (ADMM)-based method tailored to the resulting problem structure. Under suitable regularity conditions, we establish global convergence of the generated sequence, characterize its convergence rate through the Kurdyka-Lojasiewicz exponent, and extend the analysis to inexact block updates.
Cite
@article{arxiv.2608.11003,
title = {Information Bottleneck under Perfect Privacy},
author = {Junle Zhong and Mohamad Assaad and Sreejith Sreekumar},
journal= {arXiv preprint arXiv:2608.11003},
year = {2026}
}