Alternating Optimization Approach for Computing $\alpha$-Mutual Information and $\alpha$-Capacity
Information Theory
2025-05-01 v5 math.IT
Abstract
This study presents alternating optimization (AO) algorithms for computing -mutual information (-MI) and -capacity based on variational characterizations of -MI using a reverse channel. Specifically, we derive several variational characterizations of Sibson, Arimoto, Augustin--Csisz{\' a}r, and Lapidoth--Pfister MI and introduce novel AO algorithms for computing -MI and -capacity; their performances for computing -capacity are also compared. The comparison results show that the AO algorithm based on the Sibson MI's characterization has the fastest convergence speed.
Keywords
Cite
@article{arxiv.2404.10950,
title = {Alternating Optimization Approach for Computing $\alpha$-Mutual Information and $\alpha$-Capacity},
author = {Akira Kamatsuka and Koki Kazama and Takahiro Yoshida},
journal= {arXiv preprint arXiv:2404.10950},
year = {2025}
}