English

A Constructive Method to Maximize Entropy under Marginal Constraints

Information Theory 2026-02-09 v2 math.IT Statistics Theory Statistics Theory

Abstract

We study the problem of maximizing R{\'e}nyi entropy of order 22 (equivalently, minimizing the index of coincidence) over the set of joint distributions with prescribed marginals. A closed-form optimizer is known under a feasibility condition on the marginals; we show that this condition is highly restrictive. We then provide an explicit construction of an optimal coupling for arbitrary marginals. Our approach characterizes the optimizer's structure and yields an iterative algorithm that terminates in finite time, returning an exact solution after at most p1p-1 updates, where pp is the number of rows.

Keywords

Cite

@article{arxiv.2601.09347,
  title  = {A Constructive Method to Maximize Entropy under Marginal Constraints},
  author = {Pierre Jean-Claude Robert Bertrand},
  journal= {arXiv preprint arXiv:2601.09347},
  year   = {2026}
}
R2 v1 2026-07-01T09:04:06.994Z