English

Iterated Entropy Derivatives and Binary Entropy Inequalities

Information Theory 2025-01-15 v2 Combinatorics math.IT Number Theory

Abstract

We embark on a systematic study of the (k+1)(k+1)-th derivative of xkrH(xr)x^{k-r}H(x^r), where H(x):=xlogx(1x)log(1x)H(x):=-x\log x-(1-x)\log(1-x) is the binary entropy and k>r1k>r\geq 1 are integers. Our motivation is the conjectural entropy inequality αkH(xk)xk1H(x)\alpha_k H(x^k)\geq x^{k-1}H(x), where 0<αk<10<\alpha_k<1 is given by a functional equation. The k=2k=2 case was the key technical tool driving recent breakthroughs on the union-closed sets conjecture. We express dk+1dxk+1xkrH(xr) \frac{d^{k+1}}{dx^{k+1}}x^{k-r}H(x^r) as a rational function, an infinite series, and a sum over generalized Stirling numbers. This allows us to reduce the proof of the entropy inequality for real kk to showing that an associated polynomial has only two real roots in the interval (0,1)(0,1), which also allows us to prove the inequality for fractional exponents such as k=3/2k=3/2. The proof suggests a new framework for proving tight inequalities for the sum of polynomials times the logarithms of polynomials, which converts the inequality into a statement about the real roots of a simpler associated polynomial.

Keywords

Cite

@article{arxiv.2312.14743,
  title  = {Iterated Entropy Derivatives and Binary Entropy Inequalities},
  author = {Tanay Wakhare},
  journal= {arXiv preprint arXiv:2312.14743},
  year   = {2025}
}

Comments

v2, 15 pages

R2 v1 2026-06-28T13:59:56.951Z