English

Dirichlet polynomials and entropy

Information Theory 2021-10-29 v2 Category Theory math.IT

Abstract

A Dirichlet polynomial dd in one variable y{\mathcal{y}} is a function of the form d(y)=anny++a22y+a11y+a00yd({\mathcal{y}})=a_n n^{\mathcal{y}}+\cdots+a_22^{\mathcal{y}}+a_11^{\mathcal{y}}+a_00^{\mathcal{y}} for some n,a0,,anNn,a_0,\ldots,a_n\in\mathbb{N}. We will show how to think of a Dirichlet polynomial as a set-theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy H(d)H(d) of the corresponding probability distribution, and we define its length (or, classically, its perplexity) by L(d)=2H(d)L(d)=2^{H(d)}. On the other hand, we will define a rig homomorphism h ⁣:DirRecth\colon\mathsf{Dir}\to\mathsf{Rect} from the rig of Dirichlet polynomials to the so-called rectangle rig, whose underlying set is R0×R0\mathbb{R}_{\geq0}\times\mathbb{R}_{\geq0} and whose additive structure involves the weighted geometric mean; we write h(d)=(A(d),W(d))h(d)=(A(d),W(d)), and call the two components area and width (respectively). The main result of this paper is the following: the rectangle-area formula A(d)=L(d)W(d)A(d)=L(d)W(d) holds for any Dirichlet polynomial dd. In other words, the entropy of an empirical distribution can be calculated entirely in terms of the homomorphism hh applied to its corresponding Dirichlet polynomial. We also show that similar results hold for the cross entropy.

Cite

@article{arxiv.2107.04832,
  title  = {Dirichlet polynomials and entropy},
  author = {David I. Spivak and Timothy Hosgood},
  journal= {arXiv preprint arXiv:2107.04832},
  year   = {2021}
}
R2 v1 2026-06-24T04:04:02.607Z