English

A New Bound on the Cumulant Generating Function of Dirichlet Processes

Probability 2024-09-30 v1 Information Theory math.IT

Abstract

In this paper, we introduce a novel approach for bounding the cumulant generating function (CGF) of a Dirichlet process (DP) XDP(αν0)X \sim \text{DP}(\alpha \nu_0), using superadditivity. In particular, our key technical contribution is the demonstration of the superadditivity of αlogEXDP(αν0)[exp(EX[αf])]\alpha \mapsto \log \mathbb{E}_{X \sim \text{DP}(\alpha \nu_0)}[\exp( \mathbb{E}_X[\alpha f])], where EX[f]=fdX\mathbb{E}_X[f] = \int f dX. This result, combined with Fekete's lemma and Varadhan's integral lemma, converts the known asymptotic large deviation principle into a practical upper bound on the CGF logEXDP(αν0)exp(EX[f]) \log\mathbb{E}_{X\sim \text{DP}(\alpha\nu_0)}{\exp(\mathbb{E}_{X}{[f]})} for any α>0\alpha > 0. The bound is given by the convex conjugate of the scaled reversed Kullback-Leibler divergence αKL(ν0)\alpha\mathrm{KL}(\nu_0\Vert \cdot). This new bound provides particularly effective confidence regions for sums of independent DPs, making it applicable across various fields.

Keywords

Cite

@article{arxiv.2409.18621,
  title  = {A New Bound on the Cumulant Generating Function of Dirichlet Processes},
  author = {Pierre Perrault and Denis Belomestny and Pierre Ménard and Éric Moulines and Alexey Naumov and Daniil Tiapkin and Michal Valko},
  journal= {arXiv preprint arXiv:2409.18621},
  year   = {2024}
}
R2 v1 2026-06-28T18:59:20.185Z