English

Denoising growth complexity: Data geometry and certified schedules for diffusion sampling

Statistics Theory 2026-07-28 v1 Machine Learning Numerical Analysis Machine Learning

Abstract

Two central challenges in diffusion-based sampling are the theoretical one of understanding their remarkable effectiveness even in high-dimensional settings, and the practical one of designing algorithms with certified performance guarantees. We show that these questions are intimately connected via the \emph{denoising growth complexity} (DGC\mathsf{DGC}). It is a geometric measure defined by a log-time weighted integral of the derivative of the denoising mean-squared error along the Gaussian heat flow. We show how the DGC\mathsf{DGC} increments lead to a simple and explicit bound on the KL error of an Euler scheme applied to the stochastic innovations representation. The bound is local along the path: each step is controlled by the corresponding DGC\mathsf{DGC} increment and its relative stepsize. This structure allows us to derive KL sampling guarantees for optimized stepsize schedules, both in a simpler single-block setting and in a more refined KK-block setting. The DGC\mathsf{DGC} function has a natural martingale structure, which we exploit to develop fully data-certified versions of these algorithms. It also admits information-theoretic upper bounds in terms of covariance, rate distortion, metric entropy, and the Poincar'e constant, thereby recovering and sharpening a range of existing diffusion-sampling guarantees, as well as giving new results. In log heat-time, the fine partition limit is governed by an integral involving the square root of the DGC\mathsf{DGC} density, whereas a single-block schedule depends on its ordinary integral. This comparison precisely characterizes when adaptation to data geometry yields substantial computational gains, including logarithmic-to-constant separations for simple Gaussian mixture models.

Cite

@article{arxiv.2607.26285,
  title  = {Denoising growth complexity: Data geometry and certified schedules for diffusion sampling},
  author = {Martin J. Wainwright},
  journal= {arXiv preprint arXiv:2607.26285},
  year   = {2026}
}