Dimension-Free Convergence of Discrete Diffusion Models: Adjoint Equations Induce the Right Space
Abstract
Discrete diffusion has become a leading framework for generative modeling in various applications including language, vision, and biology. Existing convergence theory, however, exhibits fundamental limitations. KL-based analyses diverge under singular priors such as the masked distribution, while bounds in total variation (TV) depend on the state space size and become vacuous for modern language tasks, where vocabularies contain hundreds of thousands of tokens. We develop a unified adjoint-equation-based framework that establishes dimension-free convergence guarantees in any integral probability metric (IPM). To the best of our knowledge, our bounds are the first to be entirely free of and applicable to both masked and uniform priors. Importantly, our theory relies only on a single standard rate-matrix regularity assumption and is compatible with time-inhomogeneous schedules. Four novel techniques drive our improvements: working in the space of observables via adjoint equations rather than directly with probability measures, a regularity analysis that yields bounds on any IPM, a coupling argument that removes -dependence under uniform transitions, and a score-marginal cancellation technique that removes -dependence under masked transitions. Our framework thus sharply departs from prior analyses and avoids the shortcomings of pathspace-KL and existing TV-based approaches. Beyond convergence bounds, our framework provides a versatile toolkit for further theoretical study of discrete diffusion models.
Cite
@article{arxiv.2605.17232,
title = {Dimension-Free Convergence of Discrete Diffusion Models: Adjoint Equations Induce the Right Space},
author = {Kelvin Kan and Xingjian Li and Benjamin J. Zhang and Tuhin Sahai and Stanley Osher and Markos A. Katsoulakis},
journal= {arXiv preprint arXiv:2605.17232},
year = {2026}
}