English

Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models

Machine Learning 2025-02-03 v1 Machine Learning

Abstract

Score-based generative models, which transform noise into data by learning to reverse a diffusion process, have become a cornerstone of modern generative AI. This paper contributes to establishing theoretical guarantees for the probability flow ODE, a widely used diffusion-based sampler known for its practical efficiency. While a number of prior works address its general convergence theory, it remains unclear whether the probability flow ODE sampler can adapt to the low-dimensional structures commonly present in natural image data. We demonstrate that, with accurate score function estimation, the probability flow ODE sampler achieves a convergence rate of O(k/T)O(k/T) in total variation distance (ignoring logarithmic factors), where kk is the intrinsic dimension of the target distribution and TT is the number of iterations. This dimension-free convergence rate improves upon existing results that scale with the typically much larger ambient dimension, highlighting the ability of the probability flow ODE sampler to exploit intrinsic low-dimensional structures in the target distribution for faster sampling.

Keywords

Cite

@article{arxiv.2501.18863,
  title  = {Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models},
  author = {Jiaqi Tang and Yuling Yan},
  journal= {arXiv preprint arXiv:2501.18863},
  year   = {2025}
}
R2 v1 2026-06-28T21:26:54.960Z