English

The probability flow ODE is provably fast

Machine Learning 2023-05-22 v1 Statistics Theory Machine Learning Statistics Theory

Abstract

We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining such guarantees for the SDE-based implementation (i.e., denoising diffusion probabilistic modeling or DDPM), but requires the development of novel techniques for studying deterministic dynamics without contractivity. Through the use of a specially chosen corrector step based on the underdamped Langevin diffusion, we obtain better dimension dependence than prior works on DDPM (O(d)O(\sqrt{d}) vs. O(d)O(d), assuming smoothness of the data distribution), highlighting potential advantages of the ODE framework.

Keywords

Cite

@article{arxiv.2305.11798,
  title  = {The probability flow ODE is provably fast},
  author = {Sitan Chen and Sinho Chewi and Holden Lee and Yuanzhi Li and Jianfeng Lu and Adil Salim},
  journal= {arXiv preprint arXiv:2305.11798},
  year   = {2023}
}

Comments

23 pages, 2 figures

R2 v1 2026-06-28T10:39:26.800Z