The probability flow ODE is provably fast
Machine Learning
2023-05-22 v1 Statistics Theory
Machine Learning
Statistics Theory
Abstract
We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining such guarantees for the SDE-based implementation (i.e., denoising diffusion probabilistic modeling or DDPM), but requires the development of novel techniques for studying deterministic dynamics without contractivity. Through the use of a specially chosen corrector step based on the underdamped Langevin diffusion, we obtain better dimension dependence than prior works on DDPM ( vs. , assuming smoothness of the data distribution), highlighting potential advantages of the ODE framework.
Keywords
Cite
@article{arxiv.2305.11798,
title = {The probability flow ODE is provably fast},
author = {Sitan Chen and Sinho Chewi and Holden Lee and Yuanzhi Li and Jianfeng Lu and Adil Salim},
journal= {arXiv preprint arXiv:2305.11798},
year = {2023}
}
Comments
23 pages, 2 figures