English
Related papers

Related papers: S4S: Solving for a Diffusion Model Solver

200 papers

Recent years have witnessed significant progress in developing effective training and fast sampling techniques for diffusion models. A remarkable advancement is the use of stochastic differential equations (SDEs) and their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Defang Chen , Zhenyu Zhou , Jian-Ping Mei , Chunhua Shen , Chun Chen , Can Wang

Recently, diffusion models have achieved great success in generative tasks. Sampling from diffusion models is equivalent to solving the reverse diffusion stochastic differential equations (SDEs) or the corresponding probability flow…

Machine Learning · Computer Science 2023-11-03 Hanzhong Guo , Cheng Lu , Fan Bao , Tianyu Pang , Shuicheng Yan , Chao Du , Chongxuan Li

Diffusion models (DMs) have achieved state-of-the-art generative performance but suffer from high sampling latency due to their sequential denoising nature. Existing solver-based acceleration methods often face image quality degradation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Beier Zhu , Ruoyu Wang , Tong Zhao , Hanwang Zhang , Chi Zhang

Diffusion models have demonstrated remarkable generation quality but at the cost of numerous function evaluations. Recently, advanced ODE-based solvers have been developed to mitigate the substantial computational demands of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Shuai Wang , Zexian Li , Qipeng zhang , Tianhui Song , Xubin Li , Tiezheng Ge , Bo Zheng , Limin Wang

Diffusion Probabilistic Models (DPMs) are a well-established class of diffusion models for unconditional image generation, while SGMSE+ is a well-established conditional diffusion model for speech enhancement. One of the downsides of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Bunlong Lay , Timo Gerkmann

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential…

Machine Learning · Computer Science 2026-05-29 Jiayi Fu , Yuxia Wang

Diffusion models (DMs) have become the dominant paradigm of generative modeling in a variety of domains by learning stochastic processes from noise to data. Recently, diffusion denoising bridge models (DDBMs), a new formulation of…

Machine Learning · Computer Science 2024-11-01 Guande He , Kaiwen Zheng , Jianfei Chen , Fan Bao , Jun Zhu

Machine learning methods, such as diffusion models, are widely explored as a promising way to accelerate high-fidelity fluid dynamics computation via a super-resolution process from faster-to-compute low-fidelity input. However, existing…

Computational Engineering, Finance, and Science · Computer Science 2025-12-24 Ruoyan Li , Zijie Huang , Haixin Wang , Guancheng Wan , Yizhou Sun , Wei Wang

Diffusion models (DMs) have made significant progress in the fields of image, audio, and video generation. One downside of DMs is their slow iterative process. Recent algorithms for fast sampling are designed from the perspective of…

Machine Learning · Statistics 2023-09-12 Shigui Li , Wei Chen , Delu Zeng

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion…

Machine Learning · Computer Science 2025-03-31 Zijie Li , Anthony Zhou , Amir Barati Farimani

Diffusion models, as a kind of powerful generative model, have given impressive results on image super-resolution (SR) tasks. However, due to the randomness introduced in the reverse process of diffusion models, the performances of…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Yiyang Ma , Huan Yang , Wenhan Yang , Jianlong Fu , Jiaying Liu

Diffusion-based inverse algorithms have shown remarkable performance across various inverse problems, yet their reliance on numerous denoising steps incurs high computational costs. While recent developments of fast diffusion ODE solvers…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jiawei Zhang , Ziyuan Liu , Leon Yan , Gen Li , Yuantao Gu

We investigate the use of diffusion models as neural density estimators. The current approach to this problem involves converting the generative process to a smooth flow, known as the Probability Flow ODE. The log density at a given sample…

Machine Learning · Computer Science 2024-10-10 Akhil Premkumar

A popular approach to sample a diffusion-based generative model is to solve an ordinary differential equation (ODE). In existing samplers, the coefficients of the ODE solvers are pre-determined by the ODE formulation, the reverse discrete…

Machine Learning · Computer Science 2023-10-04 Guoqiang Zhang , Niwa Kenta , W. Bastiaan Kleijn

Higher-order ODE solvers have become a standard tool for accelerating diffusion probabilistic model (DPM) sampling, motivating the widespread view that first-order methods are inherently slower and that increasing discretization order is…

Machine Learning · Statistics 2026-01-01 Yuchen Jiao , Na Li , Changxiao Cai , Gen Li

We propose self-diffusion, a novel framework for solving inverse problems without relying on pretrained generative models. Traditional diffusion-based approaches require training a model on a clean dataset to learn to reverse the forward…

Machine Learning · Computer Science 2025-12-09 Guanxiong Luo , Shoujin Huang , Yanlong Yang

The diffusion model has shown remarkable success in computer vision, but it remains unclear whether the ODE-based probability flow or the SDE-based diffusion model is more superior and under what circumstances. Comparing the two is…

Machine Learning · Computer Science 2023-11-08 Yu Cao , Jingrun Chen , Yixin Luo , Xiang Zhou

Diffusion Probabilistic Models (DPMs) are generative models showing competitive performance in various domains, including image synthesis and 3D point cloud generation. Sampling from pre-trained DPMs involves multiple neural function…

Machine Learning · Computer Science 2025-05-21 Vinh Tong , Hoang Trung-Dung , Anji Liu , Guy Van den Broeck , Mathias Niepert

Diffusion Models (DMs) have achieved great success in image generation and other fields. By fine sampling through the trajectory defined by the SDE/ODE solver based on a well-trained score model, DMs can generate remarkable high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Bowen Zheng , Tianming Yang