English
Related papers

Related papers: S4S: Solving for a Diffusion Model Solver

200 papers

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

Diffusion probabilistic models (DPMs) have shown remarkable performance in visual synthesis but are computationally expensive due to the need for multiple evaluations during the sampling. Recent predictor-corrector diffusion samplers have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Wenliang Zhao , Haolin Wang , Jie Zhou , Jiwen Lu

Diffusion models (DMs), which enable both image generation from noise and inversion from data, have inspired powerful unpaired image-to-image (I2I) translation algorithms. However, they often require a larger number of neural function…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Jeongsol Kim , Beomsu Kim , Jong Chul Ye

Diffusion models have recently advanced Combinatorial Optimization (CO) as a powerful backbone for neural solvers. However, their iterative sampling process requiring denoising across multiple noise levels incurs substantial overhead. We…

Machine Learning · Computer Science 2025-02-06 Yang Li , Jinpei Guo , Runzhong Wang , Hongyuan Zha , Junchi Yan

Diffusion models (DMs) are capable of generating remarkably high-quality samples by iteratively denoising a random vector, a process that corresponds to moving along the probability flow ordinary differential equation (PF ODE).…

Machine Learning · Computer Science 2025-03-04 Liangchen Li , Jiajun He

Diffusion models have proven effective for various applications such as images, audio and graph generation. Other important applications are image super-resolution and the solution of inverse problems. More recently, some works have used…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Marcelo dos Santos , Rayson Laroca , Rafael O. Ribeiro , João Neves , Hugo Proença , David Menotti

Diffusion models have recently emerged as powerful priors for solving inverse problems. While computed tomography (CT) is theoretically a linear inverse problem, it poses many practical challenges. These include correlated noise, artifact…

Image and Video Processing · Electrical Eng. & Systems 2026-02-24 Jiayang Shi , Daniel M. Pelt , K. Joost Batenburg

Satellites are widely used to estimate and monitor ground cover, providing critical information to address the challenges posed by climate change. High-resolution satellite images help to identify smaller features on the ground and…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Jhanavi Hegde

Stepwise signals are ubiquitous in single-molecule detections, where abrupt changes in signal levels typically correspond to molecular conformational changes or state transitions. However, these features are inevitably obscured by noise,…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Xingdi Tong , Chenyu Wen

The multi-step denoising process in diffusion and Flow Matching models causes major efficiency issues, which motivates research on few-step generation. We present Solution Flow Models (SoFlow), a framework for one-step generation from…

Machine Learning · Computer Science 2026-03-03 Tianze Luo , Haotian Yuan , Zhuang Liu

Diffusion probabilistic models (DPMs) have shown remarkable performance in high-resolution image synthesis, but their sampling efficiency is still to be desired due to the typically large number of sampling steps. Recent advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Shuchen Xue , Zhaoqiang Liu , Fei Chen , Shifeng Zhang , Tianyang Hu , Enze Xie , Zhenguo Li

This paper considers the problem of utilizing a large-scale text-to-image diffusion model to tackle the challenging Inexact Segmentation (IS) task. Unlike traditional approaches that rely heavily on discriminative-model-based paradigms or…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Tianjiao Zhang , Fei Zhang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Score-based diffusion models learn to reverse a stochastic differential equation that maps data to noise. However, for complex tasks, numerical error can compound and result in highly unnatural samples. Previous work mitigates this drift…

Machine Learning · Statistics 2023-06-12 Aaron Lou , Stefano Ermon

The data-driven discovery of interpretable models approximating the underlying dynamics of a physical system has gained attraction in the past decade. Current approaches employ pre-specified functional forms or basis functions and often…

Machine Learning · Computer Science 2025-07-30 Rahul Golder , M. M. Faruque Hasan

Diffusion models have recently received a surge of interest due to their impressive performance for image restoration, especially in terms of noise robustness. However, existing diffusion-based methods are trained on a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yuchun Miao , Lefei Zhang , Liangpei Zhang , Dacheng Tao

Drawing from the theory of stochastic differential equations, we introduce a novel sampling method for known distributions and a new algorithm for diffusion generative models with unknown distributions. Our approach is inspired by the…

Statistics Theory · Mathematics 2024-07-12 Xicheng Zhang

Probabilistic ordinary differential equation (ODE) solvers have been introduced over the past decade as uncertainty-aware numerical integrators. They typically proceed by assuming a functional prior to the ODE solution, which is then…

Numerical Analysis · Mathematics 2025-03-25 Yvann Le Fay , Simo Särkkä , Adrien Corenflos

The curvature of ODE trajectories in diffusion models hinders their ability to generate high-quality images in a few number of function evaluations (NFE). In this paper, we propose a novel and effective approach to reduce trajectory…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Yuchen Liang , Yuchuan Tian , Lei Yu , Huao Tang , Jie Hu , Xiangzhong Fang , Hanting Chen

Diffusion models (DMs) have achieved state-of-the-art generative performance but suffer from high sampling latency due to their sequential denoising nature. Existing solver-based acceleration methods often face significant image quality…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ruoyu Wang , Ziyu Li , Beier Zhu , Liangyu Yuan , Hanwang Zhang , Xun Yang , Xiaojun Chang , Chi Zhang

The iterative sampling procedure employed by diffusion models (DMs) often leads to significant inference latency. To address this, we propose Stochastic Consistency Distillation (SCott) to enable accelerated text-to-image generation, where…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Hongjian Liu , Qingsong Xie , TianXiang Ye , Zhijie Deng , Chen Chen , Shixiang Tang , Xueyang Fu , Haonan Lu , Zheng-jun Zha