English
Related papers

Related papers: Come-Closer-Diffuse-Faster: Accelerating Condition…

200 papers

Large denoising diffusion models, such as Stable Diffusion, have been trained on billions of image-caption pairs to perform text-conditioned image generation. As a byproduct of this training, these models have acquired general knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alexandros Graikos , Nebojsa Jojic , Dimitris Samaras

Inverse problems arise in a multitude of applications, where the goal is to recover a clean signal from noisy and possibly (non)linear observations. The difficulty of a reconstruction problem depends on multiple factors, such as the ground…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

We present an novel framework for efficiently and effectively extending the powerful continuous diffusion processes to discrete modeling. Previous approaches have suffered from the discrepancy between discrete data and continuous modeling.…

Machine Learning · Computer Science 2024-10-31 Yuxuan Gu , Xiaocheng Feng , Lei Huang , Yingsheng Wu , Zekun Zhou , Weihong Zhong , Kun Zhu , Bing Qin

Diffusion Inverse Solvers (DIS) are designed to sample from the conditional distribution $p_{\theta}(X_0|y)$, with a predefined diffusion model $p_{\theta}(X_0)$, an operator $f(\cdot)$, and a measurement $y=f(x'_0)$ derived from an unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tongda Xu , Ziran Zhu , Jian Li , Dailan He , Yuanyuan Wang , Ming Sun , Ling Li , Hongwei Qin , Yan Wang , Jingjing Liu , Ya-Qin Zhang

Diffusion models have made remarkable progress in solving various inverse problems, attributing to the generative modeling capability of the data manifold. Posterior sampling from the conditional score function enable the precious data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jinghao Zhang , Zizheng Yang , Qi Zhu , Feng Zhao

Diffusion models (DMs) are a class of generative models that allow sampling from a distribution learned over a training set. When applied to solving inverse problems, the reverse sampling steps are modified to approximately sample from a…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Ismail Alkhouri , Shijun Liang , Cheng-Han Huang , Jimmy Dai , Qing Qu , Saiprasad Ravishankar , Rongrong Wang

With the rapid development of diffusion models and flow-based generative models, there has been a surge of interests in solving noisy linear inverse problems, e.g., super-resolution, deblurring, denoising, colorization, etc, with generative…

Machine Learning · Computer Science 2024-10-22 Xiangming Meng , Yoshiyuki Kabashima

We present a conditional diffusion model - ConDiSim, for simulation-based inference of complex systems with intractable likelihoods. ConDiSim leverages denoising diffusion probabilistic models to approximate posterior distributions,…

Machine Learning · Computer Science 2025-10-17 Mayank Nautiyal , Andreas Hellander , Prashant Singh

Denoising diffusion models have emerged as the go-to generative framework for solving inverse problems in imaging. A critical concern regarding these models is their performance on out-of-distribution tasks, which remains an under-explored…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Riccardo Barbano , Alexander Denker , Hyungjin Chung , Tae Hoon Roh , Simon Arridge , Peter Maass , Bangti Jin , Jong Chul Ye

Recent methods have shown that pre-trained diffusion models can be fine-tuned to enable generative inverse rendering by learning image-conditioned noise-to-intrinsic mapping. Despite their remarkable progress, they struggle to robustly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Rongjia Zheng , Qing Zhang , Chengjiang Long , Wei-Shi Zheng

Diffusion probabilistic models have demonstrated an outstanding capability to model natural images and raw audio waveforms through a paired diffusion and reverse processes. The unique property of the reverse process (namely, eliminating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-23 Yen-Ju Lu , Yu Tsao , Shinji Watanabe

Diffusion models have emerged as powerful tools for solving inverse problems, yet prior work has primarily focused on observations with Gaussian measurement noise, restricting their use in real-world scenarios. This limitation persists due…

Machine Learning · Statistics 2025-02-11 Alessandro Micheli , Mélodie Monod , Samir Bhatt

Denoising diffusion models are a class of generative models which have recently achieved state-of-the-art results across many domains. Gradual noise is added to the data using a diffusion process, which transforms the data distribution into…

Machine Learning · Statistics 2024-06-28 Francisco Vargas , Teodora Reu , Anna Kerekes , Michael M Bronstein

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang

Diffusion models have emerged as a key pillar of foundation models in visual domains. One of their critical applications is to universally solve different downstream inverse tasks via a single diffusion prior without re-training for each…

Machine Learning · Computer Science 2023-10-03 Morteza Mardani , Jiaming Song , Jan Kautz , Arash Vahdat

Recently, diffusion models have shown remarkable results in image synthesis by gradually removing noise and amplifying signals. Although the simple generative process surprisingly works well, is this the best way to generate image data? For…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Sangyun Lee , Hyungjin Chung , Jaehyeon Kim , Jong Chul Ye

Diffusion models have emerged as the new state-of-the-art generative model with high quality samples, with intriguing properties such as mode coverage and high flexibility. They have also been shown to be effective inverse problem solvers,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Hyungjin Chung , Dohoon Ryu , Michael T. McCann , Marc L. Klasky , Jong Chul Ye

Diffusion models have been demonstrated as strong priors for solving general inverse problems. Most existing Diffusion model-based Inverse Problem Solvers (DIS) employ a plug-and-play approach to guide the sampling trajectory with either…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jiankun Zhao , Bowen Song , Liyue Shen

Diffusion models have recently exhibited remarkable abilities to synthesize striking image samples since the introduction of denoising diffusion probabilistic models (DDPMs). Their key idea is to disrupt images into noise through a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zijian Zhang , Zhou Zhao , Jun Yu , Qi Tian

Deep learning has shown the capability to substantially accelerate MRI reconstruction while acquiring fewer measurements. Recently, diffusion models have gained burgeoning interests as a novel group of deep learning-based generative…

Image and Video Processing · Electrical Eng. & Systems 2023-06-27 Jiahao Huang , Angelica Aviles-Rivero , Carola-Bibiane Schönlieb , Guang Yang