English
Related papers

Related papers: Function-Space Decoupled Diffusion for Forward and…

200 papers

In this work, we address the challenge of multi-task image generation with limited data for denoising diffusion probabilistic models (DDPM), a class of generative models that produce high-quality images by reversing a noisy diffusion…

Machine Learning · Computer Science 2023-11-29 Delaram Pirhayatifard , Mohammad Taha Toghani , Guha Balakrishnan , César A. Uribe

In a great number of tasks in science and engineering, the goal is to infer an unknown image from a small number of measurements collected from a known forward model describing certain sensing or imaging modality. Due to resource…

Image and Video Processing · Electrical Eng. & Systems 2024-06-13 Xingyu Xu , Yuejie Chi

Generative posterior sampling using diffusion models has emerged as a dominant paradigm for solving inverse problems in imaging, which usually consists of three main components: data consistency (DC) guidance, classifier-free guidance (CFG)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Junseo Bang , Dong Ju Mun , Hoigi Seo , Seongmin Hong , Se Young Chun

Diffusion models have found widespread adoption in various areas. However, their sampling process is slow because it requires hundreds to thousands of network evaluations to emulate a continuous process defined by differential equations. In…

Machine Learning · Computer Science 2023-07-25 Hongkai Zheng , Weili Nie , Arash Vahdat , Kamyar Azizzadenesheli , Anima Anandkumar

Diffusion Probabilistic Models stand as a critical tool in generative modelling, enabling the generation of complex data distributions. This family of generative models yields record-breaking performance in tasks such as image synthesis,…

Limitations on bandwidth and power consumption impose strict bounds on data rates of diagnostic imaging systems. Consequently, the design of suitable (i.e. task- and data-aware) compression and reconstruction techniques has attracted…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Iris A. M. Huijben , Bastiaan S. Veeling , Kees Janse , Massimo Mischi , Ruud J. G. van Sloun

We study posterior sampling for inverse problems in discrete state spaces using discrete diffusion models as generative priors. While continuous diffusion models have become widely used for inverse problems, their discrete counterparts…

Machine Learning · Computer Science 2026-05-12 Chaitanya Amballa , Sattwik Basu , Jorge Vančo Sampedro , Romit Roy Choudhury

Recent success of diffusion models has inspired a surge of interest in developing sampling techniques using reverse diffusion processes. However, accurately estimating the drift term in the reverse stochastic differential equation (SDE)…

Machine Learning · Statistics 2024-10-22 Zhekun Shi , Longlin Yu , Tianyu Xie , Cheng Zhang

Diffusion models have been shown to be capable of generating high-quality images, suggesting that they could contain meaningful internal representations. Unfortunately, the feature maps that encode a diffusion model's internal information…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Grace Luo , Lisa Dunlap , Dong Huk Park , Aleksander Holynski , Trevor Darrell

In recent years we have witnessed a growth in mathematics for deep learning, which has been used to solve inverse problems of partial differential equations (PDEs). However, most deep learning-based inversion methods either require paired…

Numerical Analysis · Mathematics 2024-04-23 Enze Jiang , Jishen Peng , Zheng Ma , Xiong-Bin Yan

Diffusion sampling-based Plug-and-Play (PnP) methods produce images with high perceptual quality but often suffer from reduced data fidelity, primarily due to the noise introduced during reverse diffusion. To address this trade-off, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zhen Wang , Hongyi Liu , Jianing Li , Zhihui Wei

Diffusion-based generative models have exhibited powerful generative performance in recent years. However, as many attributes exist in the data distribution and owing to several limitations of sharing the model parameters across all levels…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-26 Ha-Yeong Choi , Sang-Hoon Lee , Seong-Whan Lee

For image inpainting, the existing Denoising Diffusion Probabilistic Model (DDPM) based method i.e. RePaint can produce high-quality images for any inpainting form. It utilizes a pre-trained DDPM as a prior and generates inpainting results…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Lintao Zhang , Xiangcheng Du , LeoWu TomyEnrique , Yiqun Wang , Yingbin Zheng , Cheng Jin

Causal inference in spatio-temporal settings is critically hindered by unmeasured confounders with complex spatio-temporal dynamics and the prevalence of multi-resolution data. While diffusion models present a promising avenue for…

Machine Learning · Statistics 2026-04-07 Xinwen Liu , Lei Qian , Song Xi Chen , Niansheng Tang

Feature selection is fundamental to robust data-centric AI, but most existing methods optimize predictive performance under a single data distribution. This often selects spurious features that fail under distribution shifts. Motivated by…

Machine Learning · Computer Science 2026-03-24 Arun Vignesh Malarkkan , Xinyuan Wang , Kunpeng Liu , Denghui Zhang , Yanjie Fu

Diffusion models are extensively used for modeling image priors for inverse problems. We introduce \emph{Diff-Unfolding}, a principled framework for learning posterior score functions of \emph{conditional diffusion models} by explicitly…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Yuanhao Wang , Shirin Shoushtari , Ulugbek S. Kamilov

Deep learning-based techniques for the analysis of multimodal remote sensing data have become popular due to their ability to effectively integrate complementary spatial, spectral, and structural information from different sensors.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hao Liu , Yongjie Zheng , Yuhan Kang , Mingyang Zhang , Maoguo Gong , Lorenzo Bruzzone

Diffusion models have gained prominence as powerful generative tools for solving inverse problems due to their ability to model complex data distributions. However, existing methods typically rely on complete knowledge of the forward…

Machine Learning · Computer Science 2026-03-03 Hongkun Dou , Zike Chen , Zeyu Li , Hongjue Li , Lijun Yang , Yue Deng

In recent advancements in high-fidelity image generation, Denoising Diffusion Probabilistic Models (DDPMs) have emerged as a key player. However, their application at high resolutions presents significant computational challenges. Current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jing Nathan Yan , Jiatao Gu , Alexander M. Rush

The implementation of diffusion-based pansharpening task is predominantly constrained by its slow inference speed, which results from numerous sampling steps. Despite the existing techniques aiming to accelerate sampling, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Shiqi Cao , Liangjian Deng , Shangqi Deng