English
Related papers

Related papers: Gradpaint: Gradient-Guided Inpainting with Diffusi…

200 papers

Denoising diffusion probabilistic models (DDPMs) (Ho et al. 2020) have shown impressive results on image and waveform generation in continuous state spaces. Here, we introduce Discrete Denoising Diffusion Probabilistic Models (D3PMs),…

Machine Learning · Computer Science 2023-02-23 Jacob Austin , Daniel D. Johnson , Jonathan Ho , Daniel Tarlow , Rianne van den Berg

With the advancements in denoising diffusion probabilistic models (DDPMs), image inpainting has significantly evolved from merely filling information based on nearby regions to generating content conditioned on various prompts such as text,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Lingzhi Pan , Tong Zhang , Bingyuan Chen , Qi Zhou , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

Diffusion models are the current state of the art for generating photorealistic images. Controlling the sampling process for constrained image generation tasks such as inpainting, however, remains challenging since exact conditioning on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Anji Liu , Mathias Niepert , Guy Van den Broeck

This paper presents a RePaint-enhanced framework that integrates a pre-trained performance-guided denoising diffusion probabilistic model (DDPM) for performance- and parameter-constraint engineering design generation. The proposed method…

Machine Learning · Computer Science 2026-02-03 Ke Wang , Nguyen Gia Hien Vu , Yifan Tang , Mostafa Rahmani Dehaghani , G. Gary Wang

We investigate the construction of gradient-guided conditional diffusion models for reconstructing private images, focusing on the adversarial interplay between differential privacy noise and the denoising capabilities of diffusion models.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Tao Huang , Jiayang Meng , Hong Chen , Guolong Zheng , Xu Yang , Xun Yi , Hua Wang

Denoising diffusion probabilistic models (DDPMs) have been proven capable of synthesizing high-quality images with remarkable diversity when trained on large amounts of data. Typical diffusion models and modern large-scale conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Multi-modality image fusion aims to combine different modalities to produce fused images that retain the complementary features of each modality, such as functional highlights and texture details. To leverage strong generative priors and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zixiang Zhao , Haowen Bai , Yuanzhi Zhu , Jiangshe Zhang , Shuang Xu , Yulun Zhang , Kai Zhang , Deyu Meng , Radu Timofte , Luc Van Gool

We provide a theoretical justification for sample recovery using diffusion based image inpainting in a linear model setting. While most inpainting algorithms require retraining with each new mask, we prove that diffusion based inpainting…

Machine Learning · Statistics 2023-02-03 Litu Rout , Advait Parulekar , Constantine Caramanis , Sanjay Shakkottai

Generative models of graphs based on discrete Denoising Diffusion Probabilistic Models (DDPMs) offer a principled approach to molecular generation by systematically removing structural noise through iterative atom and bond adjustments.…

Machine Learning · Computer Science 2025-11-03 Matteo Ninniri , Marco Podda , Davide Bacciu

Advances in microscopy imaging enable researchers to visualize structures at the nanoscale level thereby unraveling intricate details of biological organization. However, challenges such as image noise, photobleaching of fluorophores, and…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Pamela Osuna-Vargas , Maren H. Wehrheim , Lucas Zinz , Johanna Rahm , Ashwin Balakrishnan , Alexandra Kaminer , Mike Heilemann , Matthias Kaschube

Denoising Diffusion Probabilistic Models (DDPMs) are powerful generative deep learning models that have been very successful at image generation, and, very recently, in path planning and control. In this paper, we investigate how to…

Robotics · Computer Science 2024-11-18 Michiel Nikken , Nicolò Botteghi , Wesley Roozing , Federico Califano

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A…

Image and Video Processing · Electrical Eng. & Systems 2022-05-17 Tobias Alt , Pascal Peter , Joachim Weickert

This Letter introduces an approach for precisely designing surface friction properties using a conditional generative machine learning model, specifically a diffusion denoising probabilistic model (DDPM). We created a dataset of synthetic…

Computational Physics · Physics 2024-01-11 Even Marius Nordhagen , Henrik Andersen Sveinsson , Anders Malthe-Sørenssen

In this work, we address the challenge of multi-task image generation with limited data for denoising diffusion probabilistic models (DDPM), a class of generative models that produce high-quality images by reversing a noisy diffusion…

Machine Learning · Computer Science 2023-11-29 Delaram Pirhayatifard , Mohammad Taha Toghani , Guha Balakrishnan , César A. Uribe

Deep generative models are key-enabling technology to computer vision, text generation, and large language models. Denoising diffusion probabilistic models (DDPMs) have recently gained much attention due to their ability to generate diverse…

Quantum Physics · Physics 2026-02-02 Bingzhi Zhang , Peng Xu , Xiaohui Chen , Quntao Zhuang

Recently, research on denoising diffusion models has expanded its application to the field of image restoration. Traditional diffusion-based image restoration methods utilize degraded images as conditional input to effectively guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zhenning Shi , Haoshuai Zheng , Chen Xu , Changsheng Dong , Bin Pan , Xueshuo Xie , Along He , Tao Li , Huazhu Fu

Diffusion models have emerged as a popular family of deep generative models (DGMs). In the literature, it has been claimed that one class of diffusion models -- denoising diffusion probabilistic models (DDPMs) -- demonstrate superior image…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Rucha Deshpande , Muzaffer Özbey , Hua Li , Mark A. Anastasio , Frank J. Brooks

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann