English
Related papers

Related papers: RePaint: Inpainting using Denoising Diffusion Prob…

200 papers

The training of diffusion-based models for image generation is predominantly controlled by a select few Big Tech companies, raising concerns about privacy, copyright, and data authority due to their lack of transparency regarding training…

Machine Learning · Computer Science 2024-06-19 Matthijs de Goede , Bart Cox , Jérémie Decouchant

Score-based diffusion methods provide a powerful strategy to solve image restoration tasks by flexibly combining a pre-trained foundational prior model with a likelihood function specified during test time. Such methods are predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Charlesquin Kemajou Mbakam , Jean-Francois Giovannelli , Marcelo Pereyra

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Diffusion models have emerged as powerful priors for image editing tasks such as inpainting and local modification, where the objective is to generate realistic content that remains consistent with observed regions. In particular, zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Badr Moufad , Navid Bagheri Shouraki , Alain Oliviero Durmus , Thomas Hirtz , Eric Moulines , Jimmy Olsson , Yazid Janati

Diffusion Probabilistic Models (DPMs) have shown a powerful capacity of generating high-quality image samples. Recently, diffusion autoencoders (Diff-AE) have been proposed to explore DPMs for representation learning via autoencoding. Their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zijian Zhang , Zhou Zhao , Zhijie Lin

Semantic image inpainting is a challenging task where large missing regions have to be filled based on the available visual data. Existing methods which extract information from only a single image generally produce unsatisfactory results…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Raymond A. Yeh , Chen Chen , Teck Yian Lim , Alexander G. Schwing , Mark Hasegawa-Johnson , Minh N. Do

Natural language offers a highly intuitive interface for image editing. In this paper, we introduce the first solution for performing local (region-based) edits in generic natural images, based on a natural language description along with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Omri Avrahami , Dani Lischinski , Ohad Fried

Modern diffusion-based inpainting models pose significant challenges for image forgery localization (IFL), as their full regeneration pipelines reconstruct the entire image via a latent decoder, disrupting the camera-level noise patterns…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Paschalis Giakoumoglou , Symeon Papadopoulos

Generating diverse VLSI layout patterns is essential for various downstream tasks in design for manufacturing, as design rules continually evolve during the development of new technology nodes. However, existing training-based methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Guanglei Zhou , Bhargav Korrapati , Gaurav Rajavendra Reddy , Chen-Chia Chang , Jingyu Pan , Jiang Hu , Yiran Chen , Dipto G. Thakurta

Image inpainting is a fundamental task in computer vision, aiming to restore missing or corrupted regions in images realistically. While recent deep learning approaches have significantly advanced the state-of-the-art, challenges remain in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jacob Fein-Ashley , Benjamin Fein-Ashley

Panoptic and instance segmentation networks are often trained with specialized object detection modules, complex loss functions, and ad-hoc post-processing steps to manage the permutation-invariance of the instance masks. This work builds…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Wouter Van Gansbeke , Bert De Brabandere

Denoising Diffusion Probabilistic Models (DDPMs) represent a contemporary class of generative models with exceptional qualities in both synthesis and maximizing the data likelihood. These models work by traversing a forward Markov Chain…

Machine Learning · Computer Science 2024-09-16 Hang Li , Wei Jin , Geri Skenderi , Harry Shomer , Wenzhuo Tang , Wenqi Fan , Jiliang Tang

Deep neural networks have been extensively applied in the medical domain for various tasks, including image classification, segmentation, and landmark detection. However, their application is often hindered by data scarcity, both in terms…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Roberto Di Via , Francesca Odone , Vito Paolo Pastore

The success of Deep Learning applications critically depends on the quality and scale of the underlying training data. Generative adversarial networks (GANs) can generate arbitrary large datasets, but diversity and fidelity are limited,…

This Letter introduces an approach for precisely designing surface friction properties using a conditional generative machine learning model, specifically a diffusion denoising probabilistic model (DDPM). We created a dataset of synthetic…

Computational Physics · Physics 2024-01-11 Even Marius Nordhagen , Henrik Andersen Sveinsson , Anders Malthe-Sørenssen

Programmable structures are systems whose undeformed geometries and material property distributions are deliberately designed to achieve prescribed deformed configurations under specific loading conditions. Inflatable structures are a…

Computational Engineering, Finance, and Science · Computer Science 2025-08-19 Sara Karimi , Nikolaos N. Vlassis

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

This study aims to improve photon counting CT (PCCT) image resolution using denoising diffusion probabilistic models (DDPM). Although DDPMs have shown superior performance when applied to various computer vision tasks, their effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Chuang Niu , Christopher Wiedeman , Mengzhou Li , Jonathan S Maltz , Ge Wang

Denoising diffusion probabilistic models (DDPM) are powerful hierarchical latent variable models with remarkable sample generation quality and training stability. These properties can be attributed to parameter sharing in the generative…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Giorgio Giannone , Didrik Nielsen , Ole Winther

Modern-day surveillance systems perform person recognition using deep learning-based face verification networks. Most state-of-the-art facial verification systems are trained using visible spectrum images. But, acquiring images in the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Nithin Gopalakrishnan Nair , Vishal M. Patel