English
Related papers

Related papers: DiffGANPaint: Fast Inpainting Using Denoising Diff…

200 papers

This study introduces a novel method for inpainting normal maps using a generative adversarial network (GAN). Normal maps, often derived from a lightstage, are crucial in performance capture but can have obscured areas due to movement…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Hancheng Zuo , Bernard Tiddeman

Sparse-view computed tomography (CT) can be used to reduce radiation dose greatly but is suffers from severe image artifacts. Recently, the deep learning based method for sparse-view CT reconstruction has attracted a major attention.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-21 Wenjun Xia , Wenxiang Cong , Ge Wang

Diffusion models (DMs) have exhibited remarkable efficacy in various image restoration tasks. However, existing approaches typically operate within the high-dimensional pixel space, resulting in high computational overhead. While methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yang Zheng , Wen Li , Zhaoqiang Liu

Diffusion models are distinguished by their exceptional generative performance, particularly in producing high-quality samples through iterative denoising. While current theory suggests that the number of denoising steps required for…

Machine Learning · Computer Science 2025-04-08 Gen Li , Changxiao Cai , Yuting Wei

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Spurious features associated with class labels can lead image classifiers to rely on shortcuts that don't generalize well to new domains. This is especially problematic in medical settings, where biased models fail when applied to different…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Qixuan Jin , Walter Gerych , Marzyeh Ghassemi

Generative Adversarial Network (GAN) inversion have demonstrated excellent performance in image inpainting that aims to restore lost or damaged image texture using its unmasked content. Previous GAN inversion-based methods usually utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Libo Zhang , Yongsheng Yu , Jiali Yao , Heng Fan

We propose an efficient approach to train large diffusion models with masked transformers. While masked transformers have been extensively explored for representation learning, their application to generative learning is less explored in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Hongkai Zheng , Weili Nie , Arash Vahdat , Anima Anandkumar

Recent video inpainting algorithms integrate flow-based pixel propagation with transformer-based generation to leverage optical flow for restoring textures and objects using information from neighboring frames, while completing masked…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Xiaowen Li , Haolan Xue , Peiran Ren , Liefeng Bo

Recently deep neutral networks have achieved promising performance for filling large missing regions in image inpainting tasks. They usually adopted the standard convolutional architecture over the corrupted image, leading to meaningless…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Yuqing Ma , Xianglong Liu , Shihao Bai , Lei Wang , Aishan Liu , Dacheng Tao , Edwin Hancock

Although many long-range imaging systems are designed to support extended vision applications, a natural obstacle to their operation is degradation due to atmospheric turbulence. Atmospheric turbulence causes significant degradation to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Nithin Gopalakrishnan Nair , Kangfu Mei , Vishal M. Patel

Modern diffusion-based inpainting models pose significant challenges for image forgery localization (IFL), as their full regeneration pipelines reconstruct the entire image via a latent decoder, disrupting the camera-level noise patterns…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Paschalis Giakoumoglou , Symeon Papadopoulos

Most existing Image Restoration (IR) models are task-specific, which can not be generalized to different degradation operators. In this work, we propose the Denoising Diffusion Null-Space Model (DDNM), a novel zero-shot framework for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Yinhuai Wang , Jiwen Yu , Jian Zhang

Automatic magnetic resonance (MR) image processing pipelines are widely used to study people with multiple sclerosis (PwMS), encompassing tasks such as lesion segmentation and brain parcellation. However, the presence of lesion often…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Jinwei Zhang , Lianrui Zuo , Yihao Liu , Samuel Remedios , Bennett A. Landman , Jerry L. Prince , Aaron Carass

Denoising Diffusion Models (DDMs) have become a popular tool for generating high-quality samples from complex data distributions. These models are able to capture sophisticated patterns and structures in the data, and can generate samples…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Emanuele Aiello , Diego Valsesia , Enrico Magli

The powerful generative capabilities of diffusion models have significantly advanced the field of image synthesis, enhancing both full image generation and inpainting-based image editing. Despite their remarkable advancements, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Fei Wang , Xuecheng Wu , Zheng Zhang , Danlei Huang , Yuheng Huang , Bo Wang

We introduce the state-of-the-art deep learning Denoising Diffusion Probabilistic Model (DDPM) as a method to infer the volume or number density of giant molecular clouds (GMCs) from projected mass surface density maps. We adopt…

Astrophysics of Galaxies · Physics 2023-06-28 Duo Xu , Jonathan C. Tan , Chia-Jung Hsu , Ye Zhu

The latest methods based on deep learning have achieved amazing results regarding the complex work of inpainting large missing areas in an image. But this type of method generally attempts to generate one single "optimal" result, ignoring…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Weiwei Cai , Zhanguo Wei

The outstanding capability of diffusion models in generating high-quality images poses significant threats when misused by adversaries. In particular, we assume malicious adversaries exploiting diffusion models for inpainting tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Joonsung Jeon , Woo Jae Kim , Suhyeon Ha , Sooel Son , Sung-eui Yoon