English
Related papers

Related papers: Generative Diffusion Prior for Unified Image Resto…

200 papers

Analysis of galaxy--galaxy strong lensing systems is strongly dependent on any prior assumptions made about the appearance of the source. Here we present a method of imposing a data-driven prior / regularisation for source galaxies based on…

Instrumentation and Methods for Astrophysics · Physics 2022-11-09 Konstantin Karchev , Noemi Anau Montel , Adam Coogan , Christoph Weniger

In supervised image restoration tasks, one key issue is how to obtain the aligned high-quality (HQ) and low-quality (LQ) training image pairs. Unfortunately, such HQ-LQ training pairs are hard to capture in practice, and hard to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Tao Yang , Peiran Ren , Xuansong xie , Lei Zhang

Diffusion models excel at capturing the natural design spaces of images, molecules, DNA, RNA, and protein sequences. However, rather than merely generating designs that are natural, we often aim to optimize downstream reward functions while…

When images are statistically described by a generative model we can use this information to develop optimum techniques for various image restoration problems as inpainting, super-resolution, image coloring, generative model inversion, etc.…

Image and Video Processing · Electrical Eng. & Systems 2020-06-17 Kalliopi Basioti , George V. Moustakides

Recent diffusion models have exhibited great potential in generative modeling tasks. Part of their success can be attributed to the ability of training stable on huge sets of paired synthetic data. However, adapting these models to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Yiyang Shen , Mingqiang Wei , Yongzhen Wang , Xueyang Fu , Jing Qin

Plug-and-play (PnP) methods offer an iterative strategy for solving image restoration (IR) problems in a zero-shot manner, using a learned \textit{discriminative denoiser} as the implicit prior. More recently, a sampling-based variant of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Chong Wang , Lanqing Guo , Zixuan Fu , Siyuan Yang , Hao Cheng , Alex C. Kot , Bihan Wen

The inductive bias of the convolutional neural network (CNN) can be a strong prior for image restoration, which is known as the Deep Image Prior (DIP). Recently, DIP is utilized in unsupervised dynamic MRI reconstruction, which adopts a…

Image and Video Processing · Electrical Eng. & Systems 2024-09-25 Zhongsen Li , Wenxuan Chen , Shuai Wang , Chuyu Liu , Qing Zou , Rui Li

Although diffusion-based models have achieved impressive results in image super-resolution, they often rely on large-scale backbones such as Stable Diffusion XL (SDXL) and Diffusion Transformers (DiT), which lead to excessive computational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Zhongbao Yang , Jiangxin Dong , Yazhou Yao , Jinhui Tang , Jinshan Pan

Image inpainting techniques have shown promising improvement with the assistance of generative adversarial networks (GANs) recently. However, most of them often suffered from completed results with unreasonable structure or blurriness. To…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zheng Hui , Jie Li , Xiumei Wang , Xinbo Gao

Through the use of carefully tailored convolutional neural network architectures, a deep image prior (DIP) can be used to obtain pre-images from latent representation encodings. Though DIP inversion has been known to be superior to…

Machine Learning · Computer Science 2020-10-26 Vivek Narayanaswamy , Jayaraman J. Thiagarajan , Andreas Spanias

Advances in microscopy imaging enable researchers to visualize structures at the nanoscale level thereby unraveling intricate details of biological organization. However, challenges such as image noise, photobleaching of fluorophores, and…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Pamela Osuna-Vargas , Maren H. Wehrheim , Lucas Zinz , Johanna Rahm , Ashwin Balakrishnan , Alexandra Kaminer , Mike Heilemann , Matthias Kaschube

Image super-resolution pursuits reconstructing high-fidelity high-resolution counterpart for low-resolution image. In recent years, diffusion-based models have garnered significant attention due to their capabilities with rich prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aiwen Jiang , Zhi Wei , Long Peng , Feiqiang Liu , Wenbo Li , Mingwen Wang

Recently, several discriminative learning approaches have been proposed for effective image restoration, achieving convincing trade-off between image quality and computational efficiency. However, these methods require separate training for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Lei Xiao , Felix Heide , Wolfgang Heidrich , Bernhard Schölkopf , Michael Hirsch

Diffusion Probabilistic Models (DPMs) have shown a powerful capacity of generating high-quality image samples. Recently, diffusion autoencoders (Diff-AE) have been proposed to explore DPMs for representation learning via autoencoding. Their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zijian Zhang , Zhou Zhao , Zhijie Lin

Diffusion probabilistic models (DPM) have been widely adopted in image-to-image translation to generate high-quality images. Prior attempts at applying the DPM to image super-resolution (SR) have shown that iteratively refining a pure…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Axi Niu , Kang Zhang , Trung X. Pham , Jinqiu Sun , Yu Zhu , In So Kweon , Yanning Zhang

Many application domains, spanning from computational photography to medical imaging, require recovery of high-fidelity images from noisy, incomplete or partial/compressed measurements. State of the art methods for solving these inverse…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Xinyi Wei , Hans van Gorp , Lizeth Gonzalez Carabarin , Daniel Freedman , Yonina C. Eldar , Ruud J. G. van Sloun

The recent emergence of diffusion models has significantly advanced the precision of learnable priors, presenting innovative avenues for addressing inverse problems. Since inverse problems inherently entail maximum a posteriori estimation,…

Machine Learning · Computer Science 2025-01-22 Jiawei Zhang , Jiaxin Zhuang , Cheng Jin , Gen Li , Yuantao Gu

Acquiring high-quality data for training discriminative models is a crucial yet challenging aspect of building effective predictive systems. In this paper, we present Diffusion Inversion, a simple yet effective method that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yongchao Zhou , Hshmat Sahak , Jimmy Ba

Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains due to their creative and high-fidelity image generation. Nonetheless, existing large-scale diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Younghyun Kim , Geunmin Hwang , Junyu Zhang , Eunbyung Park

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng