English
Related papers

Related papers: The Spectral Bias of the Deep Image Prior

200 papers

Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Dmitry Ulyanov , Andrea Vedaldi , Victor Lempitsky

The deep image prior was recently introduced as a prior for natural images. It represents images as the output of a convolutional network with random inputs. For "inference", gradient descent is performed to adjust network parameters to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zezhou Cheng , Matheus Gadelha , Subhransu Maji , Daniel Sheldon

Convolutional neural networks contain strong priors for generating natural looking images [1]. These priors enable image denoising, super resolution, and inpainting in an unsupervised manner. Previous attempts to demonstrate similar ideas…

Sound · Computer Science 2022-10-26 Arnon Turetzky , Tzvi Michelson , Yossi Adi , Shmuel Peleg

Recent work has shown that the structure of convolutional neural networks (CNNs) induces a strong prior that favors natural images. This prior, known as a deep image prior (DIP), is an effective regularizer in inverse problems such as image…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Pallabi Ghosh , Vibhav Vineet , Larry S. Davis , Abhinav Shrivastava , Sudipta Sinha , Neel Joshi

The deep image prior showed that a randomly initialized network with a suitable architecture can be trained to solve inverse imaging problems by simply optimizing it's parameters to reconstruct a single degraded image. However, it suffers…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Zenglin Shi , Pascal Mettes , Subhransu Maji , Cees G. M. Snoek

In Deep Image Prior (DIP), a Convolutional Neural Network (CNN) is fitted to map a latent space to a degraded (e.g. noisy) image but in the process learns to reconstruct the clean image. This phenomenon is attributed to CNN's internal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Nimrod Shabtay , Eli Schwartz , Raja Giryes

Image denoising is the process of removing noise from noisy images, which is an image domain transferring task, i.e., from a single or several noise level domains to a photo-realistic domain. In this paper, we propose an effective image…

Image and Video Processing · Electrical Eng. & Systems 2019-06-05 Xianxu Hou , Hongming Luo , Jingxin Liu , Bolei Xu , Ke Sun , Yuanhao Gong , Bozhi Liu , Guoping Qiu

Prior probability models are a fundamental component of many image processing problems, but density estimation is notoriously difficult for high-dimensional signals such as photographic images. Deep neural networks have provided…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zahra Kadkhodaie , Eero P. Simoncelli

Image denoisers have been shown to be powerful priors for solving inverse problems in imaging. In this work, we introduce a generalization of these methods that allows any image restoration network to be used as an implicit prior. The…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Yuyang Hu , Mauricio Delbracio , Peyman Milanfar , Ulugbek S. Kamilov

Image denoising is often empowered by accurate prior information. In recent years, data-driven neural network priors have shown promising performance for RGB natural image denoising. Compared to classic handcrafted priors (e.g., sparsity…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Yu-Chun Miao , Xi-Le Zhao , Xiao Fu , Jian-Li Wang , Yu-Bang Zheng

Deep Image Prior (DIP) shows that some network architectures naturally bias towards smooth images and resist noises, a phenomenon known as spectral bias. Image denoising is an immediate application of this property. Although DIP has removed…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Yilin Liu , Jiang Li , Yunkui Pang , Dong Nie , Pew-thian Yap

Image denoising is an essential part of many image processing and computer vision tasks due to inevitable noise corruption during image acquisition. Traditionally, many researchers have investigated image priors for the denoising, within…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Jae Woong Soh , Nam Ik Cho

The accuracy of medical imaging-based diagnostics is directly impacted by the quality of the collected images. A passive approach to improve image quality is one that lags behind improvements in imaging hardware, awaiting better sensor…

Image and Video Processing · Electrical Eng. & Systems 2019-09-23 Saeed Izadi , Zahra Mirikharaji , Mengliu Zhao , Ghassan Hamarneh

Deep image prior (DIP) serves as a good inductive bias for diverse inverse problems. Among them, denoising is known to be particularly challenging for the DIP due to noise fitting with the requirement of an early stopping. To address the…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Yeonsik Jo , Se Young Chun , Jonghyun Choi

Most of existing image denoising methods learn image priors from either external data or the noisy image itself to remove noise. However, priors learned from external data may not be adaptive to the image to be denoised, while priors…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Jun Xu , Lei Zhang , David Zhang

We propose to leverage denoising autoencoder networks as priors to address image restoration problems. We build on the key observation that the output of an optimal denoising autoencoder is a local mean of the true data density, and the…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Siavash Arjomand Bigdeli , Matthias Zwicker

Through the use of carefully tailored convolutional neural network architectures, a deep image prior (DIP) can be used to obtain pre-images from latent representation encodings. Though DIP inversion has been known to be superior to…

Machine Learning · Computer Science 2020-10-26 Vivek Narayanaswamy , Jayaraman J. Thiagarajan , Andreas Spanias

Image denoising is an essential tool in computational photography. Standard denoising techniques, which use deep neural networks at their core, require pairs of clean and noisy images for its training. If we do not possess the clean…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 David Honzátko , Siavash A. Bigdeli , Engin Türetken , L. Andrea Dunbar

This paper proposes a novel approach to regularize the \textit{ill-posed} and \textit{non-linear} blind image deconvolution (blind deblurring) using deep generative networks as priors. We employ two separate generative models --- one…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Muhammad Asim , Fahad Shamshad , Ali Ahmed

We present a comprehensive overview of the Deep Image Prior (DIP) framework and its applications to image reconstruction in computed tomography. Unlike conventional deep learning methods that rely on large, supervised datasets, the DIP…

Image and Video Processing · Electrical Eng. & Systems 2026-02-24 Simon Arridge , Riccardo Barbano , Alexander Denker , Zeljko Kereta
‹ Prev 1 2 3 10 Next ›