English
Related papers

Related papers: Video Restoration with a Deep Plug-and-Play Prior

200 papers

The use of Plug-and-Play (PnP) methods has become a central approach for solving inverse problems, with denoisers serving as regularising priors that guide optimisation towards a clean solution. In this work, we introduce KAN-PnP, an…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Yanqi Cheng , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Conventional deconvolution methods utilize hand-crafted image priors to constrain the optimization. While deep-learning-based methods have simplified the optimization by end-to-end training, they fail to generalize well to blurs unseen in…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Dong Huo , Abbas Masoumzadeh , Rafsanjany Kushol , Yee-Hong Yang

Deep learning based unmixing methods have received great attention in recent years and achieve remarkable performance. These methods employ a data-driven approach to extract structure features from hyperspectral image, however, they tend to…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Min Zhao , Linruize Tang , Jie Chen

For magnetic resonance imaging (MRI), recently proposed "plug-and-play" (PnP) image recovery algorithms have shown remarkable performance. These PnP algorithms are similar to traditional iterative algorithms like FISTA, ADMM, or primal-dual…

Information Theory · Computer Science 2020-12-03 Saurav K. Shastri , Rizwan Ahmad , Philip Schniter

De-fencing is to eliminate the captured fence on an image or a video, providing a clear view of the scene. It has been applied for many purposes including assisting photographers and improving the performance of computer vision algorithms…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Chen Du , Byeongkeun Kang , Zheng Xu , Ji Dai , Truong Nguyen

Deep learning algorithms have demonstrated state-of-the-art performance in various tasks of image restoration. This was made possible through the ability of CNNs to learn from large exemplar sets. However, the latter becomes an issue for…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Oleksii Sidorov , Jon Yngve Hardeberg

In Deep Image Prior (DIP), a Convolutional Neural Network (CNN) is fitted to map a latent space to a degraded (e.g. noisy) image but in the process learns to reconstruct the clean image. This phenomenon is attributed to CNN's internal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Nimrod Shabtay , Eli Schwartz , Raja Giryes

A deep learning approach to blind denoising of images without complete knowledge of the noise statistics is considered. We propose DN-ResNet, which is a deep convolutional neural network (CNN) consisting of several residual blocks…

Image and Video Processing · Electrical Eng. & Systems 2019-04-12 Haoyu Ren , Mostafa El-Khamy , Jungwon Lee

Plug-and-play Image Restoration (IR) has been widely recognized as a flexible and interpretable method for solving various inverse problems by utilizing any off-the-shelf denoiser as the implicit image prior. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yuanzhi Zhu , Kai Zhang , Jingyun Liang , Jiezhang Cao , Bihan Wen , Radu Timofte , Luc Van Gool

Denoising is one of the fundamental steps of the processing pipeline that converts data captured by a camera sensor into a display-ready image or video. It is generally performed early in the pipeline, usually before demosaicking, although…

Image and Video Processing · Electrical Eng. & Systems 2024-12-02 Marco Sánchez-Beeckman , Antoni Buades , Nicola Brandonisio , Bilel Kanoun

The ability of deep image prior (DIP) to recover high-quality images from incomplete or corrupted measurements has made it popular in inverse problems in image restoration and medical imaging including magnetic resonance imaging (MRI).…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Shijun Liang , Evan Bell , Qing Qu , Rongrong Wang , Saiprasad Ravishankar

Existing video super-resolution (SR) algorithms usually assume that the blur kernels in the degradation process are known and do not model the blur kernels in the restoration. However, this assumption does not hold for video SR and usually…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Jinshan Pan , Songsheng Cheng , Jiawei Zhang , Jinhui Tang

Demosaicking and denoising are among the most crucial steps of modern digital camera pipelines and their joint treatment is a highly ill-posed inverse problem where at-least two-thirds of the information are missing and the rest are…

Computer Vision and Pattern Recognition · Computer Science 2018-07-13 Filippos Kokkinos , Stamatios Lefkimmiatis

The spatial resolution of images of living samples obtained by fluorescence microscopes is physically limited due to the diffraction of visible light, which makes the study of entities of size less than the diffraction barrier (around 200…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Vasiliki Stergiopoulou , Subhadip Mukherjee , Luca Calatroni , Laure Blanc-Féraud

While deep neural networks exhibit state-of-the-art results in the task of image super-resolution (SR) with a fixed known acquisition process (e.g., a bicubic downscaling kernel), they experience a huge performance loss when the real…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Tom Tirer , Raja Giryes

In this paper, we propose to regularize ill-posed inverse problems using a deep hierarchical variational autoencoder (HVAE) as an image prior. The proposed method synthesizes the advantages of i) denoiser-based Plug \& Play approaches and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Jean Prost , Antoine Houdard , Andrés Almansa , Nicolas Papadakis

Spectral unmixing is a widely used technique in hyperspectral image processing and analysis. It aims to separate mixed pixels into the component materials and their corresponding abundances. Early solutions to spectral unmixing are…

Signal Processing · Electrical Eng. & Systems 2021-04-27 Min zhao , Xiuheng Wang , Jie Chen , Wei Chen

Non-blind deconvolution aims to restore a sharp image from its blurred counterpart given an obtained kernel. Existing deep neural architectures are often built based on large datasets of sharp ground truth images and trained with…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tomáš Chobola , Gesine Müller , Veit Dausmann , Anton Theileis , Jan Taucher , Jan Huisken , Tingying Peng

Compressive sensing is a method to recover the original image from undersampled measurements. In order to overcome the ill-posedness of this inverse problem, image priors are used such as sparsity in the wavelet domain, minimum…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Magauiya Zhussip , Shakarim Soltanayev , Se Young Chun

In a great number of tasks in science and engineering, the goal is to infer an unknown image from a small number of measurements collected from a known forward model describing certain sensing or imaging modality. Due to resource…

Image and Video Processing · Electrical Eng. & Systems 2024-06-13 Xingyu Xu , Yuejie Chi