English
Related papers

Related papers: Unsupervised Image Fusion Using Deep Image Priors

200 papers

Deep image prior (DIP) has been successfully applied to positron emission tomography (PET) image restoration, enabling represent implicit prior using only convolutional neural network architecture without training dataset, whereas the…

Medical Physics · Physics 2024-04-23 Yuya Onishi , Fumio Hashimoto , Kibo Ote , Keisuke Matsubara , Masanobu Ibaraki

Deep image prior (DIP) and its variants have showed remarkable potential for solving inverse problems in computer vision, without any extra training data. Practical DIP models are often substantially overparameterized. During the fitting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Hengkang Wang , Taihui Li , Zhong Zhuang , Tiancong Chen , Hengyue Liang , Ju Sun

The present paper studies so-called deep image prior (DIP) techniques in the context of ill-posed inverse problems. DIP networks have been recently introduced for applications in image processing; also first experimental results for…

Machine Learning · Computer Science 2020-03-19 Sören Dittmer , Tobias Kluth , Peter Maass , Daniel Otero Baguer

Deep image prior (DIP), which utilizes a deep convolutional network (ConvNet) structure itself as an image prior, has attracted attentions in computer vision and machine learning communities. It empirically shows the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Tatsuya Yokota , Hidekata Hontani , Qibin Zhao , Andrzej Cichocki

Deep learning algorithms that rely on extensive training data are revolutionizing image recovery from ill-posed measurements. Training data is scarce in many imaging applications, including ultra-high-resolution imaging. The deep image…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Maneesh John , Hemant Kumar Aggarwal , Qing Zou , Mathews Jacob

Deep learning has been widely used for solving image reconstruction tasks but its deployability has been held back due to the shortage of high-quality training data. Unsupervised learning methods, such as the deep image prior (DIP),…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Riccardo Barbano , Javier Antorán , Johannes Leuschner , José Miguel Hernández-Lobato , Bangti Jin , Željko Kereta

Zero-shot image restoration (IR) methods based on pretrained diffusion models have recently achieved significant success. These methods typically require at least a parametric form of the degradation model. However, in real-world scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamadi Chihaoui , Paolo Favaro

Many seemingly unrelated computer vision tasks can be viewed as a special case of image decomposition into separate layers. For example, image segmentation (separation into foreground and background layers); transparent layer separation…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Yossi Gandelsman , Assaf Shocher , Michal Irani

We present a novel method for generating robust adversarial image examples building upon the recent `deep image prior' (DIP) that exploits convolutional network architectures to enforce plausible texture in image synthesis. Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Thomas Gittings , Steve Schneider , John Collomosse

Convolutional neural networks have recently been used for multi-focus image fusion. However, due to the lack of labeled data for supervised training of such networks, existing methods have resorted to adding Gaussian blur in focused images…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Xiang Yan , Syed Zulqarnain Gilani , Hanlin Qin , Ajmal Mian

Multi-focus image fusion (MFIF) and super-resolution (SR) are the inverse problem of imaging model, purposes of MFIF and SR are obtaining all-in-focus and high-resolution 2D mapping of targets. Though various MFIF and SR methods have been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yuanjie Gu , Yinghan Guan , Zhibo Xiao , Haoran Dai , Cheng Liu , Shouyu Wang

Unsupervised deep image prior (DIP) addresses shortcomings of training data requirements and limited generalization associated with supervised deep learning. The performance of DIP depends on the network architecture and the stopping point…

We extend the Deep Image Prior (DIP) framework to one-dimensional signals. DIP is using a randomly initialized convolutional neural network (CNN) to solve linear inverse problems by optimizing over weights to fit the observed measurements.…

Machine Learning · Computer Science 2019-04-19 Sriram Ravula , Alexandros G. Dimakis

In this work, we propose a novel unsupervised deep learning model to address multi-focus image fusion problem. First, we train an encoder-decoder network in unsupervised manner to acquire deep feature of input images. And then we utilize…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Boyuan Ma , Xiaojuan Ban , Haiyou Huang , Yu Zhu

Deep image prior (DIP) serves as a good inductive bias for diverse inverse problems. Among them, denoising is known to be particularly challenging for the DIP due to noise fitting with the requirement of an early stopping. To address the…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Yeonsik Jo , Se Young Chun , Jonghyun Choi

Hyperspectral and multispectral image fusion allows us to overcome the hardware limitations of hyperspectral imaging systems inherent to their lower spatial resolution. Nevertheless, existing algorithms usually fail to consider realistic…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Xiuheng Wang , Ricardo Augusto Borsoi , Cédric Richard , Jie Chen

Recently, Deep Image Prior (DIP) has demonstrated strong capabilities for solving inverse imaging problems (IIPs) by optimizing a randomly initialized convolutional neural network in a training-data-free regime. However, DIP suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Chaoyan Huang , Cheng-Han Huang , Ismail R. Alkhouri , Rongrong Wang

Recent inverse problem solvers that leverage generative diffusion priors have garnered significant attention due to their exceptional quality. However, adaptation of the prior is necessary when there exists a discrepancy between the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Hyungjin Chung , Jong Chul Ye

Learning a good image prior is a long-term goal for image restoration and manipulation. While existing methods like deep image prior (DIP) capture low-level image statistics, there are still gaps toward an image prior that captures rich…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Xingang Pan , Xiaohang Zhan , Bo Dai , Dahua Lin , Chen Change Loy , Ping Luo

Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yongsheng Zang , Dongming Zhou , Changcheng Wang , Rencan Nie , Yanbu Guo