English
Related papers

Related papers: Using Deep Image Priors to Generate Counterfactual…

200 papers

The "deep image prior" proposed by Ulyanov et al. is an intriguing property of neural nets: a convolutional encoder-decoder network can be used as a prior for natural images. The network architecture implicitly introduces a bias; If we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Prithvijit Chakrabarty , Subhransu Maji

In recent years, we have witnessed the great advancement of Deep neural networks (DNNs) in image restoration. However, a critical limitation is that they cannot generalize well to real-world degradations with different degrees or types. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Xin Li , Bingchen Li , Xin Jin , Cuiling Lan , Zhibo Chen

Image representations, from SIFT and bag of visual words to Convolutional Neural Networks (CNNs) are a crucial component of almost all computer vision systems. However, our understanding of them remains limited. In this paper we study…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Aravindh Mahendran , Andrea Vedaldi

Generative models, such as GANs, learn an explicit low-dimensional representation of a particular class of images, and so they may be used as natural image priors for solving inverse problems such as image restoration and compressive…

Machine Learning · Computer Science 2025-10-28 Mara Daniels , Paul Hand , Reinhard Heckel

Deep neural networks excel at comprehending complex visual signals, delivering on par or even superior performance to that of human experts. However, ad-hoc visual explanations of model decisions often reveal an alarming level of reliance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Dong Wang , Yuewei Yang , Chenyang Tao , Zhe Gan , Liqun Chen , Fanjie Kong , Ricardo Henao , Lawrence Carin

Although sparse-view computed tomography (CT) has significantly reduced radiation dose, it also introduces severe artifacts which degrade the image quality. In recent years, deep learning-based methods for inverse problems have made…

Image and Video Processing · Electrical Eng. & Systems 2024-01-02 Shuo Xu , Yucheng Zhang , Gang Chen , Xincheng Xiang , Peng Cong , Yuewen Sun

Seismic data frequently exhibits missing traces, substantially affecting subsequent seismic processing and interpretation. Deep learning-based approaches have demonstrated significant advancements in reconstructing irregularly missing…

Geophysics · Physics 2025-01-16 Paul Goyes-Peñafiel , Ulugbek Kamilov , Henry Arguello

Deep Image Prior (DIP) has recently emerged as a promising one-shot neural-network based image reconstruction method. However, DIP has seen limited application to 3D image reconstruction problems. In this work, we introduce Tada-DIP, a…

Image and Video Processing · Electrical Eng. & Systems 2025-12-04 Evan Bell , Shijun Liang , Ismail Alkhouri , Saiprasad Ravishankar

Recovering clear images from blurry ones with an unknown blur kernel is a challenging problem. Deep image prior (DIP) proposes to use the deep network as a regularizer for a single image rather than as a supervised model, which achieves…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tingting Wu , Zhiyan Du , Zhi Li , Feng-Lei Fan , Tieyong Zeng

This paper proposes a novel approach to regularize the \textit{ill-posed} and \textit{non-linear} blind image deconvolution (blind deblurring) using deep generative networks as priors. We employ two separate generative models --- one…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Muhammad Asim , Fahad Shamshad , Ali Ahmed

Many seemingly unrelated computer vision tasks can be viewed as a special case of image decomposition into separate layers. For example, image segmentation (separation into foreground and background layers); transparent layer separation…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Yossi Gandelsman , Assaf Shocher , Michal Irani

Reconstructing magnetization in nanoscale magnetic thin films is essential for developing next-generation memory, sensors, and various spintronic technologies. However, this remains challenging due to the ill-posed nature of the stray field…

Disordered Systems and Neural Networks · Physics 2026-04-28 Zander Scholl , Justin Woods , Charudatta Phatak , Hanu Arava

Deep Neural Networks (DNNs) are well-known to act as over-parameterized deep image priors (DIP) that regularize various image inverse problems. Meanwhile, researchers also proposed extremely compact, under-parameterized image priors (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Qiming Wu , Xiaohan Chen , Yifan Jiang , Zhangyang Wang

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

Deep image prior (DIP), which utilizes a deep convolutional network (ConvNet) structure itself as an image prior, has attracted attentions in computer vision and machine learning communities. It empirically shows the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Tatsuya Yokota , Hidekata Hontani , Qibin Zhao , Andrzej Cichocki

Deep image prior (DIP) has been successfully applied to positron emission tomography (PET) image restoration, enabling represent implicit prior using only convolutional neural network architecture without training dataset, whereas the…

Medical Physics · Physics 2024-04-23 Yuya Onishi , Fumio Hashimoto , Kibo Ote , Keisuke Matsubara , Masanobu Ibaraki

Blind image deconvolution (BID) is a classic yet challenging problem in the field of image processing. Recent advances in deep image prior (DIP) have motivated a series of DIP-based approaches, demonstrating remarkable success in BID.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiangtao Zhang , Zongsheng Yue , Hui Wang , Qian Zhao , Deyu Meng

Deep image prior (DIP) serves as a good inductive bias for diverse inverse problems. Among them, denoising is known to be particularly challenging for the DIP due to noise fitting with the requirement of an early stopping. To address the…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Yeonsik Jo , Se Young Chun , Jonghyun Choi

Image denoisers have been shown to be powerful priors for solving inverse problems in imaging. In this work, we introduce a generalization of these methods that allows any image restoration network to be used as an implicit prior. The…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Yuyang Hu , Mauricio Delbracio , Peyman Milanfar , Ulugbek S. Kamilov

While invaluable for many computer vision applications, decomposing a natural image into intrinsic reflectance and shading layers represents a challenging, underdetermined inverse problem. As opposed to strict reliance on conventional…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Qingnan Fan , Jiaolong Yang , Gang Hua , Baoquan Chen , David Wipf