English
Related papers

Related papers: Regularization Theory of the Analytic Deep Prior A…

200 papers

The ability of deep image prior (DIP) to recover high-quality images from incomplete or corrupted measurements has made it popular in inverse problems in image restoration and medical imaging including magnetic resonance imaging (MRI).…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Shijun Liang , Evan Bell , Qing Qu , Rongrong Wang , Saiprasad Ravishankar

Regularization method and Bayesian inverse method are two dominating ways for solving inverse problems generated from various fields, e.g., seismic exploration and medical imaging. The two methods are related with each other by the MAP…

Numerical Analysis · Mathematics 2019-06-18 Junxiong Jia , Qihang Sun , Bangyu Wu , Jigen Peng

Markov decision processes (MDPs) with large number of states are of high practical interest. However, conventional algorithms to solve MDP are computationally infeasible in this scenario. Approximate dynamic programming (ADP) methods tackle…

Systems and Control · Computer Science 2014-11-19 Chandrashekar Lakshminarayanan , Shalabh Bhatnagar

Many application domains, spanning from computational photography to medical imaging, require recovery of high-fidelity images from noisy, incomplete or partial/compressed measurements. State of the art methods for solving these inverse…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Xinyi Wei , Hans van Gorp , Lizeth Gonzalez Carabarin , Daniel Freedman , Yonina C. Eldar , Ruud J. G. van Sloun

Recently, Deep Image Prior (DIP) has demonstrated strong capabilities for solving inverse imaging problems (IIPs) by optimizing a randomly initialized convolutional neural network in a training-data-free regime. However, DIP suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Chaoyan Huang , Cheng-Han Huang , Ismail R. Alkhouri , Rongrong Wang

In this article we investigate the connection between regularization theory for inverse problems and dynamic programming theory. This is done by developing two new regularization methods, based on dynamic programming techniques. The aim of…

Numerical Analysis · Mathematics 2021-01-26 S. Kindermann , A. Leitao

In this paper, we provide a modern synthesis of the classic inverse compositional algorithm for dense image alignment. We first discuss the assumptions made by this well-established technique, and subsequently propose to relax these…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zhaoyang Lv , Frank Dellaert , James M. Rehg , Andreas Geiger

Deep image prior (DIP) was recently introduced as an effective unsupervised approach for image restoration tasks. DIP represents the image to be recovered as the output of a deep convolutional neural network, and learns the network's…

Image and Video Processing · Electrical Eng. & Systems 2023-02-10 Riccardo Barbano , Johannes Leuschner , Maximilian Schmidt , Alexander Denker , Andreas Hauptmann , Peter Maaß , Bangti Jin

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations…

Optimization and Control · Mathematics 2012-10-10 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

We propose a new method for optimistic planning in infinite-horizon discounted Markov decision processes based on the idea of adding regularization to the updates of an otherwise standard approximate value iteration procedure. This…

Machine Learning · Computer Science 2023-06-16 Antoine Moulin , Gergely Neu

Network regularization is an effective tool for incorporating structural prior knowledge to learn coherent models over networks, and has yielded provably accurate estimates in applications ranging from spatial economics to neuroimaging…

Machine Learning · Computer Science 2020-06-02 Hongyuan You , Furkan Kocayusufoglu , Ambuj K. Singh

Normalization techniques are a boon for modern deep learning. They let weights converge more quickly with often better generalization performances. It has been argued that the normalization-induced scale invariance among the weights…

Machine Learning · Computer Science 2021-01-19 Byeongho Heo , Sanghyuk Chun , Seong Joon Oh , Dongyoon Han , Sangdoo Yun , Gyuwan Kim , Youngjung Uh , Jung-Woo Ha

We study the deep image prior (DIP) framework applied to photoacoustic tomography (PAT) as an unsupervised reconstruction approach to mitigate limited-view artifacts and noise commonly encountered in experimental settings. Efficient…

Image and Video Processing · Electrical Eng. & Systems 2026-04-22 Hanna Pulkkinen , Jenni Poimala , Leonid Kunyansky , Janek Gröhl , Andreas Hauptmann

Inverse problems are characterized by their inherent non-uniqueness and sensitivity with respect to data perturbations. Their stable solution requires the application of regularization methods including variational and iterative…

Numerical Analysis · Mathematics 2023-10-17 Aviv Gibali , Markus Haltmeier

Plug-and-play priors (PnP) is a broadly applicable methodology for solving inverse problems by exploiting statistical priors specified as denoisers. Recent work has reported the state-of-the-art performance of PnP algorithms using…

Machine Learning · Computer Science 2021-01-25 Yu Sun , Zihui Wu , Xiaojian Xu , Brendt Wohlberg , Ulugbek S. Kamilov

Regularization by denoising (RED) is a widely-used framework for solving inverse problems by leveraging image denoisers as image priors. Recent work has reported the state-of-the-art performance of RED in a number of imaging applications…

Image and Video Processing · Electrical Eng. & Systems 2022-02-11 Yuyang Hu , Jiaming Liu , Xiaojian Xu , Ulugbek S. Kamilov

We consider the problem of designing efficient regularization algorithms when regularization is encoded by a (strongly) convex functional. Unlike classical penalization methods based on a relaxation approach, we propose an iterative method…

Optimization and Control · Mathematics 2017-07-19 Simon Matet , Lorenzo Rosasco , Silvia Villa , Bang Long Vu

Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain…

Machine Learning · Computer Science 2022-05-25 Shudong Zhang , Haichang Gao , Tianwei Zhang , Yunyi Zhou , Zihui Wu

We consider a regularization concept for the solution of ill--posed operator equations, where the operator is composed of a continuous and a discontinuous operator. A particular application is level set regularization, where we develop a…

Numerical Analysis · Mathematics 2020-11-16 F. Frühauf , O. Scherzer , A. Leitao

Deep image prior (DIP) and its variants have showed remarkable potential for solving inverse problems in computer vision, without any extra training data. Practical DIP models are often substantially overparameterized. During the fitting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Hengkang Wang , Taihui Li , Zhong Zhuang , Tiancong Chen , Hengyue Liang , Ju Sun