English
Related papers

Related papers: Deep Learning for Inverse Problems: Bounds and Reg…

200 papers

Incorporating prior information into inverse problems, e.g. via maximum-a-posteriori estimation, is an important technique for facilitating robust inverse problem solutions. In this paper, we devise two novel approaches for linear inverse…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Carter Lyons , Raghu G. Raj , Margaret Cheney

The image reconstruction process in medical imaging can be treated as solving an inverse problem. The inverse problem is usually solved using time-consuming iterative algorithms with sparsity or other constraints. Recently, deep neural…

Medical Physics · Physics 2021-10-29 Jingke Zhang , Qiong He , Congzhi Wang , Hongen Liao , Jianwen Luo

In recent years, deep learning methods have been extensively developed for inverse imaging problems (IIPs), encompassing supervised, self-supervised, and generative approaches. Most of these methods require large amounts of labeled or…

Image and Video Processing · Electrical Eng. & Systems 2025-12-04 Ismail Alkhouri , Evan Bell , Avrajit Ghosh , Shijun Liang , Rongrong Wang , Saiprasad Ravishankar

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke

In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Kyong Hwan Jin , Michael T. McCann , Emmanuel Froustey , Michael Unser

We study a new family of inverse problems for recovering representations of corrupted data. We assume access to a pre-trained representation learning network R(x) that operates on clean images, like CLIP. The problem is to recover the…

Machine Learning · Computer Science 2021-10-28 Sriram Ravula , Georgios Smyrnis , Matt Jordan , Alexandros G. Dimakis

There has been significant recent interest in the use of deep learning for regularizing imaging inverse problems. Most work in the area has focused on regularization imposed implicitly by convolutional neural networks (CNNs) pre-trained for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Zihao Zou , Jiaming Liu , Brendt Wohlberg , Ulugbek S. Kamilov

Inverse problems play a key role in modern image/signal processing methods. However, since they are generally ill-conditioned or ill-posed due to lack of observations, their solutions may have significant intrinsic uncertainty. Analysing…

Signal Processing · Electrical Eng. & Systems 2019-09-09 Xiaohao Cai , Marcelo Pereyra , Jason D. McEwen

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

This paper extends our previous work on regularization of neural networks using Eigenvalue Decay by employing a soft approximation of the dominant eigenvalue in order to enable the calculation of its derivatives in relation to the synaptic…

Machine Learning · Computer Science 2016-05-10 Oswaldo Ludwig

Recently deep neural networks have been widely and successfully applied in computer vision tasks and attracted growing interests in medical imaging. One barrier for the application of deep neural networks to medical imaging is the need of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Kuang Gong , Kyungsang Kim , Jianan Cui , Ning Guo , Ciprian Catana , Jinyi Qi , Quanzheng Li

For any given neural network architecture a permutation of weights and biases results in the same functional network. This implies that optimization algorithms used to `train' or `learn' the network are faced with a very large number (in…

Optimization and Control · Mathematics 2022-02-22 Harbir Antil , Thomas S. Brown , Rainald Löhner , Fumiya Togashi , Deepanshu Verma

Neural networks allow solving many ill-posed inverse problems with unprecedented performance. Physics informed approaches already progressively replace carefully hand-crafted reconstruction algorithms in real applications. However, these…

Machine Learning · Computer Science 2023-12-19 Alban Gossard , Pierre Weiss

Inverse problems correspond to a certain type of optimization problems formulated over appropriate input distributions. Recently, there has been a growing interest in understanding the computational hardness of these optimization problems,…

Machine Learning · Statistics 2018-09-03 Alex Nowak , Soledad Villar , Afonso S. Bandeira , Joan Bruna

Standard regularization methods that are used to compute solutions to ill-posed inverse problems require knowledge of the forward model. In many real-life applications, the forward model is not known, but training data is readily available.…

Numerical Analysis · Mathematics 2015-06-19 Julianne Chung , Matthias Chung

In an attempt to better understand generalization in deep learning, we study several possible explanations. We show that implicit regularization induced by the optimization method is playing a key role in generalization and success of deep…

Machine Learning · Computer Science 2017-09-11 Behnam Neyshabur

Deep neural networks trained as image denoisers are widely used as priors for solving imaging inverse problems. While Gaussian denoising is thought sufficient for learning image priors, we show that priors from deep models pre-trained as…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Yuyang Hu , Albert Peng , Weijie Gan , Peyman Milanfar , Mauricio Delbracio , Ulugbek S. Kamilov

A novel artificial neural network method is proposed for solving Cauchy inverse problems. It allows multiple hidden layers with arbitrary width and depth, which theoretically yields better approximations to the inverse problems. In this…

Numerical Analysis · Mathematics 2020-01-07 Yixin Li , Xianliang Hu

In this work, we investigate various approaches that use learning from training data to solve inverse problems, following a bi-level learning approach. We consider a general framework for optimal inversion design, where training data can be…

Numerical Analysis · Mathematics 2021-10-07 Julianne Chung , Matthias Chung , Silvia Gazzola , Mirjeta Pasha

Multidimensional imaging, capturing image data in more than two dimensions, has been an emerging field with diverse applications. Due to the limitation of two-dimensional detectors in obtaining the high-dimensional image data, computational…

Image and Video Processing · Electrical Eng. & Systems 2020-06-16 Didem Dogan , Figen S. Oktem