English
Related papers

Related papers: Regularization of Inverse Problems by Neural Netwo…

200 papers

During the inversion of discrete linear systems noise in data can be amplified and result in meaningless solutions. To combat this effect, characteristics of solutions that are considered desirable are mathematically implemented during…

Numerical Analysis · Mathematics 2023-02-07 Michael J. Byrne , Rosemary A. Renaut

This paper aims to solve numerically the two-dimensional inverse medium scattering problem with far-field data. This is a challenging task due to the severe ill-posedness and strong nonlinearity of the inverse problem. As already known, it…

Numerical Analysis · Mathematics 2025-09-25 Kai Li , Bo Zhang , Haiwen Zhang

Deep neural networks have proven remarkably effective at solving many classification problems, but have been criticized recently for two major weaknesses: the reasons behind their predictions are uninterpretable, and the predictions…

Machine Learning · Computer Science 2017-11-28 Andrew Slavin Ross , Finale Doshi-Velez

These lecture notes for a graduate class present the regularization theory for linear and nonlinear ill-posed operator equations in Hilbert spaces. Covered are the general framework of regularization methods and their analysis via spectral…

Functional Analysis · Mathematics 2021-02-09 Christian Clason

In this work, we investigate various approaches that use learning from training data to solve inverse problems, following a bi-level learning approach. We consider a general framework for optimal inversion design, where training data can be…

Numerical Analysis · Mathematics 2021-10-07 Julianne Chung , Matthias Chung , Silvia Gazzola , Mirjeta Pasha

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

Theoretical guarantees for the robust solution of inverse problems have important implications for applications. To achieve both guarantees and high reconstruction quality, we propose learning a pixel-based ridge regularizer with a…

Optimization and Control · Mathematics 2025-01-07 Sebastian Neumayer , Fabian Altekrüger

In recent years, deep learning-based methods have been proposed for solving inverse scattering problems (ISPs), but most of them heavily rely on data and suffer from limited generalization capabilities. In this paper, a new solving scheme…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Yutong Du , Zicheng Liu , Bazargul Matkerim , Changyou Li , Yali Zong , Bo Qi , Jingwei Kou

Designing appropriate variational regularization schemes is a crucial part of solving inverse problems, making them better-posed and guaranteeing that the solution of the associated optimization problem satisfies desirable properties.…

Machine Learning · Computer Science 2020-06-09 Ronan Fablet , Lucas Drumetz , Francois Rousseau

Deep learning, a branch of artificial intelligence, is a data-driven method that uses multiple layers of interconnected units or neurons to learn intricate patterns and representations directly from raw input data. Empowered by this…

Machine Learning · Computer Science 2025-07-28 Mohd Halim Mohd Noor , Ayokunle Olalekan Ige

Deep neural networks have introduced novel and useful tools to the machine learning community. Other types of classifiers can potentially make use of these tools as well to improve their performance and generality. This paper reviews the…

Machine Learning · Computer Science 2019-09-30 Alireza Ghods , Diane J Cook

Deep neural networks (DNNs) have become increasingly important due to their excellent empirical performance on a wide range of problems. However, regularization is generally achieved by indirect means, largely due to the complex set of…

Machine Learning · Computer Science 2018-07-02 Amal Rannen Triki , Maxim Berman , Matthew B. Blaschko

Standard regularization methods that are used to compute solutions to ill-posed inverse problems require knowledge of the forward model. In many real-life applications, the forward model is not known, but training data is readily available.…

Numerical Analysis · Mathematics 2015-06-19 Julianne Chung , Matthias Chung

Modern deep neural network (DNN) trainings utilize various training techniques, e.g., nonlinear activation functions, batch normalization, skip-connections, etc. Despite their effectiveness, it is still mysterious how they help accelerate…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Junjie Yang , Yi Zhou

Deep neural networks have dramatically advanced the state of the art for many areas of machine learning. Recently they have been shown to have a remarkable ability to generate highly complex visual artifacts such as images and text rather…

Computer Vision and Pattern Recognition · Computer Science 2016-07-08 Andrey Zhmoginov , Mark Sandler

We develop regularisation theory for dynamic inverse problems, solved using online methods with an infinite time horizon. Using concepts of subregularity to treat nonsmooth regularisers, we prove that time-averaged reconstruction errors…

Numerical Analysis · Mathematics 2026-05-26 Jyrki Jauhiainen , Yassine Nabou , Tuomo Valkonen

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

We consider a neural network architecture designed to solve inverse problems where the degradation operator is linear and known. This architecture is constructed by unrolling a forward-backward algorithm derived from the minimization of an…

Optimization and Control · Mathematics 2025-10-02 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

The need to blend observational data and mathematical models arises in many applications and leads naturally to inverse problems. Parameters appearing in the model, such as constitutive tensors, initial conditions, boundary conditions, and…

Statistics Theory · Mathematics 2010-09-16 J. Nolen , G. A. Pavliotis , A. M. Stuart

Inverse problems in imaging such as denoising, deblurring, superresolution (SR) have been addressed for many decades. In recent years, convolutional neural networks (CNNs) have been widely used for many inverse problem areas. Although their…

Machine Learning · Computer Science 2018-10-26 Cem Tarhan , Gozde Bozdagi Akar