English
Related papers

Related papers: Regularization from examples via neural networks f…

200 papers

Deep learning is emerging as a new paradigm for solving inverse imaging problems. However, the deep learning methods often lack the assurance of traditional physics-based methods due to the lack of physical information considerations in…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 Dongdong Chen , Mike E. Davies

We consider the ill-posed inverse problem of identifying a nonlinearity in a time-dependent PDE model. The nonlinearity is approximated by a neural network, and needs to be determined alongside other unknown physical parameters and the…

Numerical Analysis · Mathematics 2022-11-23 Barbara Kaltenbacher , Tram Thi Ngoc Nguyen

Many application domains, spanning from computational photography to medical imaging, require recovery of high-fidelity images from noisy, incomplete or partial/compressed measurements. State of the art methods for solving these inverse…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Xinyi Wei , Hans van Gorp , Lizeth Gonzalez Carabarin , Daniel Freedman , Yonina C. Eldar , Ruud J. G. van Sloun

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

Recently, deep learning based methods appeared as a new paradigm for solving inverse problems. These methods empirically show excellent performance but lack of theoretical justification; in particular, no results on the regularization…

Numerical Analysis · Mathematics 2019-01-30 Johannes Schwab , Stephan Antholzer , Markus Haltmeier

In this paper we consider inverse problems that are mathematically ill-posed. That is, given some (noisy) data, there is more than one solution that approximately fits the data. In recent years, deep neural techniques that find the most…

Machine Learning · Computer Science 2023-08-28 Moshe Eliasof , Eldad Haber , Eran Treister

This paper presents an uncalibrated deep neural network framework for the photometric stereo problem. For training models to solve the problem, existing neural network-based methods either require exact light directions or ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

Regularization plays a pivotal role in integrating prior information into inverse problems. While many deep learning methods have been proposed to solve inverse problems, determining where to apply regularization remains a crucial…

Numerical Analysis · Mathematics 2024-03-22 Ke Chen , Chunmei Wang , Haizhao Yang

The choice of the parameter value for regularized inverse problems is critical to the results and remains a topic of interest. This article explores a criterion for selecting a good parameter value by maximizing the probability of the data,…

Numerical Analysis · Mathematics 2020-02-11 Toby Sanders , Rodrigo B. Platte , Robert D. Skeel

We consider the variational reconstruction framework for inverse problems and propose to learn a data-adaptive input-convex neural network (ICNN) as the regularization functional. The ICNN-based convex regularizer is trained adversarially…

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

Regularizing neural networks is important for anticipating model behavior in regions of the data space that are not well represented. In this work, we propose a regularization technique for enforcing a level of smoothness in the mapping…

Machine Learning · Computer Science 2025-03-05 Ali Hasan , Haoming Yang , Yuting Ng , Vahid Tarokh

Inverse Problems in medical imaging and computer vision are traditionally solved using purely model-based methods. Among those variational regularization models are one of the most popular approaches. We propose a new framework for applying…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Sebastian Lunz , Ozan Öktem , Carola-Bibiane Schönlieb

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

A two-dimensional tomographic problem is studied. The target is assumed to be a homogeneous object bounded by a smooth curve. A Non Uniform Rational Basis Splines (NURBS) curve is used as computational representation of the boundary. This…

Numerical Analysis · Mathematics 2017-08-08 Heikki Haario , Aki Kallonen , Marko Laine , Esa Niemi , Zenith Purisha , Samuli Siltanen

Proper regularization is crucial in inverse problems to achieve high-quality reconstruction, even with an ill-conditioned measurement system. This is particularly true for three-dimensional photoacoustic tomography, which is computationally…

Optimization and Control · Mathematics 2024-09-26 Chao Wang , Alexandre H. Thiery

Standard regularization methods that are used to compute solutions to ill-posed inverse problems require knowledge of the forward model. In many real-life applications, the forward model is not known, but training data is readily available.…

Numerical Analysis · Mathematics 2015-06-19 Julianne Chung , Matthias Chung

When training overparameterized deep networks for classification tasks, it has been widely observed that the learned features exhibit a so-called "neural collapse" phenomenon. More specifically, for the output features of the penultimate…

Machine Learning · Computer Science 2023-03-09 Can Yaras , Peng Wang , Zhihui Zhu , Laura Balzano , Qing Qu