English
Related papers

Related papers: Smoothing $\mathcal{L}^2$ gradients in iterative r…

200 papers

Many problems in Science and Engineering give rise to linear integral equations of the first kind with a smooth kernel. Discretization of the integral operator yields a matrix, whose singular values cluster at the origin. We describe the…

Numerical Analysis · Mathematics 2022-04-13 Thomas Mach , Lothar Reichel , Marc Van Barel

This paper introduces a novel approach to learning sparsity-promoting regularizers for solving linear inverse problems. We develop a bilevel optimization framework to select an optimal synthesis operator, denoted as $B$, which regularizes…

Machine Learning · Statistics 2026-03-03 Giovanni S. Alberti , Ernesto De Vito , Tapio Helin , Matti Lassas , Luca Ratti , Matteo Santacesaria

Regularization for optimization is a crucial technique to avoid overfitting in machine learning. In order to obtain the best performance, we usually train a model by tuning the regularization parameters. It becomes costly, however, when a…

Machine Learning · Computer Science 2020-08-18 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same…

Numerical Analysis · Mathematics 2025-01-23 Marcella Bonazzoli , Houssem Haddar , Tuan Anh Vu

Image de-blurring is important in many cases of imaging a real scene or object by a camera. This project focuses on de-blurring an image distorted by an out-of-focus blur through a simulation study. A pseudo-inverse filter is first explored…

Computer Vision and Pattern Recognition · Computer Science 2017-11-03 Yuzhen Lu

Solving large-scale Bayesian inverse problems presents significant challenges, particularly when the exact (discretized) forward operator is unavailable. These challenges often arise in image processing tasks due to unknown defects in the…

Numerical Analysis · Mathematics 2024-11-22 Yutong Bu , Julianne Chung

This paper is concerned with the inverse problem of reconstructing an inhomogeneous medium from the acoustic far-field data at a fixed frequency in two dimensions. This inverse problem is severely ill-posed (and also strongly nonlinear),…

Numerical Analysis · Mathematics 2023-09-21 Kai Li , Bo Zhang , Haiwen Zhang

We introduce a data-adaptive inversion method that integrates classical or deep learning-based approaches with iterative graph Laplacian regularization, specifically targeting acoustic impedance inversion - a critical task in seismic…

Numerical Analysis · Mathematics 2025-04-18 Davide Bianchi , Florian Bossmann , Wenlong Wang , Mingming Liu

Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems…

Numerical Analysis · Mathematics 2020-01-29 Frank Werner , Bernd Hofmann

In this paper, we use the optimization formulation of nonlinear Kalman filtering and smoothing problems to develop second-order variants of iterated Kalman smoother (IKS) methods. We show that Newton's method corresponds to a recursion over…

Signal Processing · Electrical Eng. & Systems 2023-06-16 Fatemeh Yaghoobi , Hany Abdulsamad , Simo Särkkä

This work is concerned with linear inverse problems where a distributed parameter is known a priori to only take on values from a given discrete set. This property can be promoted in Tikhonov regularization with the aid of a suitable convex…

Optimization and Control · Mathematics 2018-04-19 Christian Clason , Thi Bich Tram Do

Gradient descent can be surprisingly good at optimizing deep neural networks without overfitting and without explicit regularization. We find that the discrete steps of gradient descent implicitly regularize models by penalizing gradient…

Machine Learning · Computer Science 2022-07-20 David G. T. Barrett , Benoit Dherin

Stochastic variance reduced gradient (SVRG) is a popular variance reduction technique for accelerating stochastic gradient descent (SGD). We provide a first analysis of the method for solving a class of linear inverse problems in the lens…

Numerical Analysis · Mathematics 2022-01-19 Bangti Jin , Zehui Zhou , Jun Zou

Over the last decades, the total variation (TV) evolved to one of the most broadly-used regularisation functionals for inverse problems, in particular for imaging applications. When first introduced as a regulariser, higher-order…

Optimization and Control · Mathematics 2020-12-30 Kristian Bredies , Martin Holler

Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a data fidelity term and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

In this article we propose a novel nonstationary iterated Tikhonov (NIT) type method for obtaining stable approximate solutions to ill-posed operator equations modeled by linear operators acting between Hilbert spaces. Geometrical…

Numerical Analysis · Mathematics 2020-11-12 R. Boiger , A. Leitao , B. F. Svaiter

In this paper, a class of smoothing modulus-based iterative method was presented for solving implicit complementarity problems. The main idea was to transform the implicit complementarity problem into an equivalent implicit fixed-point…

Numerical Analysis · Mathematics 2023-06-09 Cong Guo , Chenliang Li , Tao Luo

This paper is concerned with the classical inverse scattering problem to recover the refractive index of a medium given near or far field measurements of scattered time-harmonic acoustic waves. It contains the first rigorous proof of…

Numerical Analysis · Mathematics 2015-06-19 Thorsten Hohage , Frederic Weidling

In this paper, we propose to use the general $L^2$-based Sobolev norms, i.e., $H^s$ norms where $s\in \mathbb{R}$, to measure the data discrepancy due to noise in image processing tasks that are formulated as optimization problems. As…

Numerical Analysis · Mathematics 2022-03-01 Bowen Zhu , Jingwei Hu , Yifei Lou , Yunan Yang

The analysis of Tikhonov regularization for nonlinear ill-posed equations with smoothness promoting penalties is an important topic in inverse problem theory. With focus on Hilbert scale models, the case of oversmoothing penalties, i.e.,…

Numerical Analysis · Mathematics 2024-04-18 Bernd Hofmann , Christopher Hofmann , Peter Mathé , Robert Plato