English
Related papers

Related papers: Acceleration techniques for regularized Newton met…

200 papers

Newton-type methods are typically analyzed under Lipschitz continuity of the Hessian, an assumption that can fail for objectives with higher-order or polynomial growth. We introduce a class of nonlinearly preconditioned Newton methods that…

Optimization and Control · Mathematics 2026-05-14 Alexander Bodard , Panagiotis Patrinos

Discrete inverse problems correspond to solving a system of equations in a stable way with respect to noise in the data. A typical approach to enforce uniqueness and select a meaningful solution is to introduce a regularizer. While for most…

Optimization and Control · Mathematics 2022-04-22 Cristian Vega , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

The choice of a suitable regularization parameter is an important part of most regularization methods for inverse problems. In the absence of reliable estimates of the noise level, heuristic parameter choice rules can be used to accomplish…

Numerical Analysis · Mathematics 2022-05-23 Simon Hubmer , Ekaterina Sherina , Stefan Kindermann , Kemal Raik

We show that Nesterov acceleration is an optimal-order iterative regularization method for linear ill-posed problems provided that a parameter is chosen accordingly to the smoothness of the solution. This result is proven both for an a…

Numerical Analysis · Mathematics 2021-07-07 Stefan Kindermann

As second-order methods, Gauss--Newton-type methods can be more effective than first-order methods for the solution of nonsmooth optimization problems with expensive-to-evaluate smooth components. Such methods, however, often do not…

Optimization and Control · Mathematics 2020-09-01 Jyrki Jauhiainen , Petri Kuusela , Aku Seppänen , Tuomo Valkonen

This work investigates a dynamical system functioning as a nonsmooth adaptation of the continuous Newton method, aimed at minimizing the sum of a primal lower-regular and a locally Lipschitz function, both potentially nonsmooth. The…

Optimization and Control · Mathematics 2024-12-10 Juan Guillermo Garrido , Pedro Pérez-Aros , Emilio Vilches

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

Generative diffusion models can provide powerful prior probability models for inverse problems in imaging, but existing implementations suffer from two key limitations: $(i)$ the prior density is represented implicitly, and $(ii)$ they rely…

Machine Learning · Computer Science 2026-05-19 Nicolas Zilberstein , Santiago Segarra , Eero Simoncelli , Florentin Guth

Image reconstruction of EIT mathematically is a typical nonlinear and severely ill-posed inverse problem. Appropriate priors or penalties are required to enable the reconstruction. The commonly used L2-norm can enforce the stability to…

Numerical Analysis · Mathematics 2018-03-13 Jing Wang , Bo Han , Wei Wang

Regularization methods are a key tool in the solution of inverse problems. They are used to introduce prior knowledge and make the approximation of ill-posed (pseudo-)inverses feasible. In the last two decades interest has shifted from…

Numerical Analysis · Mathematics 2018-01-31 Martin Benning , Martin Burger

A new sampling method for inverse scattering problems is proposed to process far field data of one incident wave. As the linear sampling method, the method sets up ill-posed integral equations and uses the (approximate) solutions to…

Analysis of PDEs · Mathematics 2018-08-01 Juan Liu , Jiguang Sun

This paper is concerned with backward problem for nonlinear space fractional diffusion with additive noise on the right-hand side and the final value. To regularize the instable solution, we develop some new regularized method for solving…

Analysis of PDEs · Mathematics 2016-12-19 Erkan Nane , Nguyen Huy Tuan

During the inversion of discrete linear systems noise in data can be amplified and result in meaningless solutions. To combat this effect, characteristics of solutions that are considered desirable are mathematically implemented during…

Numerical Analysis · Mathematics 2023-02-07 Michael J. Byrne , Rosemary A. Renaut

We study image inverse problems with a normalizing flow prior. Our formulation views the solution as the maximum a posteriori estimate of the image conditioned on the measurements. This formulation allows us to use noise models with…

Machine Learning · Computer Science 2021-07-02 Jay Whang , Qi Lei , Alexandros G. Dimakis

In this paper we consider ill-posed inverse problems, both linear and nonlinear, by a heavy ball method in which a strongly convex regularization function is incorporated to detect the feature of the sought solution. We develop ideas on how…

Numerical Analysis · Mathematics 2024-04-05 Qinian Jin , Qin Huang

We propose a regularization method to solve a nonlinear ill-posed problem connected to inversion of data gathered by a ground conductivity meter.

Numerical Analysis · Mathematics 2021-09-21 Gian Piero Deidda , Caterina Fenu , Giuseppe Rodriguez

This paper considers the regularization continuation method and the trust-region updating strategy for the nonlinearly equality-constrained optimization problem. Namely, it uses the inverse of the regularization quasi-Newton matrix as the…

Optimization and Control · Mathematics 2023-08-07 Xin-long Luo , Hang Xiao , Sen Zhang

This paper considers the problems of solving monotone variational inequalities with H\"older continuous Jacobians. By employing the knowledge of H\"older parameter $\nu$, we propose the $\nu$-regularized extra-Newton method within at most…

Optimization and Control · Mathematics 2022-12-19 Chengchang Liu , Luo Luo

Solving inverse problems requires appropriate regularization techniques to ensure well-posedness and stability. In recent years, denoiser-driven methods have emerged as effective regularization strategies, achieving state-of-the-art…

Numerical Analysis · Mathematics 2026-04-23 Harshit Bajpai , Ankik Kumar Giri , Tim Jahn , Abhinav Jha

The new version of a posteriori choice (NVAC) of the regularization parameter in the classical Tikhonov regularization method is considered. Lemmas and theorems on the error and the asymptotic convergence rate of the regularized solution…

Functional Analysis · Mathematics 2015-09-28 V. S. Sizikov