English
Related papers

Related papers: On the order optimality of the regularization via …

200 papers

This study proposes a cubic regularization of the Newton method for generating weakly efficient points of unconstrained vector optimization problems under no convexity assumption on the objective function. It is observed that at a given…

Optimization and Control · Mathematics 2025-05-20 Debdas Ghosh

We consider the entropic regularization of discretized optimal transport and propose to solve its optimality conditions via a logarithmic Newton iteration. We show a quadratic convergence rate and validate numerically that the method…

Optimization and Control · Mathematics 2018-02-12 Christoph Brauer , Christian Clason , Dirk Lorenz , Benedikt Wirth

Despite a variety of available techniques the issue of the proper regularization parameter choice for inverse problems still remains one of the biggest challenges. The main difficulty lies in constructing a rule, allowing to compute the…

Numerical Analysis · Mathematics 2017-10-13 Ernesto De Vito , Massimo Fornasier , Valeriya Naumova

In this article the concept of saturation of an arbitrary regularization method is formalized based upon the original idea of saturation for spectral regularization methods introduced by A. Neubauer in 1994. Necessary and sufficient…

Functional Analysis · Mathematics 2011-08-23 Terry Herdman , Ruben D. Spies , Karina G. Temperini

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Marc Kachelrieß , Marc Dewey , Christian Wald , Christoph Kolbitsch

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

High-order tensor methods that employ Taylor-based local models (of degree $p\ge 3$) within adaptive regularization frameworks have been recently proposed for both convex and nonconvex optimization problems. They have been shown to have…

Optimization and Control · Mathematics 2024-04-19 Wenqi Zhu , Coralia Cartis

The numerical solution of linear discrete ill-posed problems typically requires regularization, i.e., replacement of the available ill-conditioned problem by a nearby better conditioned one. The most popular regularization methods for…

Numerical Analysis · Mathematics 2016-02-11 Silvia Noschese , Lothar Reichel

We analyze Newton's method with lazy Hessian updates for solving general possibly non-convex optimization problems. We propose to reuse a previously seen Hessian for several iterations while computing new gradients at each step of the…

Optimization and Control · Mathematics 2023-06-16 Nikita Doikov , El Mahdi Chayti , Martin Jaggi

Recovering a function or high-dimensional parameter vector from indirect measurements is a central task in various scientific areas. Several methods for solving such inverse problems are well developed and well understood. Recently, novel…

Numerical Analysis · Mathematics 2019-12-10 Housen Li , Johannes Schwab , Stephan Antholzer , Markus Haltmeier

In this paper, we investigate iterative methods that are based on sampling of the data for computing Tikhonov-regularized solutions. We focus on very large inverse problems where access to the entire data set is not possible all at once…

Numerical Analysis · Mathematics 2018-12-18 J. Tanner Slagel , Julianne Chung , Matthias Chung , David Kozak , Luis Tenorio

In this paper we investigate the problem of identifying the source term in an elliptic system from a single noisy measurement couple of the Neumann and Dirichlet data. A variational method of Tikhonov-type regularization with specific…

Analysis of PDEs · Mathematics 2019-03-15 Michael Hinze , Bernd Hofmann , Tran Nhan Tam Quyen

We study an iterative regularization method of optimal control problems with control constraints. The regularization method is based on generalized Bregman distances. We provide convergence results under a combination of a source condition…

Optimization and Control · Mathematics 2016-11-04 Frank Pörner , Daniel Wachsmuth

We propose a regularized Hessian-free Newton-type method for minimizing smooth convex functions with Lipschitz continuous Hessians. The algorithm constructs an approximate Hessian by finite differences and selects the regularization…

Optimization and Control · Mathematics 2026-05-01 Leandro Farias Maia , Antonio Victor B. Nascimento , Paulo Sergio M. Santos , Gilson N. Silva

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

In this paper, we consider an inverse problem to determine a source term in a parabolic equation, where the data are obtained at a certain time. In general, this problem is ill-posed, therefore the Tikhonov regularization method is proposed…

Analysis of PDEs · Mathematics 2015-12-10 Nguyen Huy Tuan , Nguyen Van Thinh , Vo Anh Khoa , Tran Thanh Binh

In this manuscript we propose and analyze an implicit two-point type method (or inertial method) for obtaining stable approximate solutions to linear ill-posed operator equations. The method is based on the iterated Tikhonov (iT) scheme. We…

Numerical Analysis · Mathematics 2024-01-30 Joel C. Rabelo , Antonio Leitão , Alexandre L. Madureira

We propose an inexact infeasible arc-search interior-point method for solving linear optimization problems. The method combines an arc-search strategy with inexact solutions to Newton systems and admits a polynomial iteration complexity…

Optimization and Control · Mathematics 2026-01-08 Einosuke Iida , Makoto Yamashita