English
Related papers

Related papers: A novel two-point gradient method for Regularizati…

200 papers

We consider the method of quasi-solutions (also referred to as Ivanov regularization) for the regularization of linear ill-posed problems in non-reflexive Banach spaces. Using the equivalence to a metric projection onto the image of the…

Optimization and Control · Mathematics 2018-10-09 Christian Clason , Andrej Klassen

In this work, we consider a constrained convex problem with linear inequalities and provide an inexact penalty re-formulation of the problem. The novelty is in the choice of the penalty functions, which are smooth and can induce a non-zero…

Optimization and Control · Mathematics 2020-05-04 Tatiana Tatarenko , Angelia Nedich

We study the performance of stochastic first-order methods for finding saddle points of convex-concave functions. A notorious challenge faced by such methods is that the gradients can grow arbitrarily large during optimization, which may…

Machine Learning · Computer Science 2024-06-10 Gergely Neu , Nneka Okolo

Recently, inverse problems have attracted more and more attention in computational mathematics and become increasingly important in engineering applications. After the discretization, many of inverse problems are reduced to linear systems.…

Numerical Analysis · Mathematics 2022-04-07 Gong Rongfang , Huang Qin

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same…

Numerical Analysis · Mathematics 2025-01-23 Marcella Bonazzoli , Houssem Haddar , Tuan Anh Vu

In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic…

Optimization and Control · Mathematics 2019-03-20 Nicolas Loizou , Peter Richtárik

We investigate generalized versions of the Iteratively Regularized Landweber Method, initially introduced in [Appl. Math. Optim., 38(1):45-68, 1998], to address linear and nonlinear ill-posed problems. Our approach is inspired by the…

Numerical Analysis · Mathematics 2023-12-07 Andrea Aspri , Otmar Scherzer

In this work, we propose and analyze a residual-minimization strategy for the numerical solution of nonlinear PDEs posed in Banach spaces. Given a finite-dimensional trial space and a suitably enriched discrete test space (of higher…

Numerical Analysis · Mathematics 2026-04-02 Ignacio Muga , Jorge Perera , Sergio Rojas , Ricardo Ruiz-Baier

We consider a scalar objective minimization problem over the solution set of another optimization problem. This problem is known as simple bilevel optimization problem and has drawn a significant attention in the last few years. Our inner…

Optimization and Control · Mathematics 2018-09-18 Yekini Shehu , Phan Tu Vuong , Alain Zemkoho

We characterize the solution of a broad class of convex optimization problems that address the reconstruction of a function from a finite number of linear measurements. The underlying hypothesis is that the solution is decomposable as a…

Optimization and Control · Mathematics 2021-07-26 Michael Unser , Shayan Aziznejad

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

Subspace recycling techniques have been used quite successfully for the acceleration of iterative methods for solving large-scale linear systems. These methods often work by augmenting a solution subspace generated iteratively by a known…

Numerical Analysis · Mathematics 2021-05-18 Ronny Ramlau , Kirk M. Soodhalter , Victoria Hutterer

This work is concerned with the iterative regularization of a non-smooth nonlinear ill-posed problem where the forward mapping is merely directionally but not G\^ateaux differentiable. Using a Bouligand subderivative of the forward mapping,…

Numerical Analysis · Mathematics 2019-07-02 Christian Clason , Vu Huu Nhu

Variational regularisation is the primary method for solving inverse problems, and recently there has been considerable work leveraging deeply learned regularisation for enhanced performance. However, few results exist addressing the…

Optimization and Control · Mathematics 2024-06-18 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

We present a new hybrid direct/iterative approach to the solution of a special class of saddle point matrices arising from the discretization of the steady incompressible Navier-Stokes equations on an Arakawa C-grid. The two-level method…

Numerical Analysis · Mathematics 2010-06-10 Fred Wubs , Jonas Thies

In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with general convex penalty term. When the data is given exactly, we give a…

Numerical Analysis · Mathematics 2016-01-13 Yuling Jiao , Qinian Jin , Xiliang Lu , Weijie Wang

We introduce and investigate an iterative scheme for approximating common fixed point of a family of Bregman relatively-nonexpansive mappings in real reflexive Banach spaces. We prove strong convergence theorem of the sequence generated by…

Functional Analysis · Mathematics 2017-07-27 Oladipo Abiodun Timoye , Enyinnaya Ekuma-Okereke

We consider parameter identification problems in parametrized partial differential equations (PDE). This leads to nonlinear ill-posed inverse problems. One way to solve them are iterative regularization methods, which typically require…

Numerical Analysis · Mathematics 2018-05-07 Dominik Garmatter , Bernard Haasdonk , Bastian Harrach

When optimization theorists consider optimization problems in infinite dimensional spaces, they need to deal with closed convex subsets(usually cones) which mostly have empty interior. These subsets often prevent optimization theorists from…

Functional Analysis · Mathematics 2022-10-19 Lixin Cheng , Weihao Mao