English
Related papers

Related papers: A novel two-point gradient method for Regularizati…

200 papers

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

We prove strong convergence theorems of some iterative algorithms in a real uniformly smooth Banach space. The results presented extend, generalize and improve the corresponding results recently announced by many authors.

Functional Analysis · Mathematics 2015-08-28 Abba Auwalu

This paper considers optimization of smooth nonconvex functionals in smooth infinite dimensional spaces. A H\"older gradient descent algorithm is first proposed for finding approximate first-order points of regularized polynomial…

Optimization and Control · Mathematics 2021-04-07 Serge Gratton , Sadok Jerad , Philippe L. Toint

In this paper, two generalized algorithms for solving the variational inequality problem in Banach spaces are proposed. Then the strong convergence of the sequences generated by these algorithms will be proved under the suitable conditions.…

Functional Analysis · Mathematics 2021-05-25 M. Ghadampour , E. Soori

We consider composite linear inverse problems where the signal to recover is modeled as a sum of two functions. We study a variational framework formulated as an optimization problem over the pairs of components using two regularization…

Optimization and Control · Mathematics 2026-05-25 Adrian Jarret , Julien Fageot

A nonlinear equation in a Banach space is written as a linear equation with a linear operator depending on the unknown solution. This method, which we call a global linearization method, differs essentially from the local linearization…

Mathematical Physics · Physics 2007-05-23 A. G. Ramm

Constructing or learning a function from a finite number of sampled data points (measurements) is a fundamental problem in science and engineering. This is often formulated as a minimum norm interpolation problem, regularized learning…

Functional Analysis · Mathematics 2020-06-26 Rui Wang , Yuesheng Xu

This work presents a comprehensive discretization theory for abstract linear operator equations in Banach spaces. The fundamental starting point of the theory is the idea of residual minimization in dual norms, and its inexact version using…

Numerical Analysis · Mathematics 2022-11-15 Ignacio Muga , Kristoffer G. van der Zee

This paper deals with a general form of variational problems in Banach spaces which encompasses variational inequalities as well as minimization problems. We prove a characterization of local error bounds for the distance to the…

Optimization and Control · Mathematics 2018-07-12 Christian Kanzow , Daniel Steck

This paper introduces a novel steepest descent flow in Banach spaces. This extends previous works on generalized gradient descent, notably the work of Charpiat et al., to the setting of Finsler metrics. Such a generalized gradient allows…

Numerical Analysis · Mathematics 2015-12-08 Guillaume Charpiat , Giacomo Nardi , Gabriel Peyré , François-Xavier Vialard

This paper is a close follow-up of Kaltenbacher and Tomba 2013 and Jin 2012, where Newton-Landweber iterations have been shown to converge either (unconditionally) without rates or (under an additional regularity assumption) with rates. The…

Numerical Analysis · Mathematics 2014-08-22 Barbara Kaltenbacher , Ivan Tomba

In this paper, we introduce some new iterative optimisation algorithms on Riemannian manifolds and Hilbert spaces which have good global convergence guarantees to local minima. More precisely, these algorithms have the following properties:…

Optimization and Control · Mathematics 2025-05-29 Tuyen Trung Truong

Recently, deep unfolding methods that guide the design of deep neural networks (DNNs) through iterative algorithms have received increasing attention in the field of inverse problems. Unlike general end-to-end DNNs, unfolding methods have…

Optimization and Control · Mathematics 2022-11-28 Zhuo-Xu Cui , Qingyong Zhu , Jing Cheng , Dong Liang

The use of second order information on the forward operator often comes at a very moderate additional computational price in the context of parameter identification probems for differential equation models. On the other hand the use of…

Numerical Analysis · Mathematics 2015-06-22 Barbara Kaltenbacher

In this paper, we introduce new implicit and explicit iterative schemes which converge strongly to a unique solution of variational inequality problems for strongly accretive operators over a common fixed point set of finite family of…

Functional Analysis · Mathematics 2010-07-07 Eric U. Ofoedu

We study the convergence of the gradient descent method for solving ill-posed problems where the solution is characterized as a global minimum of a differentiable functional in a Hilbert space. The classical least-squares functional for…

Numerical Analysis · Mathematics 2016-06-02 Stefan Kindermann

Bilevel programming has recently received a great deal of attention due to its abundant applications in many areas. The optimal value function approach provides a useful reformulation of the bilevel problem, but its utility is often limited…

Optimization and Control · Mathematics 2025-06-10 Jan Harold Alcantara , Akiko Takeda

The Multiscale Hierarchical Decomposition Method (MHDM) was introduced as an iterative method for total variation regularization, with the aim of recovering details at various scales from images corrupted by additive or multiplicative…

Numerical Analysis · Mathematics 2023-09-28 Stefan Kindermann , Elena Resmerita , Tobias Wolf

In this paper, we introduce a new three-step iteration process in Banach space and prove convergence results for approximating fixed points for nonexpansive mappings. Also, we show that the newly introduced iteration process converges…

Functional Analysis · Mathematics 2018-09-12 Chanchal Garodia , Izhar Uddin

In this work, we present a novel iterative deep Ritz method (IDRM) for solving a general class of elliptic problems. It is inspired by the iterative procedure for minimizing the loss during the training of the neural network, but at each…

Numerical Analysis · Mathematics 2025-01-28 Tianhao Hu , Bangti Jin , Fengru Wang