English
Related papers

Related papers: A convergence analysis of the iteratively regulari…

200 papers

In this paper, we propose a first second-order scheme based on arbitrary non-Euclidean norms, incorporated by Bregman distances. They are introduced directly in the Newton iterate with regularization parameter proportional to the square…

Optimization and Control · Mathematics 2021-12-07 Nikita Doikov , Yurii Nesterov

The object of the present paper is to extend the third-order iterative method for solving nonlinear equations into systems of nonlinear equations. Since our motive is to develop the method which improve the order of convergence of Newton's…

Numerical Analysis · Mathematics 2013-09-24 Anuradha Singh , J. P. Jaiswa

We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone…

Optimization and Control · Mathematics 2026-02-12 Ching-pei Lee , Stephen J. Wright

Linear inverse problems are ubiquitous. Often the measurements do not follow a Gaussian distribution. Additionally, a model matrix with a large condition number can complicate the problem further by making it ill-posed. In this case, the…

Finding an $\epsilon$-stationary point of a nonconvex function with a Lipschitz continuous Hessian is a central problem in optimization. Regularized Newton methods are a classical tool and have been studied extensively, yet they still face…

Optimization and Control · Mathematics 2025-11-03 Yuhao Zhou , Jintao Xu , Bingrui Li , Chenglong Bao , Chao Ding , Jun Zhu

We consider the inexact Newton methods $$ x_{n+1}^\d=x_n^\d-g_{\a_n}(F'(x_n^\d)^* F'(x_n^\d)) F'(x_n^\d)^* (F(x_n^\d)-y^\d) $$ for solving nonlinear ill-posed inverse problems $F(x)=y$ using the only available noise data $y^\d$ satisfying…

Numerical Analysis · Mathematics 2010-10-19 Qinian Jin

We investigate iterated Tikhonov methods coupled with a Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations. We show that the proposed method is a convergent regularization method. In the…

Numerical Analysis · Mathematics 2020-12-23 J. Baumeister , A. De Cezaro , A. Leitao

In this paper, we study the Gauss-Newton method for a special class of systems of nonlinear equation. Under the hypothesis that the derivative of the function under consideration satisfies a majorant condition, semi-local convergence…

Optimization and Control · Mathematics 2012-06-21 Max L. N. Gonçalves , Paulo R. Oliveira

A local convergence analysis of Newton's method for solving nonlinear equations, under a majorant condition, is presented in this paper. Without assuming convexity of the derivative of the majorant function, which relaxes the Lipschitz…

Numerical Analysis · Mathematics 2010-02-25 O. P. Ferreira

This article develops a solution for an inverse problem through the generalized method of lines. We consider a Laplace equation on a domain with internal and external boundaries with standard Dirichlet boundary conditions. Also, we specify…

Optimization and Control · Mathematics 2019-07-05 Fabio Silva Botelho

In this paper, we generalize (accelerated) Newton's method with cubic regularization under inexact second-order information for (strongly) convex optimization problems. Under mild assumptions, we provide global rate of convergence of these…

Optimization and Control · Mathematics 2017-10-17 Saeed Ghadimi , Han Liu , Tong Zhang

We provide a general approach to Lipschitz regularity of solutions for a large class of vector-valued, nonautonomous variational problems exhibiting nonuniform ellipticity. The functionals considered here range amongst those with unbalanced…

Analysis of PDEs · Mathematics 2021-08-02 Cristiana De Filippis , Giuseppe Mingione

We propose a generalization of the Weierstrass iteration for over-constrained systems of equations and we prove that the proposed method is the Gauss-Newton iteration to find the nearest system which has at least $k$ common roots and which…

Symbolic Computation · Computer Science 2014-01-22 Olivier Ruatta , Mark Sciabica , Agnes Szanto

In the context of linear inverse problems, we propose and study a general iterative regularization method allowing to consider large classes of regularizers and data-fit terms. The algorithm we propose is based on a primal-dual diagonal…

Optimization and Control · Mathematics 2017-08-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

For the solution of full-rank ill-posed linear systems a new approach based on the Arnoldi algorithm is presented. Working with regularized systems, the method theoretically reconstructs the true solution by means of the computation of a…

Numerical Analysis · Mathematics 2010-09-29 Claude Brezinski , Paolo Novati , Michela Redivo-Zaglia

We study a Newton-like method for the minimization of an objective function that is the sum of a smooth convex function and an l-1 regularization term. This method, which is sometimes referred to in the literature as a proximal Newton…

Optimization and Control · Mathematics 2013-09-16 Richard H. Byrd , Jorge Nocedal , Figen Oztoprak

In this paper we investigate all-at-once versus reduced regularization of dynamic inverse problems on finite time intervals $(0,T)$. In doing so, we concentrate on iterative methods and nonlinear problems, since they have already been shown…

Numerical Analysis · Mathematics 2019-10-16 Barbara Kaltenbacher

We explore the use of the Gauss-Newton method for optimization in shape learning, including implicit neural surfaces and geometry-informed neural networks. The method addresses key challenges in shape learning, such as the ill-conditioning…

Machine Learning · Computer Science 2026-02-16 James King , Arturs Berzins , Siddhartha Mishra , Marius Zeinhofer

The article introduces a new algorithm for solving a class ofequilibrium problems involving strongly pseudomonotone bifunctions with Lipschitz-type condition. We describe how to incorporate the proximal-like regularized technique with…

Optimization and Control · Mathematics 2018-04-26 Dang Van Hieu

This paper is concerned with the least squares inverse eigenvalue problem of reconstructing a linear parameterized real symmetric matrix from the prescribed partial eigenvalues in the sense of least squares, which was originally proposed by…

Numerical Analysis · Mathematics 2018-06-19 Teng-Teng Yao , Zheng-Jian Bai , Xiao-Qing Jin , Zhi Zhao