English
Related papers

Related papers: Inexact Newton's method to nonlinear functions wit…

200 papers

We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and engineering, ranging from constrained deep neural networks, to…

Optimization and Control · Mathematics 2023-05-31 Ilgee Hong , Sen Na , Michael W. Mahoney , Mladen Kolar

In this paper, using generalized metric projection, we propose a new extragradient method for finding a common element of the solutions set of a generalized equilibrium problem and a variational inequality for an $\alpha$-inverse-strongly…

Functional Analysis · Mathematics 2016-11-01 Zeynab Jouymandi , Fridoun Moradlou

Newton's method is the most widespread high-order method, demanding the gradient and the Hessian of the objective function. However, one of the main disadvantages of Newtons method is its lack of global convergence and high iteration cost.…

In this paper, we investigate global convergence properties of the inexact nonsmooth Newton method for solving the system of absolute value equations (AVE). Global $Q$-linear convergence is established under suitable assumptions. Moreover,…

Optimization and Control · Mathematics 2015-11-13 J. Y. Bello Cruz , O. P. Ferreira , L. F. Prudente

Let $E$ be a uniformly smooth and uniformly convex real Banach space and $E^*$ be its dual space. Suppose $A : E\rightarrow E^*$ is bounded, strongly monotone and satisfies the range condition such that $A^{-1}(0)\neq \emptyset$. Inspired…

Functional Analysis · Mathematics 2020-08-19 Mathew O. Aibinu , O. T. Mewomo

In this paper we study Newton's method for solving generalized equations in Banach spaces. We show that under strong regularity of the generalized equation, the method is locally convergent to a solution with superlinear/quadratic rate. The…

Numerical Analysis · Mathematics 2016-09-28 O. P. Ferreira , G. N. Silva

We consider a class of difference-of-convex (DC) optimization problems where the objective function is the sum of a smooth function and a possible nonsmooth DC function. The application of proximal DC algorithms to address this problem…

Optimization and Control · Mathematics 2023-08-30 Shummin Nakayama , Yasushi Narushima , Hiroshi Yabe

This paper concerns the inclusion of Newton's method into an adaptive finite element method (FEM) for the solution of nonlinear partial differential equations (PDEs). It features an adaptive choice of the damping parameter in the Newton…

Numerical Analysis · Mathematics 2025-12-23 Philipp Bringmann , Maximilian Brunner , Dirk Praetorius

This paper deals with the minimization of large sum of convex functions by Inexact Newton (IN) methods employing subsampled functions, gradients and Hessian approximations. The Conjugate Gradient method is used to compute the inexact Newton…

Numerical Analysis · Mathematics 2018-11-15 Stefania Bellavia , Natasa Krejic , Natasa Krklec Jerinkic

This work investigates the application of the Newton's method for the numerical solution of a nonlinear boundary value problem formulated through an ordinary differential equation (ODE). Nonlinear ODEs arise in various mathematical modeling…

We study Newton type methods for inverse problems described by nonlinear operator equations $F(u)=g$ in Banach spaces where the Newton equations $F'(u_n;u_{n+1}-u_n) = g-F(u_n)$ are regularized variationally using a general data misfit…

Numerical Analysis · Mathematics 2015-04-01 Thorsten Hohage , Frank Werner

We study a class of monotone inclusions called "self-concordant inclusion" which covers three fundamental convex optimization formulations as special cases. We develop a new generalized Newton-type framework to solve this inclusion. Our…

Optimization and Control · Mathematics 2017-07-25 Quoc Tran-Dinh , Tianxiao Sun , Shu Lu

This paper is concerned with the numerical solution of nonlinear ill-posed operator equations involving convex constraints. We study a Newton-type method which consists in applying linear Tikhonov regularization with convex constraints to…

Functional Analysis · Mathematics 2015-04-01 Robert Stück , Martin Burger , Thorsten Hohage

Let $\left( X,\left\Vert \cdot\right\Vert_{X}\right) $ and $\left( Y,\left\Vert \cdot\right\Vert_{Y}\right) $ be Banach spaces over $\mathbb{R},$ with $X$ uniformly convex and compactly embedded into $Y.$ The inverse iteration method is…

Analysis of PDEs · Mathematics 2018-10-16 Grey Ercole

Interior-point methods for linear programming problems require the repeated solution of a linear system of equations. Solving these linear systems is non-trivial due to the severe ill-conditioning of the matrices towards convergence. This…

Optimization and Control · Mathematics 2021-05-05 Jeffrey Cornelis , Wim Vanroose

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita

We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the…

Numerical Analysis · Mathematics 2021-09-03 Jeffrey Cornelis , Wim Vanroose

We consider Tikhonov-type variational regularization of ill-posed linear operator equations in Banach spaces with general convex penalty functionals. Upper bounds for certain error measures expressing the distance between exact and…

Numerical Analysis · Mathematics 2017-12-06 Jens Flemming

The $m$-point nonlocal problem for the first order differential equation with an operator coefficient in a Banach space $X$ is considered. An exponentially convergent algorithm is proposed and justified provided that the operator…

Numerical Analysis · Mathematics 2010-01-27 Vitalii Vasylyk , Dmytro Sytnyk

In this short work we consider nonlinear equation in Banach space $x = A(x)$. We combine classical Newton method with Vietoris method to propose new more general method. Under rather general conditions about the noise we investigate local…

Functional Analysis · Mathematics 2017-10-20 Alexander Gasnikov