English
Related papers

Related papers: Comments on finite termination of the generalized …

200 papers

We show that Newton's method converges globally at a linear rate for objective functions whose Hessians are stable. This class of problems includes many functions which are not strongly convex, such as logistic regression. Our linear…

Machine Learning · Computer Science 2018-06-04 Sai Praneeth Karimireddy , Sebastian U. Stich , Martin Jaggi

{A defining characteristic of Newton's method is local superlinear convergence within a neighbourhood of a strict local minimum. However, outside this neighborhood Newton's method can converge slowly or even diverge. A common approach to…

Optimization and Control · Mathematics 2025-09-19 Betty Shea , Mark Schmidt

The convergence of inexact Newton methods is studied for solving generalized equations on Riemannian manifolds by using the metric regularity property, which is also explored. Under appropriate conditions and without any additional…

Numerical Analysis · Mathematics 2024-09-25 Mauricio S. Louzeiro , Gilson N. Silva , Jinyun Yuan , Daoping Zhang

We deal with linear programming problems involving absolute values in their formulations, so that they are no more expressible as standard linear programs. The presence of absolute values causes the problems to be nonconvex and nonsmooth,…

Optimization and Control · Mathematics 2023-07-10 Milan Hladík , David Hartman

We present a Newton-type method that converges fast from any initialization and for arbitrary convex objectives with Lipschitz Hessians. We achieve this by merging the ideas of cubic regularization with a certain adaptive…

Optimization and Control · Mathematics 2023-03-02 Konstantin Mishchenko

The Gauss-Jordan elimination algorithm is extended to reduce a row-finite $\omega\times\omega$ matrix to lower row-reduced form, founded on a strategy of rightmost pivot elements. Such reduced matrix form preserves row equivalence, unlike…

Functional Analysis · Mathematics 2012-01-17 Alexandros G. Paraskevopoulos

In this paper we consider the Newton's method for solving the generalized equation of the form $ f(x) +F(x) \ni 0, $ where $f:{\Omega}\to Y$ is a continuously differentiable mapping, $X$ and $Y$ are Banach spaces, $\Omega\subseteq X$ an…

Numerical Analysis · Mathematics 2016-04-18 O. P. Ferreira , G. N. Silva

Newton method is one of the most powerful methods for finding solutions of nonlinear equations and for proving their existence. In its "pure" form it has fast convergence near the solution, but small convergence domain. On the other hand…

Optimization and Control · Mathematics 2019-08-27 Boris Polyak , Andrey Tremba

In this paper, we reconsider two new iterative methods for solving absolute value equations (AVE), which is proposed by Ali and Pan (Jpn. J. Ind. Appl. Math. 40: 303--314, 2023). Convergence results of the two iterative schemes and new…

Numerical Analysis · Mathematics 2024-12-17 Jiayu Liu , Tingting Luo , Cairong Chen

In this paper we prove the optimal convergence of a standard adaptive scheme based on edge finite elements for the approximation of the solutions of the eigenvalue problem associated with Maxwell's equations. The proof uses the known…

Numerical Analysis · Mathematics 2018-04-09 Daniele Boffi , Lucia Gastaldi

This work investigates the application of the Newton's method for the numerical solution of a nonlinear boundary value problem formulated through an ordinary differential equation (ODE). Nonlinear ODEs arise in various mathematical modeling…

We propose a inexact Newton method for solving inverse eigenvalue problems (IEP). This method is globalized by employing the classical backtracking techniques. A global convergence analysis of this method is provided and the R-order…

Numerical Analysis · Mathematics 2013-04-24 Yonghui Ling , Xiubin Xu

In this paper we study Newton's method for solving the generalized equation $F(x)+T(x)\ni 0$ in Hilbert spaces, where $F$ is a Fr\'echet differentiable function and $T$ is set-valued and maximal monotone. We show that this method is local…

Numerical Analysis · Mathematics 2016-08-02 Gilson N. Silva

We consider the inexact Newton methods $$ x_{n+1}^\d=x_n^\d-g_{\a_n}(F'(x_n^\d)^* F'(x_n^\d)) F'(x_n^\d)^* (F(x_n^\d)-y^\d) $$ for solving nonlinear ill-posed inverse problems $F(x)=y$ using the only available noise data $y^\d$ satisfying…

Numerical Analysis · Mathematics 2010-10-19 Qinian Jin

This paper continues our work [19] on sharp Alexandrov estimates. We obtain a sharp global uniform distance estimate from a convex function to the class of unimodular convex quadratic polynomials in terms of the total variation of its…

Analysis of PDEs · Mathematics 2026-02-09 Tianling Jin , Xushan Tu , Jingang Xiong

In the present paper, in order to fnd a singularity of a vector field defined on Riemannian manifolds, we present a new globalization strategy of Newton method and establish its global convergence with superlinear rate. In particular, this…

We show that the global minimum solution of $\lVert A - BXC \rVert$ can be found in closed-form with singular value decompositions and generalized singular value decompositions for a variety of constraints on $X$ involving rank, norm,…

Numerical Analysis · Mathematics 2022-09-30 Zihao Li , Lek-Heng Lim

We establish the existence theory of several commonly used finite element (FE) nonlinear fully discrete solutions, and the convergence theory of a linearized iteration. First, it is shown for standard FE, SUPG and edge-averaged method…

Numerical Analysis · Mathematics 2023-12-04 Yang Liu , Shi Shu , Ying Yang

The potential of neural networks (NN) in engineering is rooted in their capacity to understand intricate patterns and complex systems, leveraging their universal nonlinear approximation capabilities and high expressivity. Meanwhile,…

Computational Engineering, Finance, and Science · Computer Science 2025-01-23 Mohammed Abda , Elsa Piollet , Christopher Blake , Frédérick P. Gosselin

We analyze the convergence of the Conjugate Gradient (CG) method in exact arithmetic, when the coefficient matrix $A$ is symmetric positive semidefinite and the system is consistent. To do so, we diagonalize $A$ and decompose the algorithm…

Numerical Analysis · Mathematics 2020-05-12 Ken Hayami