English
Related papers

Related papers: Generalized Newton's Method based on Graphical Der…

200 papers

Considered herein is a modified Newton method for the numerical solution of nonlinear equations where the Jacobian is approximated using a complex-step derivative approximation. We show that this method converges for sufficiently small…

Numerical Analysis · Mathematics 2024-10-03 Dimitrios Mitsotakis

Finding roots of equations is at the heart of most computational science. A well-known and widely used iterative algorithm is the Newton's method. However, its convergence depends heavily on the initial guess, with poor choices often…

Numerical Analysis · Mathematics 2020-04-09 Ankush Aggarwal , Sanjay Pant

In this paper, we consider the problem of solving a constrained system of nonlinear equations. We propose an algorithm based on a combination of the Newton and conditional gradient methods, and establish its local convergence analysis. Our…

Optimization and Control · Mathematics 2016-08-25 Max L. N. Goncalves , Jefferson G. Melo

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

A new decomposition optimization algorithm, called \textit{path-following gradient-based decomposition}, is proposed to solve separable convex optimization problems. Unlike path-following Newton methods considered in the literature, this…

Optimization and Control · Mathematics 2012-09-21 Quoc Tran Dinh , Ion Necoara , Moritz Diehl

The paper deals with a comprehensive theory of mappings, whose local behavior can be described by means of linear subspaces, contained in the graphs of two (primal and dual) generalized derivatives. This class of mappings includes the…

Optimization and Control · Mathematics 2021-12-08 Helmut Gfrerer , Jiri V. Outrata

In this paper we consider a version of the Kantorovich's theorem for solving the generalized equation $F(x)+T(x)\ni 0$, where $F$ is a Fr\'echet derivative function and $T$ is a set-valued and maximal monotone acting between Hilbert spaces.…

Numerical Analysis · Mathematics 2016-05-19 Gilson N. Silva

This paper addresses the study of derivative-free smooth optimization problems, where the gradient information on the objective function is unavailable. Two novel general derivative-free methods are proposed and developed for minimizing…

Optimization and Control · Mathematics 2023-11-29 Pham Duy Khanh , Boris S. Mordukhovich , Dat Ba Tran

The aim of this paper is to introduce a new Newton-type iterative method and then to show that this process converges to the unique solution of the scalar nonlinear equation f(x)=0 under weaker conditions involving only f and f' by fixed…

General Mathematics · Mathematics 2017-06-27 Nazli Karaca , Isa Yildirim

This paper focuses on discussing Newton's method and its hybrid with machine learning for the steady state Navier-Stokes Darcy model discretized by mixed element methods. First, a Newton iterative method is introduced for solving the…

Numerical Analysis · Mathematics 2024-03-07 Jianguo Huang , Hui Peng , Haohao Wu

In this paper, we present a generic framework to extend existing uniformly optimal convex programming algorithms to solve more general nonlinear, possibly nonconvex, optimization problems. The basic idea is to incorporate a local search…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

We consider a class of difference-of-convex (DC) optimization problems where the objective function is the sum of a smooth function and a possible nonsmooth DC function. The application of proximal DC algorithms to address this problem…

Optimization and Control · Mathematics 2023-08-30 Shummin Nakayama , Yasushi Narushima , Hiroshi Yabe

This work investigates the application of the Newton's method for the numerical solution of a nonlinear boundary value problem formulated through an ordinary differential equation (ODE). Nonlinear ODEs arise in various mathematical modeling…

In this paper, we consider the efficient numerical minimization of Tikhonov functionals resulting from total-variation (TV) regularization of linear inverse problems. Since the TV penalty is non-smooth, this is typically done either via…

Numerical Analysis · Mathematics 2026-05-13 Helmut Gfrerer , Simon Hubmer , Stefan Kindermann , Jaakko Kultima , Ronny Ramlau , Tanja Tarvainen

In this study, we propose a graph neural network (GNN) model for efficiently predicting the flow behavior of non-Newtonian fluids with free surface dynamics. The numerical analysis of non-Newtonian fluids presents significant challenges, as…

Fluid Dynamics · Physics 2025-09-30 Hyo-Jin Kim , Jaekwang Kim , Hyung-Jun Park

This book is devoted to finite-dimensional problems of non-convex non-smooth optimization and numerical methods for their solution. The problem of nonconvexity is studied in the book on two main models of nonconvex dependencies: these are…

Optimization and Control · Mathematics 2024-06-18 V. S. Mikhalevich , A. M. Gupal , V. I. Norkin

In this manuscript, we propose a general proximal quasi-Newton method tailored for nonconvex and nonsmooth optimization problems, where we do not require the sequence of the variable metric (or Hessian approximation) to be uniformly bounded…

Optimization and Control · Mathematics 2025-07-28 Xiaoxi Jia

In this paper, we propose an inexact Newton-like conditional gradient method for solving constrained systems of nonlinear equations. The local convergence of the new method as well as results on its rate are established by using a general…

Optimization and Control · Mathematics 2017-05-23 M. L. N. Goncalves , F. R. Oliveira

In the present paper, in order to fnd a singularity of a vector field defined on Riemannian manifolds, we present a new globalization strategy of Newton method and establish its global convergence with superlinear rate. In particular, this…

We analyze the performance of a variant of Newton method with quadratic regularization for solving composite convex minimization problems. At each step of our method, we choose regularization parameter proportional to a certain power of the…

Optimization and Control · Mathematics 2022-08-12 Nikita Doikov , Konstantin Mishchenko , Yurii Nesterov