English
Related papers

Related papers: The complex-step Newton method and its convergence

200 papers

This paper addresses the problem of solving nonlinear systems in the context of symmetric quantum signal processing (QSP), a powerful technique for implementing matrix functions on quantum computers. Symmetric QSP focuses on representing…

Quantum Physics · Physics 2023-07-25 Yulong Dong , Lin Lin , Hongkang Ni , Jiasu Wang

We consider minimization of a smooth nonconvex objective function using an iterative algorithm based on Newton's method and the linear conjugate gradient algorithm, with explicit detection and use of negative curvature directions for the…

Optimization and Control · Mathematics 2018-11-14 Clément W. Royer , Michael O'Neill , Stephen J. Wright

Finite elasticity problems commonly include material and geometric nonlinearities and are solved using various numerical methods. However, for highly nonlinear problems, achieving convergence is relatively difficult and requires small load…

Numerical Analysis · Mathematics 2018-05-01 Yue Mei , Daniel E. Hurtado , Sanjay Pant , Ankush Aggarwal

In recent years, interface quasi-Newton methods have gained growing attention in the fluid-structure interaction community by significantly improving partitioned solution schemes: They not only help to control the inherent added-mass…

Computational Engineering, Finance, and Science · Computer Science 2020-01-23 Thomas Spenke , Norbert Hosters , Marek Behr

In this paper, we propose objective-function-free (OFF) variants of the proximal Newton method for nonconvex composite optimization problems and the regularized Newton method for unconstrained optimization problems, respectively, using…

Optimization and Control · Mathematics 2026-05-19 Hong Zhu

We investigate the use of piecewise linear systems, whose coefficient matrix is a piecewise constant function of the solution itself. Such systems arise, for example, from the numerical solution of linear complementarity problems and in the…

Numerical Analysis · Mathematics 2012-06-21 Luigi Brugnano , Alessandra Sestini

The multiplicative Newton-like method developed by the author et al. is extended to the situation where the dynamics is restricted to the orthogonal group. A general framework is constructed without specifying the cost function. Though the…

Machine Learning · Computer Science 2007-05-23 Toshinao Akuzawa

The quasi-Newton equation is the very basis of a variety of the quasi-Newton methods. By using a relationship formula between nonlinear polynomial equations and the corresponding Jacobian matrix. presented recently by the present author, we…

Numerical Analysis · Mathematics 2025-10-20 W. Chen

We consider minimization of indefinite quadratics with either trust-region (norm) constraints or cubic regularization. Despite the nonconvexity of these problems we prove that, under mild assumptions, gradient descent converges to their…

Optimization and Control · Mathematics 2020-08-17 Yair Carmon , John C. Duchi

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

We present a novel Newton-type method for distributed optimization, which is particularly well suited for stochastic optimization and learning problems. For quadratic objectives, the method enjoys a linear rate of convergence which provably…

Machine Learning · Computer Science 2014-05-15 Ohad Shamir , Nathan Srebro , Tong Zhang

We consider a family of steady free-surface flow problems in two dimensions, concentrating on the effect of nonlinearity on the train of gravity waves that appear downstream of a disturbance. By exploiting standard complex variable…

Fluid Dynamics · Physics 2018-03-14 Ravindra Pethiyagoda , Timothy J. Moroney , Scott W. McCue

We present a modification of Newton's method to restore quadratic convergence for isolated singular solutions of polynomial systems. Our method is symbolic-numeric: we produce a new polynomial system which has the original multiple solution…

Numerical Analysis · Mathematics 2007-05-23 Anton Leykin , Jan Verschelde , Ailing Zhao

The following document presents some novel numerical methods valid for one and several variables, which using the fractional derivative, allow to find solutions for some non-linear systems in the complex space using real initial conditions.…

Numerical Analysis · Mathematics 2024-04-25 A. Torres-Hernandez , F. Brambila-Paz

A zero-finding technique for solving nonlinear equations more efficiently than they usually are with traditional iterative methods in which the order of convergence is improved is presented. The key idea in deriving this procedure is to…

Numerical Analysis · Mathematics 2011-06-07 Miquel Grau-Sánchez , José Luis Díaz-Barrero

This paper investigates the global convergence of stepsized Newton methods for convex functions with H\"older continuous Hessians or third derivatives. We propose several simple stepsize schedules with fast global convergence guarantees, up…

Optimization and Control · Mathematics 2024-11-21 Slavomír Hanzely , Farshed Abdukhakimov , Martin Takáč

In this paper, we consider an unconstrained optimization model where the objective is a sum of a large number of possibly nonconvex functions, though overall the objective is assumed to be smooth and convex. Our bid to solving such model…

Optimization and Control · Mathematics 2022-03-15 Xi Chen , Bo Jiang , Tianyi Lin , Shuzhong Zhang

Gradient-based algorithms are one of the methods of choice for the optimisation of Markov Decision Processes. In this article we will present a novel approximate Newton algorithm for the optimisation of such models. The algorithm has…

Optimization and Control · Mathematics 2015-08-05 Thomas Furmston , David Barber

In this paper, we propose a quasi Newton method to solve the robust counterpart of an uncertain multiobjective optimization problem under an arbitrary finite uncertainty set. Here the robust counterpart of an uncertain multiobjective…

Optimization and Control · Mathematics 2023-10-12 Shubham kumar , Nihar Kumar Mahato , Md Abu T Ansary , Debdas Ghosh

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner