English
Related papers

Related papers: A Framework for Generalising the Newton Method and…

200 papers

Interior-point methods offer a highly versatile framework for convex optimization that is effective in theory and practice. A key notion in their theory is that of a self-concordant barrier. We give a suitable generalization of…

Optimization and Control · Mathematics 2024-06-26 Hiroshi Hirai , Harold Nieuwboer , Michael Walter

The work done by Isaac Newton more than three hundred years ago, continues being a path to increase our knowledge of Nature. To better understand all the ideas behind it, one of the finest ways is to generalize them to wider situations. In…

Differential Geometry · Mathematics 2023-01-10 Miguel-C. Muñoz-Lecanda

Functional iterations such as Newton's are a popular tool for polynomial root-finding. We consider realistic situation where some (e.g., better-conditioned) roots have already been approximated and where further computations is directed to…

Numerical Analysis · Mathematics 2019-07-09 Remi Imbach , Victor Y. Pan , Chee Yap , Ilias S. Kotsireas , Vitaly Zaderman

Machine learning models (mainly neural networks) are used more and more in real life. Users feed their data to the model for training. But these processes are often one-way. Once trained, the model remembers the data. Even when data is…

Machine Learning · Computer Science 2022-10-03 Zihao Cao , Jianzong Wang , Shijing Si , Zhangcheng Huang , Jing Xiao

A damped Newton's method to find a singularity of a vector field in Riemannian setting is presented with global convergence study. It is ensured that the sequence generated by the proposed method reduces to a sequence generated by the…

Optimization and Control · Mathematics 2018-07-20 M. A. A. Bortoloti , T. A. Fernandes , O. P. Ferreira , Jinyun Yuan

We study a Newton-like method for the minimization of an objective function that is the sum of a smooth convex function and an l-1 regularization term. This method, which is sometimes referred to in the literature as a proximal Newton…

Optimization and Control · Mathematics 2013-09-16 Richard H. Byrd , Jorge Nocedal , Figen Oztoprak

In many applications of tomography, the acquired projections are either limited in number or contain a significant amount of noise. In these cases, standard reconstruction methods tend to produce artifacts that can make further analysis…

Numerical Analysis · Mathematics 2016-04-11 D. M. Pelt , K. J. Batenburg

The object of the present paper is to extend the third-order iterative method for solving nonlinear equations into systems of nonlinear equations. Since our motive is to develop the method which improve the order of convergence of Newton's…

Numerical Analysis · Mathematics 2013-09-24 Anuradha Singh , J. P. Jaiswa

We present a new numerical method for the isometric embedding of 2-geometries specified by their 2-metrics in three dimensional Euclidean space. Our approach is to directly solve the fundamental embedding equation supplemented by six…

General Relativity and Quantum Cosmology · Physics 2015-06-23 Wolfgang Tichy , Jonathan R. McDonald , Warner A. Miller

In this paper, we propose and analyze some practical Newton methods for electronic structure calculations. We show the convergence and the local quadratic convergence rate for the Newton method when the Newton search directions are…

Optimization and Control · Mathematics 2020-01-28 Xiaoying Dai , Liwei Zhang , Aihui Zhou

We present generalizations of Newton's method that incorporate derivatives of an arbitrary order $d$ but maintain a polynomial dependence on dimension in their cost per iteration. At each step, our $d^{\text{th}}$-order method uses…

Optimization and Control · Mathematics 2024-06-13 Amir Ali Ahmadi , Abraar Chaudhry , Jeffrey Zhang

The Newton method is a powerful optimization algorithm, valued for its rapid local convergence and elegant geometric properties. However, its theoretical guarantees are usually limited to convex problems. In this work, we ask whether…

Optimization and Control · Mathematics 2025-10-01 Alexander Shestakov , Sushil Bohara , Samuel Horváth , Martin Takáč , Slavomír Hanzely

We introduce a unified framework for iterative reasoning that leverages non-Euclidean geometry via Bregman divergences, higher-order operator averaging, and adaptive feedback mechanisms. Our analysis establishes that, under mild smoothness…

Machine Learning · Computer Science 2025-02-07 Jacob Fein-Ashley

The focus in this work is on interior-point methods for inequality-constrained quadratic programs, and particularly on the system of nonlinear equations to be solved for each value of the barrier parameter. Newton iterations give high…

Optimization and Control · Mathematics 2024-01-24 David Ek , Anders Forsgren

This article introduces a new data-driven approach that leverages a manifold embedding generated by the invertible neural network to improve the robustness, efficiency, and accuracy of the constitutive-law-free simulations with limited…

Machine Learning · Computer Science 2022-05-19 Bahador Bahmani , WaiChing Sun

This study proposes a cubic regularization of the Newton method for generating weakly efficient points of unconstrained vector optimization problems under no convexity assumption on the objective function. It is observed that at a given…

Optimization and Control · Mathematics 2025-05-20 Debdas Ghosh

A technique for accelerating global convergence of pseudo-transient continuation Newton methods is proposed based on residual smoothing. The technique is motivated by the effectiveness of local nonlinear smoothers at overcoming strong…

Numerical Analysis · Mathematics 2018-05-11 Dimitri Mavriplis

The multiplicative Newton-like method developed by the author et al. is extended to the situation where the dynamics is restricted to the orthogonal group. A general framework is constructed without specifying the cost function. Though the…

Machine Learning · Computer Science 2007-05-23 Toshinao Akuzawa

This paper is concerned with the inverse problem of scattering of time-harmonic acoustic waves from a penetrable and buried obstacles. By introducing a related transmission scattering problem, a Newton iteration method is proposed to…

Numerical Analysis · Mathematics 2015-06-12 Haiwen Zhang , Bo Zhang

An inexact Newton type method for numerical minimization of convex piecewise quadratic functions is considered and its convergence is analyzed. Earlier, a similar method was successfully applied to optimizaton problems arising in numerical…

Optimization and Control · Mathematics 2019-01-11 Alexander I. Golikov , Igor E. Kaporin