English
Related papers

Related papers: A Framework for Generalising the Newton Method and…

200 papers

We present a modification of Newton's method to restore quadratic convergence for isolated singular solutions of polynomial systems. Our method is symbolic-numeric: we produce a new polynomial system which has the original multiple solution…

Numerical Analysis · Mathematics 2007-05-23 Anton Leykin , Jan Verschelde , Ailing Zhao

Newton's method for polynomial root finding is one of mathematics' most well-known algorithms. The method also has its shortcomings: it is undefined at critical points, it could exhibit chaotic behavior and is only guaranteed to converge…

Numerical Analysis · Mathematics 2020-03-03 Bahman Kalantari

In the paper, a Newton-type method for the solution of generalized equations (GEs) is derived, where the linearization concerns both the single-valued and the multi-valued part of the considered GE. The method is based on the new notion of…

Optimization and Control · Mathematics 2019-04-22 H. Gfrerer , J. V. Outrata

It is often of interest to infer lower-dimensional structure underlying complex data. As a flexible class of non-linear structures, it is common to focus on Riemannian manifolds. Most existing manifold learning algorithms replace the…

Machine Learning · Statistics 2026-01-27 David B Dunson , Nan Wu

This paper concerns with iterative schemes for the perfect reconstruction of functions belonging to multiresolution spaces on bounded manifolds from nonuniform sampling. The schemes have optimal complexity in the sense that the…

Numerical Analysis · Mathematics 2007-05-23 Massimo Fornasier , Laura Gori

We consider minimization of a smooth nonconvex objective function using an iterative algorithm based on Newton's method and the linear conjugate gradient algorithm, with explicit detection and use of negative curvature directions for the…

Optimization and Control · Mathematics 2018-11-14 Clément W. Royer , Michael O'Neill , Stephen J. Wright

Projective geometry provides the preferred framework for most implementations of Euclidean space in graphics applications. Translations and rotations are both linear transformations in projective geometry, which helps when it comes to…

Computational Geometry · Computer Science 2007-05-23 Chris Doran , Anthony Lasenby , Joan Lasenby

We study the smooth structure of convex functions by generalizing a powerful concept so-called self-concordance introduced by Nesterov and Nemirovskii in the early 1990s to a broader class of convex functions, which we call generalized…

Optimization and Control · Mathematics 2018-05-09 Tianxiao Sun , Quoc Tran-Dinh

We propose an extrinsic regression framework for modeling data with manifold valued responses and Euclidean predictors. Regression with manifold responses has wide applications in shape analysis, neuroscience, medical imaging and many other…

Statistics Theory · Mathematics 2015-08-11 Lizhen Lin , Brian St. Thomas , Hongtu Zhu , David B. Dunson

In this paper, a globally convergent Newton-type proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

Optimization and Control · Mathematics 2024-10-25 Md Abu Talhamainuddin Ansary

In this paper, a generalization of a quadratic manifold approach for the reduction of geometrically nonlinear structural dynamics problems is presented. This generalization is constructed by a linearization of the static force with respect…

Computational Engineering, Finance, and Science · Computer Science 2017-12-06 J. B. Rutzmoser , D. J. Rixen , P. Tiso , S. Jain

A Newton-type active set algorithm for large-scale minimization subject to polyhedral constraints is proposed. The algorithm consists of a gradient projection step, a second-order Newton-type step in the null space of the constraint matrix,…

Optimization and Control · Mathematics 2021-01-12 William W. Hager , Davoud Ataee Tarzanagh

In this paper, we propose a new method that combines the inexact Newton method with a procedure to obtain a feasible inexact projection for solving constrained smooth and nonsmooth equations. The local convergence theorems are established…

Optimization and Control · Mathematics 2019-03-19 Fabiana R. de Oliveira , Orizon P. Ferreira

The joint approximate diagonalization of non-commuting symmetric matrices is an important process in independent component analysis. This problem can be formulated as an optimization problem on the Stiefel manifold that can be solved using…

Optimization and Control · Mathematics 2022-02-28 Hiroyuki Sato

For optimization problems on Riemannian manifolds, many types of globally convergent algorithms have been proposed, and they are often equipped with the Riemannian version of the Armijo line search for global convergence. Such existing…

Optimization and Control · Mathematics 2025-04-11 Hiroyuki Sato , Yuya Yamakawa , Kensuke Aihara

We propose a second-order method for unconditional minimization of functions $f(z)$ of complex arguments. We call it the Mixed Newton Method due to the use of the mixed Wirtinger derivative $\frac{\partial^2f}{\partial\bar z\partial z}$ for…

Optimization and Control · Mathematics 2024-12-24 Sergey Bakhurin , Roland Hildebrand , Mohammad Alkousa , Alexander Titov , Nikita Yudin

This paper is devoted to studying an augmented Lagrangian method for solving a class of manifold optimization problems, which have nonsmooth objective functions and nonlinear constraints. Under the constant positive linear dependence…

Optimization and Control · Mathematics 2022-07-20 Yuhao Zhou , Chenglong Bao , Chao Ding , Jun Zhu

This paper aims at developing two versions of the generalized Newton method to compute not merely arbitrary local minimizers of nonsmooth optimization problems but just those, which possess an important stability property known as tilt…

Optimization and Control · Mathematics 2021-01-01 Boris Mordukhovich , Ebrahim Sarabi

Manifold learning is a popular and quickly-growing subfield of machine learning based on the assumption that one's observed data lie on a low-dimensional manifold embedded in a higher-dimensional space. This thesis presents a mathematical…

Machine Learning · Computer Science 2020-11-04 Luke Melas-Kyriazi

This paper first presents a detailed implementation of Newton's method on the indefinite Stiefel manifold. To this end, an intensive analysis of the second-order geometry of the manifold is performed. Specifically, given the two types of…

Optimization and Control · Mathematics 2026-03-10 Hiroyuki Sato