English
Related papers

Related papers: A Residual Smoothing Strategy for Accelerating New…

200 papers

In this paper, we propose a new method that combines the inexact Newton method with a procedure to obtain a feasible inexact projection for solving constrained smooth and nonsmooth equations. The local convergence theorems are established…

Optimization and Control · Mathematics 2019-03-19 Fabiana R. de Oliveira , Orizon P. Ferreira

Newton method is one of the most powerful methods for finding solutions of nonlinear equations and for proving their existence. In its "pure" form it has fast convergence near the solution, but small convergence domain. On the other hand…

Optimization and Control · Mathematics 2019-08-27 Boris Polyak , Andrey Tremba

We consider the phase retrieval problem, which involves recovering a rank-one positive semidefinite matrix from rank-one measurements. A recently proposed algorithm based on Bures-Wasserstein gradient descent (BWGD) exhibits superlinear…

Machine Learning · Statistics 2025-08-01 Tyler Maunu , Gabriel Abreu

In this paper, we consider a large class of nonlinear equations derived from first-order type methods for solving composite optimization problems. Traditional approaches to establishing superlinear convergence rates of semismooth…

Optimization and Control · Mathematics 2023-07-31 Jiang Hu , Tonghua Tian , Shaohua Pan , Zaiwen Wen

This work investigates a dynamical system functioning as a nonsmooth adaptation of the continuous Newton method, aimed at minimizing the sum of a primal lower-regular and a locally Lipschitz function, both potentially nonsmooth. The…

Optimization and Control · Mathematics 2024-12-10 Juan Guillermo Garrido , Pedro Pérez-Aros , Emilio Vilches

This paper considers the generalized continuation Newton method and thetrust-region updating strategy for the underdetermined system of nonlinear equations. Moreover, in order to improve its computational efficiency, the new method will not…

Numerical Analysis · Mathematics 2021-05-26 Xin-long Luo , Hang Xiao

In this paper a special piecewise linear system is studied. It is shown that, under a mild assumption, the semi-smooth Newton method applied to this system is well defined and the method generates a sequence that converges linearly to a…

Optimization and Control · Mathematics 2015-11-13 J. G. Barrios , J. Y. Bello Cruz , O. P. Ferreira , S. Z. Németh

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and…

Optimization and Control · Mathematics 2018-03-12 Andre Milzarek , Xiantao Xiao , Shicong Cen , Zaiwen Wen , Michael Ulbrich

In this paper a special semi-smooth equation associated to the second order cone is studied. It is shown that, under mild assumptions, the semi-smooth Newton method applied to this equation is well-defined and the generated sequence is…

Optimization and Control · Mathematics 2016-10-17 Jose Yunier Bello Cruz , O. P. Ferreira , S. Z. Nemeth , L. F. Prudente

Newton-type solvers have been extensively employed for solving a variety of nonlinear system of algebraic equations. However, for some complex nonlinear system of algebraic equations, efficiently solving these systems remains a challenging…

Numerical Analysis · Mathematics 2025-01-08 Renjie Ding , Dongling Wang

The goal of this paper is to study approaches to bridge the gap between first-order and second-order type methods for composite convex programs. Our key observations are: i) Many well-known operator splitting methods, such as…

Optimization and Control · Mathematics 2016-09-27 Xiantao Xiao , Yongfeng Li , Zaiwen Wen , Liwei Zhang

Newton-type methods enjoy fast local convergence and strong empirical performance, but achieving global guarantees comparable to first-order methods remains challenging. Even for simple strongly convex problems, no straightforward variant…

Numerical Analysis · Mathematics 2025-10-20 Alexander Lim , Fred Roosta

A method is developed for solving quasilinear convection diffusion problems starting on a coarse mesh where the data and solution-dependent coefficients are unresolved, the problem is unstable and approximation properties do not hold. The…

Numerical Analysis · Mathematics 2015-02-10 Sara Pollock

In this work we develop and analyze a semi-smooth Newton method for the general nonlinear conic programming problem. In particular, we study the problem with a generalized simplicial cone, i.e., the image of a symmetric cone under a linear…

Optimization and Control · Mathematics 2026-04-22 Nicolas F. Armijo , Yunier Bello Cruz , Gabriel Haeser

Quasi-Newton methods are widely used for solving convex optimization problems due to their ease of implementation, practical efficiency, and strong local convergence guarantees. However, their global convergence is typically established…

Optimization and Control · Mathematics 2025-08-28 Artem Agafonov , Vladislav Ryspayev , Samuel Horváth , Alexander Gasnikov , Martin Takáč , Slavomir Hanzely

Proximal methods are known to identify the underlying substructure of nonsmooth optimization problems. Even more, in many interesting situations, the output of a proximity operator comes with its structure at no additional cost, and…

Optimization and Control · Mathematics 2023-02-10 Gilles Bareilles , Franck Iutzeler , Jérôme Malick

We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated second-order information on these functions. Under the…

Optimization and Control · Mathematics 2025-11-25 Tran T. A. Nghia , Nghia V. Vo , Khoa V. H. Vu

We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone…

Optimization and Control · Mathematics 2026-02-12 Ching-pei Lee , Stephen J. Wright

In this work, we propose a nonlinear stabilization technique for scalar conservation laws with implicit time stepping. The method relies on an artificial diffusion method, based on a graph-Laplacian operator. It is nonlinear, since it…

Numerical Analysis · Computer Science 2016-12-23 Santiago Badia , Jesús Bonilla

In this paper, by combining the algorithm New Q-Newton's method - developed in previous joint work of the author - with Armijo's Backtracking line search, we resolve convergence issues encountered by Newton's method (e.g. convergence to a…

Optimization and Control · Mathematics 2022-09-13 Tuyen Trung Truong