English
Related papers

Related papers: Generalized Newton's Method based on Graphical Der…

200 papers

This paper addresses the study of a new class of nonsmooth optimization problems, where the objective is represented as a difference of two generally nonconvex functions. We propose and develop a novel Newton-type algorithm to solving such…

Optimization and Control · Mathematics 2023-01-10 Francisco J. Aragón-Artacho , Boris S. Mordukhovich , Pedro Pérez-Aros

We develop a semismooth Newton framework for the numerical solution of fixed-point equations that are posed in Banach spaces. The framework is motivated by applications in the field of obstacle-type quasi-variational inequalities and…

Numerical Analysis · Mathematics 2024-10-01 Amal Alphonse , Constantin Christof , Michael Hintermüller , Ioannis P. A. Papadopoulos

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and…

Optimization and Control · Mathematics 2018-03-12 Andre Milzarek , Xiantao Xiao , Shicong Cen , Zaiwen Wen , Michael Ulbrich

This paper proposes and develops a new Newton-type algorithm to solve subdifferential inclusions defined by subgradients of extended-real-valued prox-regular functions. The proposed algorithm is formulated in terms of the second-order…

Optimization and Control · Mathematics 2022-09-16 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat

This paper is concerned with an algorithm for finding a singularity of the nonsmooth vector fields. Firstly, we discuss the main results of the Newton method presented in [1] for solving the aforementioned problem. Combining this method…

Optimization and Control · Mathematics 2020-06-03 Fabiana R. de Oliveira , Fabrícia R. Oliveira

We consider the efficient numerical minimization of Tikhonov functionals with nonlinear operators and non-smooth and non-convex penalty terms, which appear for example in variational regularization. For this, we consider a new class of SCD…

Numerical Analysis · Mathematics 2024-10-18 Helmut Gfrerer , Simon Hubmer , Ronny Ramlau

In the paper, a variant of the \ssstar Newton method is developed for the numerical solution of generalized equations, in which the multi-valued part is a so-called SCD (subspace containing derivative) mapping. Under a rather mild…

Numerical Analysis · Mathematics 2022-10-13 H. Gfrerer , M. Mandlmayr , J. V. Outrata , J. Valdman

We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods…

Machine Learning · Statistics 2014-03-19 Jason D. Lee , Yuekai Sun , Michael A. Saunders

The extended modification of the Newton method is considered when the inverse of the derivative (of the operator F(x) in the equation F(x)=0) is replaced by an invertible bounded x-independent operator B. The continuity assumption is…

Numerical Analysis · Mathematics 2015-03-24 Andrei Dubin

We introduce a new framework for analyzing (Quasi-}Newton type methods applied to non-smooth optimization problems. The source of randomness comes from the evaluation of the (approximation) of the Hessian. We derive, using a variant of…

Optimization and Control · Mathematics 2025-03-05 Titus Pinta

In this paper, we propose a globally convergent method for solving constrained nonlinear systems. The method combines an efficient Newton conditional gradient method with a derivative-free and nonmonotone linesearch strategy. The global…

Optimization and Control · Mathematics 2018-06-06 M. L. N. Gonçalves , F. R. Oliveira

The article deals with the generalized Newton--Kantorovich method for solving operator equations with nondifferentiable operators in Banach spaces. The convergence theorem is proved by means of majorant scalar equations.

Numerical Analysis · Mathematics 2012-01-12 A. N. Tanyhina

A general class of Newton algorithms on Gra{\ss}mann and Lagrange-Gra{\ss}mann manifolds is introduced, that depends on an arbitrary pair of local coordinates. Local quadratic convergence of the algorithm is shown under a suitable condition…

Optimization and Control · Mathematics 2011-11-10 Uwe Helmke , Knut Hüper , Jochen Trumpf

We are concerned with a class of nonconvex and nonsmooth composite optimization problems, comprising a twice differentiable function and a prox-regular function. We establish a sufficient condition for the proximal mapping of a prox-regular…

Optimization and Control · Mathematics 2025-09-09 Yuqia Wu , Pengcheng Wu , Yaohua Hu , Shaohua Pan , Xiaoqi Yang

Total generalization variation (TGV) is a very powerful and important regularization for various inverse problems and computer vision tasks. In this paper, we proposed a semismooth Newton based augmented Lagrangian method to solve this…

Optimization and Control · Mathematics 2022-01-28 Hongpeng Sun

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

Optimization and Control · Mathematics 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

We propose a novel linesearch variant of the trust region normal map-based semismooth Newton method developed in [Ouyang and Milzarek, Math. Program. 212(1-2), 389--435 (2025)] for solving a class of nonsmooth, nonconvex composite-type…

Optimization and Control · Mathematics 2026-02-16 Hanfeng Zeng , Wenqing Ouyang , Andre Milzarek

Newton method is one of the most powerful methods for finding solutions of nonlinear equations and for proving their existence. In its "pure" form it has fast convergence near the solution, but small convergence domain. On the other hand…

Optimization and Control · Mathematics 2019-08-27 Boris Polyak , Andrey Tremba

In this paper we develop an adaptive procedure for the numerical solution of general, semilinear elliptic problems with possible singular perturbations. Our approach combines both a prediction-type adaptive Newton method and an adaptive…

Numerical Analysis · Mathematics 2014-08-27 Mario Amrein , Thomas P. Wihler

For the numerical solution of nonsmooth problems, sometimes it is not necessary that an exact subgradient/generalized Jacobian is at our disposal, but it suffices that a semismooth derivative, i.e., a mapping satisfying a certain…

Optimization and Control · Mathematics 2026-03-12 H. Gfrerer , J. V. Outrata