English
Related papers

Related papers: A semi-smooth Newton method for general projection…

200 papers

This paper presents a fast first-order method for solving the quasi-static contact problem with the Coulomb friction. It is known that this problem can be formulated as a second-order cone linear complementarity problem, for which…

Optimization and Control · Mathematics 2022-12-21 Yoshihiro Kanno

Variable projection methods prove highly efficient in solving separable nonlinear least squares problems by transforming them into a reduced nonlinear least squares problem, typically solvable via the Gauss-Newton method. When solving…

Numerical Analysis · Mathematics 2024-02-14 Malena I. Español , Gabriela Jeronimo

Sketch-and-project is a framework which unifies many known iterative methods for solving linear systems and their variants, as well as further extensions to non-linear optimization problems. It includes popular methods such as randomized…

Optimization and Control · Mathematics 2023-09-20 Michał Dereziński , Elizaveta Rebrova

We present two new remarkably simple stochastic second-order methods for minimizing the average of a very large number of sufficiently smooth and strongly convex functions. The first is a stochastic variant of Newton's method (SN), and the…

Machine Learning · Computer Science 2019-12-04 Dmitry Kovalev , Konstantin Mishchenko , Peter Richtárik

We develop a semismooth Newton framework for the numerical solution of fixed-point equations that are posed in Banach spaces. The framework is motivated by applications in the field of obstacle-type quasi-variational inequalities and…

Numerical Analysis · Mathematics 2024-10-01 Amal Alphonse , Constantin Christof , Michael Hintermüller , Ioannis P. A. Papadopoulos

We are concerned with a class of nonconvex and nonsmooth composite optimization problems, comprising a twice differentiable function and a prox-regular function. We establish a sufficient condition for the proximal mapping of a prox-regular…

Optimization and Control · Mathematics 2025-09-09 Yuqia Wu , Pengcheng Wu , Yaohua Hu , Shaohua Pan , Xiaoqi Yang

We consider the closest-point projection with respect to the Frobenius norm of a general real square matrix to the set SL($n$) of matrices with unit determinant. As it turns out, it is sufficient to consider diagonal matrices only. We…

Optimization and Control · Mathematics 2025-02-03 Patrick Jaap , Oliver Sander

In this paper, we introduce a stochastic projected subgradient method for weakly convex (i.e., uniformly prox-regular) nonsmooth, nonconvex functions---a wide class of functions which includes the additive and convex composite classes. At a…

Optimization and Control · Mathematics 2018-09-19 Damek Davis , Benjamin Grimmer

In recent years, the proximal gradient method and its variants have been generalized to Riemannian manifolds for solving optimization problems with an additively separable structure, i.e., $f + h$, where $f$ is continuously differentiable,…

Optimization and Control · Mathematics 2024-04-04 Wutao Si , P. -A. Absil , Wen Huang , Rujun Jiang , Simon Vary

Newton's method is a fundamental technique in optimization with quadratic convergence within a neighborhood around the optimum. However reaching this neighborhood is often slow and dominates the computational costs. We exploit two…

Machine Learning · Computer Science 2016-05-24 Hadi Daneshmand , Aurelien Lucchi , Thomas Hofmann

In this work we present and discuss a possible globalization concept for Newton-type methods. We consider nonlinear problems $f(x)=0$ in $\mathbb{R}^{n}$ using the concepts from ordinary differential equations as a basis for the proposed…

Numerical Analysis · Mathematics 2018-10-24 Mario Amrein

We propose a DC proximal Newton algorithm for solving nonconvex regularized sparse learning problems in high dimensions. Our proposed algorithm integrates the proximal Newton algorithm with multi-stage convex relaxation based on the…

Machine Learning · Statistics 2018-02-16 Xingguo Li , Lin F. Yang , Jason Ge , Jarvis Haupt , Tong Zhang , Tuo Zhao

In the paper, a variant of the \ssstar Newton method is developed for the numerical solution of generalized equations, in which the multi-valued part is a so-called SCD (subspace containing derivative) mapping. Under a rather mild…

Numerical Analysis · Mathematics 2022-10-13 H. Gfrerer , M. Mandlmayr , J. V. Outrata , J. Valdman

Newton's Method is widely used to find the solution of complex non-linear simulation problems in Computer Graphics. To guarantee a descent direction, it is common practice to clamp the negative eigenvalues of each element Hessian prior to…

Graphics · Computer Science 2026-05-26 José Antonio Fernández-Fernández , Fabian Löschner , Jan Bender

In this paper, the problem of computing the projection, and therefore the minimum distance, from a point onto a Minkowski sum of general convex sets is studied. Our approach is based on the minimum norm duality theorem originally stated by…

Optimization and Control · Mathematics 2018-01-26 Xiaolong Qin , Nguyen Thai An

We show that a second order sufficient condition for local optimality, along with a strict complementarity condition, is enough to get the superlinear convergence of the semismooth Newton method for an optimal control problem governed by a…

Optimization and Control · Mathematics 2025-06-25 Casas Eduardo , Mateos Mariano

In this paper, we propose the first sketch-and-project Newton method with fast $\mathcal O(k^{-2})$ global convergence rate for self-concordant functions. Our method, SGN, can be viewed in three ways: i) as a sketch-and-project algorithm…

Optimization and Control · Mathematics 2024-05-28 Slavomír Hanzely

The paper starts with a concise description of the recently developed semismooth* Newton method for the solution of general inclusions. This method is then applied to a class of variational inequalities of the second kind. As a result, one…

Optimization and Control · Mathematics 2020-07-23 Helmut Gfrerer , Jiri V. Outrata , Jan Valdman

This paper is devoted to the general problem of projection onto a polyhedral convex cone generated by a finite set of generators.This problem is reformulated into projection onto the polytope obtained by simple truncation of the original…

Optimization and Control · Mathematics 2020-10-26 Evgeni Nurminski

In this paper, we investigate global convergence properties of the inexact nonsmooth Newton method for solving the system of absolute value equations (AVE). Global $Q$-linear convergence is established under suitable assumptions. Moreover,…

Optimization and Control · Mathematics 2015-11-13 J. Y. Bello Cruz , O. P. Ferreira , L. F. Prudente
‹ Prev 1 3 4 5 6 7 10 Next ›