English
Related papers

Related papers: Conservative and semismooth derivatives are equiva…

200 papers

This article proposes new perspectives for developing derivative based numerical algorithms, supported by the introduction of a generalized derivative operators. It demonstrates that these operators have the potential to enhance and extend…

General Mathematics · Mathematics 2026-01-13 Flavio Barbosa , Fernando Nogueira

We describe for any Riemannian manifold a certain infinitesimal neighbourhood of the diagonal. Semi-conformal maps are analyzed as those that preserve such neighbourhoods; harmonic maps are analyzed as those that preserve mirror image…

Differential Geometry · Mathematics 2007-05-23 Anders Kock

In this paper, we consider a large class of nonlinear equations derived from first-order type methods for solving composite optimization problems. Traditional approaches to establishing superlinear convergence rates of semismooth…

Optimization and Control · Mathematics 2023-07-31 Jiang Hu , Tonghua Tian , Shaohua Pan , Zaiwen Wen

In this paper we present GSSN, a globalized SCD semismooth* Newton method for solving nonsmooth nonconvex optimization problems. The global convergence properties of the method are ensured by the proximal gradient method, whereas locally…

Optimization and Control · Mathematics 2025-01-27 H. Gfrerer

Proximal methods are known to identify the underlying substructure of nonsmooth optimization problems. Even more, in many interesting situations, the output of a proximity operator comes with its structure at no additional cost, and…

Optimization and Control · Mathematics 2023-02-10 Gilles Bareilles , Franck Iutzeler , Jérôme Malick

We demonstrate that the concept of strict proto-differentiability of subgradient mappings can play a similar role as smoothness of the gradient mapping of a function in the study of subgradient mappings of prox-regular functions. We then…

Optimization and Control · Mathematics 2024-10-30 Nguyen T. V. Hang , Ebrahim Sarabi

We show that the subgradient method converges only to local minimizers when applied to generic Lipschitz continuous and subdifferentially regular functions that are definable in an o-minimal structure. At a high level, the argument we…

Optimization and Control · Mathematics 2023-01-10 Damek Davis , Dmitriy Drusvyatskiy , Liwei Jiang

In this paper, we devise a $\operatorname{prox}$-based semi-smooth Newton method for the non-differentiable TV-minimization problem. To this end, the primal-dual optimality conditions are reformulated as a nonlinear operator equation with…

Numerical Analysis · Mathematics 2026-05-22 Sören Bartels , Alex Kaltenbach

This paper aims to develop a Newton-type method to solve a class of nonconvex composite programs. In particular, the nonsmooth part is possibly nonconvex. To tackle the nonconvexity, we develop a notion of strong prox-regularity which is…

Optimization and Control · Mathematics 2023-03-10 Jiang Hu , Kangkang Deng , Jiayuan Wu , Quanzheng Li

We analyze the constant step size subgradient method on nonsmooth, nonconvex functions. We identify geometric assumptions on the objective function under which i) its domain admits a partition (stratification) into smooth manifolds (strata)…

Optimization and Control · Mathematics 2026-04-21 Evgenii Chzhen , Sholom Schechtman

Given a convex optimization problem and its dual, there are many possible first-order algorithms. In this paper, we show the equivalence between mirror descent algorithms and algorithms generalizing the conditional gradient method. This is…

Machine Learning · Computer Science 2013-10-21 Francis Bach

We prove the genericity of the shadowing and periodic shadowing properties for both conservative and dissipative homeomorphisms on a compact connected manifold. Our proof is valid for topological manifolds and still holds in the dissipative…

Dynamical Systems · Mathematics 2016-10-03 Pierre-Antoine Guihéneuf , Thibault Lefeuvre

We prove that the subdifferential of any semi-algebraic extended-real-valued function on $\R^n$ has $n$-dimensional graph. We discuss consequences for generic semi-algebraic optimization problems.

Optimization and Control · Mathematics 2015-03-14 Dmitriy Drusvyatskiy , Adrian S. Lewis

This paper proposes and develops a new Newton-type algorithm to solve subdifferential inclusions defined by subgradients of extended-real-valued prox-regular functions. The proposed algorithm is formulated in terms of the second-order…

Optimization and Control · Mathematics 2022-09-16 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat

We prove some Liouville type results for generalized holomorphic maps in three classes: maps from pseudo-Hermitian manifolds to almost Hermitian manifolds, maps from almost Hermitian manifolds to pseudo-Hermitian manifolds and maps from…

Differential Geometry · Mathematics 2021-10-08 Haojie Chen , Yibin Ren

Difference-of-convex (DC) optimization problems are shown to be equivalent to the minimization of a Lipschitz-differentiable "envelope". A gradient method on this surrogate function yields a novel (sub)gradient-free proximal algorithm which…

Optimization and Control · Mathematics 2024-04-17 Andreas Themelis , Ben Hermans , Panagiotis Patrinos

Gradient-based algorithms are one of the methods of choice for the optimisation of Markov Decision Processes. In this article we will present a novel approximate Newton algorithm for the optimisation of such models. The algorithm has…

Optimization and Control · Mathematics 2015-08-05 Thomas Furmston , David Barber

The mathematics of K-conserving functional differentiation, with K being the integral of some invertible function of the functional variable, is clarified. The most general form for constrained functional derivatives is derived from the…

Mathematical Physics · Physics 2007-09-13 Tamas Gal

We prove that each semialgebraic subset of $\R^n$ of positive codimension can be locally approximated of any order by means of an algebraic set of the same dimension. As a consequence of previous results, algebraic approximation preserving…

Algebraic Geometry · Mathematics 2014-09-24 Massimo Ferrarotti , Elisabetta Fortuna , Leslie Wilson

We consider solving nonconvex composite optimization problems in which the sum of a smooth function and a nonsmooth function is minimized. Many of convergence analyses of proximal gradient-type methods rely on global descent property…

Optimization and Control · Mathematics 2026-04-09 Shotaro Yagishita , Masaru Ito