Related papers: Smooth, globally Polyak-{\L}ojasiewicz functions a…
We consider the nonconvex minimization problem, with quartic objective function, that arises in the exact recovery of a configuration matrix $P\in \R^{nd}$ of $n$ points when a Euclidean distance matrix, \EDMp, is given with embedding…
The {\L}ojasiewicz inequality characterizes objective-value convergence along gradient flows and, in special cases, yields exponential decay of the cost. However, such results do not directly give rates of convergence in the state. In this…
We give an example of a function satisfying a two-sided Polyak-Lojasiewicz condition but for which a gradient descent-ascent flow line fails to converge to the saddle point, circling around it instead. We can even impose the function to be…
The purpose of this paper is to extend the full convergence results of the classic GLL-type (Grippo-Lampariello-Lucidi) nonmonotone methods to nonconvex and nonsmooth optimization. We propose a novel iterative framework for the minimization…
We study gradient methods for optimizing $(L_0, L_1)$-smooth functions, a class that generalizes Lipschitz-smooth functions and has gained attention for its relevance in machine learning. We provide new insights into the structure of this…
This paper develops a comprehensive convergence analysis for generic classes of descent algorithms in nonsmooth and nonconvex optimization under several conditions of the Polyak-\L ojasiewicz-Kurdyka (PLK) type. Along other results, we…
The approximation properties of the finite element method can often be substantially improved by choosing smooth high-order basis functions. It is extremely difficult to devise such basis functions for partitions consisting of arbitrarily…
Since the Hadamard Theorem, several metric and topological conditions have emerged in the literature to date, yielding global inversion and implicit theorems for functions in different settings. Relevant examples are the mappings between…
We construct an example of a smooth convex function on the plane with a strict minimum at zero, which is real analytic except at zero, for which Thom's gradient conjecture fails both at zero and infinity. More precisely, the gradient orbits…
Bilevel optimization has recently regained interest owing to its applications in emerging machine learning fields such as hyperparameter optimization, meta-learning, and reinforcement learning. Recent results have shown that simple…
This work investigates a dynamical system functioning as a nonsmooth adaptation of the continuous Newton method, aimed at minimizing the sum of a primal lower-regular and a locally Lipschitz function, both potentially nonsmooth. The…
Let $(\mathrm{M}, \omega_{0})$ be a connected paracompact smooth oriented manifold. We establish a necessary and sufficient conditions on Lie subalgebra $\mathfrak{a}$ of $\mathrm{T M}$ such that its orbits becomes diffeomorphic to an open…
Nonconvex-nonconcave minimax optimization has gained widespread interest over the last decade. However, most existing works focus on variants of gradient descent-ascent (GDA) algorithms, which are only applicable to smooth nonconvex-concave…
In this paper, the authors characterize Sobolev spaces $W^{\alpha,p}({\mathbb R}^n)$ with the smoothness order $\alpha\in(0,2]$ and $p\in(\max\{1, \frac{2n}{2\alpha+n}\},\infty)$, via the Lusin area function and the Littlewood-Paley…
We make some remarks on the global shape of continuous convex functions defined on a Banach space $Z$. Among other results we prove that if $Z$ is separable then for every continuous convex function $f:Z\to\mathbb{R}$ there exist a unique…
In this paper, we focus on providing convergence guarantees for stochastic subgradient methods in minimizing nonsmooth nonconvex functions. We first investigate the global stability of a general framework for stochastic subgradient methods,…
The Lichnerowicz conjecture asserts that all harmonic manifolds are either flat or locally symmetric spaces of rank~1. This conjecture has been proved by Z. Szab\'{o} \cite{Sz} for harmonic manifolds with compact universal cover. E. Damek…
This paper proposes and develops inexact proximal methods for finding stationary points of the sum of a smooth function and a nonsmooth weakly convex one, where an error is present in the calculation of the proximal mapping of the nonsmooth…
We are interested in the ``smoothest'' averaging that can be achieved by convolving functions $f \in \ell^2(\mathbb{Z})$ with an averaging function $u$. More precisely, suppose $u:\{-n, \ldots, n\} \to \mathbb{R}$ is a symmetric function…
We revisit the Frank-Wolfe (FW) optimization under strongly convex constraint sets. We provide a faster convergence rate for FW without line search, showing that a previously overlooked variant of FW is indeed faster than the standard…