Related papers: On the {\L}ojasiewicz Exponent of the Quadratic Sp…
Stochastic optimization via Stochastic Gradient Descent (SGD) is a fundamental problem in statistics and optimization. This paper revisits Stochastic Gradient Descent (SGD) for strongly convex objectives, establishing tight, uniform-in-time…
We state and prove a stabilisation result for solutions of abstract gradient systems associated with nonsmooth energy functions on infinite dimensional Hilbert spaces. One feature is that in this general setting the assumption on the range…
We prove an inequality that generalizes the Fan-Taussky-Todd discrete analog of the Wirtinger inequality. It is equivalent to an estimate on the spectral gap of a weighted discrete Laplacian on the circle. The proof uses a geometric…
Gradient descent methods are fundamental first-order optimization algorithms in both Euclidean spaces and Riemannian manifolds. However, the exact gradient is not readily available in many scenarios. This paper proposes a novel inexact…
In this work, we establish that Nesterov's accelerated gradient method, applied to $C^2$ functions satisfying the Polyak--{\L}ojasiewicz inequality around local minimizers, achieves the optimal local linear convergence rate…
We improve the previously best known upper bounds on the sizes of $\theta$-spherical codes for every $\theta<\theta^*\approx 62.997^{\circ}$ at least by a factor of $0.4325$, in sufficiently high dimensions. Furthermore, for sphere packing…
Using jointly geometric and stochastic reformulations of nonconvex problems and exploiting a Monge-Kantorovich gradient system formulation with vanishing forces, we formally extend the simulated annealing method to a wide class of global…
In this paper, we prove global gradient estimates for solutions to linear elliptic and parabolic equations. For a sufficiently smooth bounded convex domain $\Omega \subset \mathbb{R}^N$, we show that a solution $\phi \in…
We present a new proof (based on spectral decomposition) of a bound originally proved by Sidelnikov~\, for the frame potentials $\sum_{ij} \left( {\bf P}_i \cdot {\bf P}_j \right)^\ell $ on a unit--sphere in $d$ dimensions. Sidelnikov's…
We study global regularity of nonlinear systems of partial differential equations depending on the symmetric part of the gradient with Dirichlet boundary conditions. These systems arise from variational problems in plasticity with power…
We propose a derivative-free trust-region method based on finite-difference gradient approximations for smooth optimization problems with convex constraints. The proposed method does not require computing an approximate stationarity…
In this paper, we prove a version of global \L ojasiewicz inequality for $C^1$ semialgebraic functions and relate its existence to the set of asymptotic critical values.
In this paper we study a second order dynamical system with variable coefficients in connection to the minimization problem of a smooth nonconvex function. The convergence of the trajectories generated by the dynamical system to a critical…
The Lojasiewicz exponent at infinity of an entire function measures of the infimal rate of growth of its gradient. The authors compute the Lojasiewicz exponents at infinity of the 3-variable complex polynomials x - 3 x^{2n+1} y^{2q} + 2…
We present a global version of the {\L}ojasiewicz inequality on comparing the rate of growth of two polynomial functions in the case the mapping defined by these functions is (Newton) non-degenerate at infinity. In addition, we show that…
We propose a group sparse optimization model for inpainting of a square-integrable isotropic random field on the unit sphere, where the field is represented by spherical harmonics with random complex coefficients. In the proposed…
The Polyak-{\L}ojasiewicz (P{\L}) condition is often invoked in nonconvex optimization because it allows fast convergence of algorithms beyond strong convexity. A function $f \colon \mathcal{M} \to \mathbb{R}$ on a Riemannian manifold…
In this paper, a generalized optimization problem on the local sphere is established by the cone order relation on the tangent space, and solved by an improved conditional gradient method (for short, ICGM). The auxiliary subproblems are…
Thomson problem is a classical problem in physics to study how $n$ number of charged particles distribute themselves on the surface of a sphere of $k$ dimensions. When $k=2$, i.e. a 2-sphere (a circle), the particles appear at equally…
In this manuscript we study the following optimization problem: given a bounded and regular domain $\Omega\subset \mathbb{R}^N$ we look for an optimal shape for the "$\mathrm{W}-$vanishing window" on the boundary with prescribed measure…