Related papers: Orbits of geometric descent
A popular approach to the MAP inference problem in graphical models is to minimize an upper bound obtained from a dual linear programming or Lagrangian relaxation by (block-)coordinate descent. This is also known as convex/convergent…
We consider the gradient method with variable step size for minimizing functions that are definable in o-minimal structures on the real field and differentiable with locally Lipschitz gradients. We prove that global convergence holds if…
The stochastic gradient descent has been widely used for solving composite optimization problems in big data analyses. Many algorithms and convergence properties have been developed. The composite functions were convex primarily and…
We give an example of a convex, finite and lower semicontinuous function whose subdifferential is everywhere empty. This is possible since the function is defined on an incomplete normed space. The function serves as a universal…
We investigate the differentiability properties of real-valued quasiconvex functions f defined on a separable Banach space X. Continuity is only assumed to hold at the points of a dense subset. If so, this subset is automatically residual.…
We consider composite functions in the elementary algebraic framework. Without any use of the Fourier transform, we find almost periodic orbits which suitably characterizes certain composite functions. In particular, we provide special…
We develop a new Riemannian descent algorithm that relies on momentum to improve over existing first-order methods for geodesically convex optimization. In contrast, accelerated convergence rates proved in prior work have only been shown to…
We present two characterizations of quasiconvexity for radially semicontinuous mappings defined on a convex subset of a real linear space. As an application we obtain an extension of the Sion's minimax theorem, as well as a new…
In this paper, we propose a general mechanism for the existence of quasicrystals in spatially extended systems (partial differential equations with Euclidean symmetry). We argue that the existence of quasicrystals with higher order…
We construct a smoothly bounded pseudoconvex domain such that every boundary point has a p.s.h. peak function but some boundary point admits no (local) holomorphic peak function.
We prove that the number of critical points of a Li-Tam Green's function on a complete open Riemannian surface of finite type admits a topological upper bound, given by the first Betti number of the surface. In higher dimensions, we show…
In this paper, we establish the existence and uniqueness theorem of entire solutions to the Lagrangian mean curvature equations with prescribed asymptotic behavior at infinity. The phase functions are assumed to be supercritical and…
If $u : \Omega\subset \mathbb{R}^d \to {\rm X}$ is a harmonic map valued in a metric space ${\rm X}$ and ${\sf E} : {\rm X} \to \mathbb{R}$ is a convex function, in the sense that it generates an ${\rm EVI}_0$-gradient flow, we prove that…
We prove that N\'eron models of jacobians of generically-smooth nodal curves over bases of arbitrary dimension are quasi-compact (hence of finite type) whenever they exist. We give a simple application to the orders of torsion subgroups of…
We explore why many recently proposed robust estimation problems are efficiently solvable, even though the underlying optimization problems are non-convex. We study the loss landscape of these robust estimation problems, and identify the…
In this paper, we study some problems with continuously differentiable quasiconvex objective function. We prove that exactly one of the following two alternatives holds: (I) the gradient of the objective function is different from zero over…
The minimization of a nonconvex composite function can model a variety of imaging tasks. A popular class of algorithms for solving such problems are majorization-minimization techniques which iteratively approximate the composite nonconvex…
Matrix sensing problems exhibit pervasive non-convexity, plaguing optimization with a proliferation of suboptimal spurious solutions. Avoiding convergence to these critical points poses a major challenge. This work provides new theoretical…
We present a new algorithm deciding if the intersection of a quasiconvex subgroup of a negatively curved group with a conjugate is finite. We also give a short proof of decidability of the membership problem for quasiconvex subgroups of…
Nonconvex optimization is central in solving many machine learning problems, in which block-wise structure is commonly encountered. In this work, we propose cyclic block coordinate methods for nonconvex optimization problems with…