English
Related papers

Related papers: Geodesic Convex Optimization: Differentiation on M…

200 papers

The Euclidean space notion of convex sets (and functions) generalizes to Riemannian manifolds in a natural sense and is called geodesic convexity. Extensively studied computational problems such as convex optimization and sampling in convex…

Optimization and Control · Mathematics 2020-02-10 Navin Goyal , Abhishek Shetty

Geodesic convexity generalizes the notion of (vector space) convexity to nonlinear metric spaces. But unlike convex optimization, geodesically convex (g-convex) optimization is much less developed. In this paper we contribute to the…

Optimization and Control · Mathematics 2016-02-22 Hongyi Zhang , Suvrit Sra

Geodesic convexity (g-convexity) is a natural generalization of convexity to Riemannian manifolds. However, g-convexity lacks many desirable properties satisfied by Euclidean convexity. For instance, the natural notions of half-spaces and…

Optimization and Control · Mathematics 2025-05-23 Christopher Criscitiello , Jungbin Kim

Manifold optimization is ubiquitous in computational and applied mathematics, statistics, engineering, machine learning, physics, chemistry and etc. One of the main challenges usually is the non-convexity of the manifold constraints. By…

Optimization and Control · Mathematics 2019-06-14 Jiang Hu , Xin Liu , Zaiwen Wen , Yaxiang Yuan

We propose a general scheme for solving convex and non-convex optimization problems on manifolds. The central idea is that, by adding a multiple of the squared retraction distance to the objective function in question, we "convexify" the…

Computation · Statistics 2020-10-20 Lizhen Lin , Bayan Saparbayeva , Michael Minyi Zhang , David B. Dunson

We study geodesically convex (g-convex) problems that can be written as a difference of Euclidean convex functions. This structure arises in several optimization problems in statistics and machine learning, e.g., for matrix scaling,…

Optimization and Control · Mathematics 2022-10-24 Melanie Weber , Suvrit Sra

Convex optimization is a well-established research area with applications in almost all fields. Over the decades, multiple approaches have been proposed to solve convex programs. The development of interior-point methods allowed solving a…

Optimization and Control · Mathematics 2020-01-08 Ahmed Douik , Babak Hassibi

We study a class of optimization problems in the Wasserstein space (the space of probability measures) where the objective function is nonconvex along generalized geodesics. Specifically, the objective exhibits some difference-of-convex…

Optimization and Control · Mathematics 2025-01-08 Hoang Phuc Hau Luu , Hanlin Yu , Bernardo Williams , Petrus Mikkola , Marcelo Hartmann , Kai Puolamäki , Arto Klami

Hidden convexity is a powerful idea in optimization: under the right transformations, nonconvex problems that are seemingly intractable can be solved efficiently using convex optimization. We introduce the notion of a Lagrangian dual…

Optimization and Control · Mathematics 2025-11-07 Venkat Chandrasekaran , Timothy Duff , Jose Israel Rodriguez , Kevin Shu

Non-convex optimization plays a key role in a growing number of machine learning applications. This motivates the identification of specialized structure that enables sharper theoretical analysis. One such identified structure is…

Optimization and Control · Mathematics 2023-06-06 Qiang Fu , Dongchu Xu , Ashia Wilson

We further research on the accelerated optimization phenomenon on Riemannian manifolds by introducing accelerated global first-order methods for the optimization of $L$-smooth and geodesically convex (g-convex) or $\mu$-strongly g-convex…

Optimization and Control · Mathematics 2023-01-16 David Martínez-Rubio

Many problems of theoretical and practical interest involve finding an optimum over a family of convex functions. For instance, finding the projection on the convex functions in $H^k(\Omega)$, and optimizing functionals arising from some…

Numerical Analysis · Mathematics 2008-04-11 Néstor E. Aguilera , Pedro Morin

We develop \emph{geometric optimisation} on the manifold of Hermitian positive definite (HPD) matrices. In particular, we consider optimising two types of cost functions: (i) geodesically convex (g-convex); and (ii) log-nonexpansive (LN).…

Functional Analysis · Mathematics 2018-06-04 Suvrit Sra , Reshad Hosseini

This book is devoted to finite-dimensional problems of non-convex non-smooth optimization and numerical methods for their solution. The problem of nonconvexity is studied in the book on two main models of nonconvex dependencies: these are…

Optimization and Control · Mathematics 2024-06-18 V. S. Mikhalevich , A. M. Gupal , V. I. Norkin

In this paper, we address the bounded/unbounded determination of geodesically convex optimization on Hadamard spaces. In Euclidean convex optimization, the recession function is a basic tool to study the unboundedness, and provides the…

Optimization and Control · Mathematics 2023-06-01 Hiroshi Hirai

We consider several basic questions pertaining to the geometry of image of a general quadratic map. In general the image of a quadratic map is non-convex, although there are several known classes of quadratic maps when the image is convex.…

Optimization and Control · Mathematics 2018-10-03 Anatoly Dymarsky , Elena Gryazina , Sergei Volodin , Boris Polyak

In this work, we consider constrained stochastic optimization problems under hidden convexity, i.e., those that admit a convex reformulation via non-linear (but invertible) map $c(\cdot)$. A number of non-convex problems ranging from…

Optimization and Control · Mathematics 2024-11-12 Ilyas Fatkhullin , Niao He , Yifan Hu

We show that a differentiable function on the 2-Wasserstein space is geodesically convex if and only if it is also convex along a larger class of curves which we call `acceleration-free'. In particular, the set of acceleration-free curves…

Functional Analysis · Mathematics 2023-06-21 Guy Parker

This paper initiates a systematic development of a theory of non-commutative optimization. It aims to unify and generalize a growing body of work from the past few years which developed and analyzed algorithms for natural geodesically…

Optimization and Control · Mathematics 2021-07-28 Peter Bürgisser , Cole Franks , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

Many problems of theoretical and practical interest involve finding a convex or concave function. For instance, optimization problems such as finding the projection on the convex functions in $H^k(\Omega)$, or some problems in economics. In…

Numerical Analysis · Mathematics 2008-04-11 Néstor Aguilera , Pedro Morin
‹ Prev 1 2 3 10 Next ›