English
Related papers

Related papers: Hybrid Riemannian Conjugate Gradient Methods with …

200 papers

Riemannian accelerated gradient methods have been well studied for smooth optimization, typically treating geodesically convex and geodesically strongly convex cases separately. However, their extension to nonsmooth problems on manifolds…

Optimization and Control · Mathematics 2025-09-29 Shuailing Feng , Yuhang Jiang , Wen Huang , Shihui Ying

We give curvature-dependant convergence rates for the optimization of weakly convex functions defined on a manifold of 1-bounded geometry via Riemannian gradient descent and via the dynamic trivialization algorithm. In order to do this, we…

Optimization and Control · Mathematics 2020-08-07 Mario Lezcano-Casado

The techniques and analysis presented in this thesis provide new methods to solve optimization problems posed on Riemannian manifolds. These methods are applied to the subspace tracking problem found in adaptive signal processing and…

Optimization and Control · Mathematics 2013-05-09 Steven Thomas Smith

Over a complete Riemannian manifold of finite dimension, Greene and Wu introduced a convolution, known as Greene-Wu (GW) convolution. In this paper, we study properties of the GW convolution and apply it to non-Euclidean machine learning…

Machine Learning · Computer Science 2022-01-25 Tianyu Wang , Yifeng Huang , Didong Li

In this paper, we consider the composite optimization problems over the Stiefel manifold. A successful method to solve this class of problems is the proximal gradient method proposed by Chen et al. Motivated by the proximal Newton-type…

Optimization and Control · Mathematics 2025-01-17 Qinsi Wang , Wei Hong Yang

We consider the optimization problem with a generally quadratic matrix constraint of the form $X^TAX = J$, where $A$ is a given nonsingular, symmetric $n\times n$ matrix and $J$ is a given $k\times k$ symmetric matrix, with $k\leq n$,…

Optimization and Control · Mathematics 2026-05-26 Dinh Van Tiep , Nguyen Thanh Son

We study the problem of finding the global Riemannian center of mass of a set of data points on a Riemannian manifold. Specifically, we investigate the convergence of constant step-size gradient descent algorithms for solving this problem.…

Differential Geometry · Mathematics 2012-01-05 Bijan Afsari , Roberto Tron , René Vidal

We consider a class of nonsmooth optimization problems over the Stiefel manifold, in which the objective function is weakly convex in the ambient Euclidean space. Such problems are ubiquitous in engineering applications but still largely…

Optimization and Control · Mathematics 2021-03-26 Xiao Li , Shixiang Chen , Zengde Deng , Qing Qu , Zhihui Zhu , Anthony Man Cho So

Minimization of a smooth function on a sphere or, more generally, on a smooth manifold, is the simplest non-convex optimization problem. It has a lot of applications. Our goal is to propose a version of the gradient projection algorithm for…

Optimization and Control · Mathematics 2019-06-28 Maxim Balashov , Boris Polyak , Andrey Tremba

In this paper, we propose a globally convergent method for solving constrained nonlinear systems. The method combines an efficient Newton conditional gradient method with a derivative-free and nonmonotone linesearch strategy. The global…

Optimization and Control · Mathematics 2018-06-06 M. L. N. Gonçalves , F. R. Oliveira

This paper addresses the problems of spline interpolation on smooth Riemannian manifolds, with or without the inclusion of least-squares fitting. Our unified approach utilizes gradient flows for successively connected curves or networks,…

Optimization and Control · Mathematics 2025-10-29 Chun-Chi Lin , Dung The Tran

This paper investigates the optimal $H_2$ model order reduction for linear systems with quadratic outputs. In the framework of Galerkin projection, we first formulate the optimal $H_2$ MOR as an unconstrained Riemannian optimization problem…

Optimization and Control · Mathematics 2025-04-16 Xiaolong Wang , Tongtu Tian

In this paper, we propose Riemannian conditional gradient methods for minimizing composite functions, i.e., those that can be expressed as the sum of a smooth function and a retraction-based convex function. We analyze the convergence of…

Optimization and Control · Mathematics 2026-05-19 Kangming Chen , Ellen H. Fukuda

Motivated by a constrained minimization problem, it is studied the gradient flows with respect to Hessian Riemannian metrics induced by convex functions of Legendre type. The first result characterizes Hessian Riemannian structures on…

Optimization and Control · Mathematics 2018-11-27 Felipe Alvarez , Jérôme Bolte , Olivier Brahic

Optimization under the symplecticity constraint is an approach for solving various problems in quantum physics and scientific computing. Building on the results that this optimization problem can be transformed into an unconstrained problem…

Optimization and Control · Mathematics 2024-06-21 Bin Gao , Nguyen Thanh Son , Tatjana Stykel

A damped Newton's method to find a singularity of a vector field in Riemannian setting is presented with global convergence study. It is ensured that the sequence generated by the proposed method reduces to a sequence generated by the…

Optimization and Control · Mathematics 2018-07-20 M. A. A. Bortoloti , T. A. Fernandes , O. P. Ferreira , Jinyun Yuan

We introduce the convex bundle method to solve convex, non-smooth optimization problems on Riemannian manifolds of bounded sectional curvature. Each step of our method is based on a model that involves the convex hull of previously…

Optimization and Control · Mathematics 2025-07-21 Ronny Bergmann , Roland Herzog , Hajg Jasa

For smooth optimization problems with a Hermitian positive semi-definite fixed-rank constraint, we consider three existing approaches including the simple Burer--Monteiro method, and Riemannian optimization over quotient geometry and the…

Optimization and Control · Mathematics 2025-04-17 Shixin Zheng , Wen Huang , Bart Vandereycken , Xiangxiong Zhang

This article presents nonlinear conjugate gradient methods for finding local weakly minimal points of set-valued optimization problems under a lower set less ordering relation. The set-valued objective function of the optimization problem…

Optimization and Control · Mathematics 2024-12-31 Debdas Ghosh , Ravi Raushan , Zai-Yun Peng , Jen-Chih Yao

Given an approximate eigenvector, its (standard) Rayleigh quotient and harmonic Rayleigh quotient are two well-known approximations of the corresponding eigenvalue. We propose a new type of Rayleigh quotient, the homogeneous Rayleigh…

Numerical Analysis · Mathematics 2023-05-24 Giulia Ferrandi , Michiel E. Hochstenbach