English
Related papers

Related papers: The Riemannian Landing Method: From projected grad…

200 papers

Recent advancements in data science have significantly elevated the importance of orthogonally constrained optimization problems. The Riemannian approach has become a popular technique for addressing these problems due to the advantageous…

Optimization and Control · Mathematics 2026-04-07 Linglingzhi Zhu , Wentao Ding , Shangyuan Liu , Anthony Man-Cho So

Numerous problems in optics, quantum physics, stability analysis, and control of dynamical systems can be brought to an optimization problem with matrix variable subjected to the symplecticity constraint. As this constraint nicely forms a…

Optimization and Control · Mathematics 2022-11-18 Bin Gao , Nguyen Thanh Son , Tatjana Stykel

Riemannian optimization is concerned with problems, where the independent variable lies on a smooth manifold. There is a number of problems from numerical linear algebra that fall into this category, where the manifold is usually specified…

Numerical Analysis · Mathematics 2024-06-27 Rasmus Jensen , Ralf Zimmermann

Since optimization on Riemannian manifolds relies on the chosen metric, it is appealing to know that how the performance of a Riemannian optimization method varies with different metrics and how to exquisitely construct a metric such that a…

Optimization and Control · Mathematics 2025-02-19 Bin Gao , Renfeng Peng , Ya-xiang Yuan

We propose a Riemannian optimization approach for computing low-rank solutions of the algebraic Riccati equation. The scheme alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is on the set of…

Optimization and Control · Mathematics 2014-05-29 B. Mishra , B. Vandereycken

The subgradient method is a classical and foundational approach in non-smooth convex optimization; its simplicity, robustness, and role as a conceptual and algorithmic starting point have made it the backbone of many significant…

Optimization and Control · Mathematics 2026-05-26 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , I. D. L. Melo

A fundamental class of matrix optimization problems that arise in many areas of science and engineering is that of quadratic optimization with orthogonality constraints. Such problems can be solved using line-search methods on the Stiefel…

Optimization and Control · Mathematics 2015-10-06 Huikang Liu , Weijie Wu , Anthony Man-Cho So

This paper investigates the optimal $H_2$ model order reduction for linear systems with quadratic outputs. In the framework of Galerkin projection, we first formulate the optimal $H_2$ MOR as an unconstrained Riemannian optimization problem…

Optimization and Control · Mathematics 2025-04-16 Xiaolong Wang , Tongtu Tian

This work puts forth low-complexity Riemannian subspace descent algorithms for the minimization of functions over the symmetric positive definite (SPD) manifold. Different from the existing Riemannian gradient descent variants, the proposed…

Machine Learning · Statistics 2023-12-19 Yogesh Darmwal , Ketan Rajawat

We give quantum speedups of several general-purpose numerical optimisation methods for minimising a function $f:\mathbb{R}^n \to \mathbb{R}$. First, we show that many techniques for global optimisation under a Lipschitz constraint can be…

The conjugate gradient method is a crucial first-order optimization method that generally converges faster than the steepest descent method, and its computational cost is much lower than that of second-order methods. However, while various…

Optimization and Control · Mathematics 2024-03-13 Jun Chen , Haishan Ye , Mengmeng Wang , Tianxin Huang , Guang Dai , Ivor W. Tsang , Yong Liu

Nonlinear dimensionality reduction methods provide a valuable means to visualize and interpret high-dimensional data. However, many popular methods can fail dramatically, even on simple two-dimensional manifolds, due to problems such as…

Machine Learning · Statistics 2020-07-08 Daniel Ting , Michael I. Jordan

This paper addresses a class of nonsmooth and nonconvex optimization problems defined on complete Riemannian manifolds. The objective function has a composite structure, combining convex, differentiable, and lower semicontinuous terms,…

Optimization and Control · Mathematics 2025-11-19 Vitaliano S. Amaral , Marcio Antônio de A. Bortoloti , Jurandir O. Lopes , Gilson N. Silva

Optimization under the symplecticity constraint is an approach for solving various problems in quantum physics and scientific computing. Building on the results that this optimization problem can be transformed into an unconstrained problem…

Optimization and Control · Mathematics 2024-06-21 Bin Gao , Nguyen Thanh Son , Tatjana Stykel

In this paper, we introduce the notion of generalized $\epsilon$-stationarity for a class of nonconvex and nonsmooth composite minimization problems on compact Riemannian submanifold embedded in Euclidean space. To find a generalized…

Optimization and Control · Mathematics 2023-10-31 Zheng Peng , Weihe Wu , Jiang Hu , Kangkang Deng

We address the problem of computing Riemannian normal coordinates on the real, compact Stiefel manifold of orthogonal frames. The Riemannian normal coordinates are based on the so-called Riemannian exponential and the Riemannian logarithm…

Numerical Analysis · Mathematics 2022-02-09 Ralf Zimmermann , Knut Hüper

We propose a first-order method for solving inequality constrained optimization problems. The method is derived from our previous work [12], a modified search direction method (MSDM) that applies the singular-value decomposition of…

Optimization and Control · Mathematics 2020-03-12 Long Chen , Wenyi Chen , Kai-Uwe Bletzinger

We study decentralized online Riemannian optimization over manifolds with possibly positive curvature, going beyond the Hadamard manifold setting. Decentralized optimization techniques rely on a consensus step that is well understood in…

Optimization and Control · Mathematics 2025-09-10 Emre Sahinoglu , Shahin Shahrampour

This paper extends the SQP-approach of the well-known bundle-Newton method for nonsmooth unconstrained minimization to the nonlinearly constrained case. Instead of using a penalty function or a filter or an improvement function to deal with…

Optimization and Control · Mathematics 2015-06-29 Hannes Fendl , Hermann Schichl

In this paper, we present a stochastic augmented Lagrangian approach on (possibly infinite-dimensional) Riemannian manifolds to solve stochastic optimization problems with a finite number of deterministic constraints.We investigate the…

Optimization and Control · Mathematics 2025-04-01 Caroline Geiersbach , Tim Suchan , Kathrin Welker