English
Related papers

Related papers: The Riemannian Landing Method: From projected grad…

200 papers

Gradient descent with momentum has been widely applied in various signal processing and machine learning tasks, demonstrating a notable empirical advantage over standard gradient descent. However, momentum-based distributed Riemannian…

Optimization and Control · Mathematics 2026-02-17 Jun Chen , Tianyi Zhu , Haishan Ye , Lina Liu , Guang Dai , Yong Liu , Yunliang Jiang , Ivor W. Tsang

Grover's algorithm is a fundamental quantum algorithm that achieves a quadratic speedup for unstructured search problems of size $N$. Recent studies have reformulated this task as a maximization problem on the unitary manifold and solved it…

Quantum Physics · Physics 2026-04-06 Zhijian Lai , Dong An , Jiang Hu , Zaiwen Wen

We investigate Riemannian gradient flows for preparing ground states of a desired Hamiltonian on a quantum device. We show that the number of steps of the corresponding Riemannian gradient descent (RGD) algorithm that prepares a ground…

Quantum Physics · Physics 2025-12-16 Mahum Pervez , Ariq Haqq , Nathan A. McMahon , Christian Arenz

We study a class of optimization problems on Riemannian manifolds, where the objective function consists of a smooth term and quasi-norm type penalties with exponent $p \in (0, 1]$. The essential difficulty lies in the fact that the…

Optimization and Control · Mathematics 2026-04-21 Lei Wang , Xiaojun Chen

High-dimensional data with intrinsic low-dimensional structure is ubiquitous in machine learning and data science. While various approaches allow one to learn a data manifold with a Riemannian structure from finite samples, performing…

Optimization and Control · Mathematics 2026-05-07 Willem Diepeveen , Melanie Weber

We consider optimization problems on Riemannian manifolds with equality and inequality constraints, which we call Riemannian nonlinear optimization (RNLO) problems. Although they have numerous applications, the existing studies on them are…

Optimization and Control · Mathematics 2021-06-16 Mitsuaki Obara , Takayuki Okuno , Akiko Takeda

The problem of recovering the configuration of points from their partial pairwise distances, referred to as the Euclidean Distance Matrix Completion (EDMC) problem, arises in a broad range of applications, including sensor network…

Optimization and Control · Mathematics 2026-05-07 Chandler Smith , HanQin Cai , Abiy Tasissa

This article deals with the conjugate gradient method on a Riemannian manifold with interest in global convergence analysis. The existing conjugate gradient algorithms on a manifold endowed with a vector transport need the assumption that…

Optimization and Control · Mathematics 2016-06-20 Hiroyuki Sato , Toshihiro Iwai

We extend the class of SQP methods for equality constrained optimization to the setting of differentiable manifolds. The use of retractions and stratifications allows us to pull back the involved mappings to linear spaces. We study local…

Optimization and Control · Mathematics 2020-05-15 Anton Schiela , Julian Ortiz

We study optimization over Riemannian embedded submanifolds, where the objective function is relatively smooth in the ambient Euclidean space. Such problems have broad applications but are still largely unexplored. We introduce two…

Optimization and Control · Mathematics 2025-08-08 Chang He , Jiaxiang Li , Bo Jiang , Shiqian Ma , Shuzhong Zhang

The symplectic Stiefel manifold, denoted by $\mathrm{Sp}(2p,2n)$, is the set of linear symplectic maps between the standard symplectic spaces $\mathbb{R}^{2p}$ and $\mathbb{R}^{2n}$. When $p=n$, it reduces to the well-known set of $2n\times…

Optimization and Control · Mathematics 2021-07-13 Bin Gao , Nguyen Thanh Son , P. -A. Absil , Tatjana Stykel

The effectiveness of dimensionality reduction with quadratic manifolds hinges on the choice of a reduced basis and the associated quadratic correction terms. Existing approaches typically rely on subspaces spanned by the leading principal…

Numerical Analysis · Mathematics 2026-05-27 Gavin Paxton , Seunghee Cheon , Rudy Geelen , Shane A. McQuarrie

This paper explores the problem of generalized phase retrieval, which involves reconstructing a length-$n$ signal $\bm{x}$ from its $m$ phaseless samples $y_k = \left|\langle \bm{a}_k,\bm{x}\rangle\right|^2$, where $k = 1,2,...,m$, and…

Information Theory · Computer Science 2026-04-16 Jianfeng Cai , Huiping Li , Jiayi Li

Optimization over the space of probability measures endowed with the Wasserstein-2 geometry is central to modern machine learning and mean-field modeling. However, traditional methods relying on full Wasserstein gradients often suffer from…

Machine Learning · Statistics 2026-04-03 Yewei Xu , Qin Li

In this paper we introduce a theoretical framework for semi-discrete optimization using ideas from optimal transport. Our primary motivation is in the field of deep learning, and specifically in the task of neural architecture search. With…

Analysis of PDEs · Mathematics 2022-02-01 Nicolas Garcia Trillos , Javier Morales

The aim of this paper is to derive convergence results for projected line-search methods on the real-algebraic variety $\mathcal{M}_{\le k}$ of real $m \times n$ matrices of rank at most $k$. Such methods extend Riemannian optimization…

Optimization and Control · Mathematics 2015-04-23 Reinhold Schneider , André Uschmajew

This paper proposes a generalized framework with joint normalization which learns lower-dimensional subspaces with maximum discriminative power by making use of the Riemannian geometry. In particular, we model the similarity/dissimilarity…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Tianci Liu , Zelin Shi , Yunpeng Liu

Many theoretical problems in quantum technology can be formulated and addressed as constrained optimization problems. The most common quantum mechanical constraints such as, e.g., orthogonality of isometric and unitary matrices, CPTP…

Quantum Physics · Physics 2021-11-18 I. A. Luchnikov , A. Ryzhov , S. N. Filippov , H. Ouerdane

In this paper, we introduce some new iterative optimisation algorithms on Riemannian manifolds and Hilbert spaces which have good global convergence guarantees to local minima. More precisely, these algorithms have the following properties:…

Optimization and Control · Mathematics 2025-05-29 Tuyen Trung Truong

We describe the first gradient methods on Riemannian manifolds to achieve accelerated rates in the non-convex case. Under Lipschitz assumptions on the Riemannian gradient and Hessian of the cost function, these methods find approximate…

Optimization and Control · Mathematics 2021-11-29 Christopher Criscitiello , Nicolas Boumal