English
Related papers

Related papers: Riemannian conjugate gradient methods: General fra…

200 papers

We propose a novel evolutionary algorithm for optimizing real-valued objective functions defined on the Grassmann manifold Gr}(k,n), the space of all k-dimensional linear subspaces of R^n. While existing optimization techniques on Gr}(k,n)…

Optimization and Control · Mathematics 2025-03-31 Andrew Lesniewski

A general class of Newton algorithms on Gra{\ss}mann and Lagrange-Gra{\ss}mann manifolds is introduced, that depends on an arbitrary pair of local coordinates. Local quadratic convergence of the algorithm is shown under a suitable condition…

Optimization and Control · Mathematics 2011-11-10 Uwe Helmke , Knut Hüper , Jochen Trumpf

In image set classification, a considerable advance has been made by modeling the original image sets by second order statistics or linear subspace, which typically lie on the Riemannian manifold. Specifically, they are Symmetric Positive…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Rui Wang , Xiao-Jun Wu , Kai-Xuan Chen , Josef Kittler

The standard implementation of the conjugate gradient algorithm suffers from communication bottlenecks on parallel architectures, due primarily to the two global reductions required every iteration. In this paper, we study conjugate…

Numerical Analysis · Computer Science 2021-04-20 Tyler Chen , Erin C. Carson

Determining the ultimate limits of quantum communication, such as the quantum capacity of a channel and the distillable entanglement of a shared state, remains a central challenge in quantum information theory, primarily due to the…

Quantum Physics · Physics 2025-10-15 Chengkai Zhu , Hongyu Mao , Kun Fang , Xin Wang

Strictly enforcing orthonormality constraints on parameter matrices has been shown advantageous in deep learning. This amounts to Riemannian optimization on the Stiefel manifold, which, however, is computationally expensive. To address this…

Machine Learning · Computer Science 2020-02-05 Jun Li , Li Fuxin , Sinisa Todorovic

We recover the Riemannian gradient of a given function defined on interior points of a Riemannian submanifold in the Euclidean space based on a sample of function evaluations at points in the submanifold. This approach is based on the…

Machine Learning · Computer Science 2023-06-06 Alvaro Almeida Gomez , Antônio J. Silva Neto , Jorge P. Zubelli

In the domain of image-set based classification, a considerable advance has been made by representing original image sets as covariance matrices which typical lie in a Riemannian manifold. Specifically, it is a Symmetric Positive Definite…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Rui Wang , Xiao-Jun Wu , Josef Kittler

Smooth, non-convex optimization problems on Riemannian manifolds occur in machine learning as a result of orthonormality, rank or positivity constraints. First- and second-order necessary optimality conditions state that the Riemannian…

Optimization and Control · Mathematics 2019-10-24 Chris Criscitiello , Nicolas Boumal

Riemannian optimization is concerned with problems, where the independent variable lies on a smooth manifold. There is a number of problems from numerical linear algebra that fall into this category, where the manifold is usually specified…

Numerical Analysis · Mathematics 2024-06-27 Rasmus Jensen , Ralf Zimmermann

In the present work we studied a subfield of Applied Mathematics called Riemannian Optimization. The main goal of this subfield is to generalize algorithms, theorems and tools from Mathematical Optimization to the case in which the…

Optimization and Control · Mathematics 2024-03-25 Caio O. da Silva

This paper is a short summary of our recent work on the medians and means of probability measures in Riemannian manifolds. Firstly, the existence and uniqueness results of local medians are given. In order to compute medians in practical…

Differential Geometry · Mathematics 2011-11-16 Marc Arnaudon , Frédéric Barbaresco , Le Yang

The natural gradient method is widely used in statistical optimization, but its standard formulation assumes a Euclidean parameter space. This paper proposes an inversion-free stochastic natural gradient method for probability distributions…

Machine Learning · Statistics 2026-04-06 Dario Draca , Takuo Matsubara , Minh-Ngoc Tran

Riemannian meta-optimization provides a promising approach to solving non-linear constrained optimization problems, which trains neural networks as optimizers to perform optimization on Riemannian manifolds. However, existing Riemannian…

Machine Learning · Computer Science 2025-02-07 Peilin Yu , Yuwei Wu , Zhi Gao , Xiaomeng Fan , Yunde Jia

Correlation matrices are fundamental summaries of functional brain networks, yet standard analyses often treat entries independently, ignoring the curved geometry of correlation space. Existing geometric methods frequently lack closed-form…

Machine Learning · Computer Science 2026-05-22 Mario Severino , Manuela Moretto , Robert A. McCutcheon , Mattia Veronese

In this paper, we propose a new global analysis framework for a class of low-rank matrix recovery problems on the Riemannian manifold. We analyze the global behavior for the Riemannian optimization with random initialization. We use the…

Machine Learning · Statistics 2021-04-20 Thomas Y. Hou , Zhenzhen Li , Ziyun Zhang

Designing quantum circuits for ground state preparation is a fundamental task in quantum information science. However, standard Variational Quantum Algorithms (VQAs) are often constrained by limited ansatz expressivity and difficult…

Quantum Physics · Physics 2026-02-25 Zhijian Lai , Hantao Nie , Jiayuan Wu , Dong An

We study the equilibrium problem on general Riemannian manifolds. The results on existence of solutions and on the convex structure of the solution set are established. Our approach consists in relating the equilibrium problem to a suitable…

Optimization and Control · Mathematics 2018-01-10 Chong Li , Xiangmei Wang , Genaro LÓpez , Jen-Chih Yao

We examine a wide class of stochastic approximation algorithms for solving (stochastic) nonlinear problems on Riemannian manifolds. Such algorithms arise naturally in the study of Riemannian optimization, game theory and optimal transport,…

Optimization and Control · Mathematics 2022-12-29 Mohammad Reza Karimi , Ya-Ping Hsieh , Panayotis Mertikopoulos , Andreas Krause

In this paper, we introduce some new iterative optimisation algorithms on Riemannian manifolds and Hilbert spaces which have good global convergence guarantees to local minima. More precisely, these algorithms have the following properties:…

Optimization and Control · Mathematics 2025-05-29 Tuyen Trung Truong