English
Related papers

Related papers: Riemannian optimization with a preconditioning sch…

200 papers

In this paper, we consider the composite optimization problems over the Stiefel manifold. A successful method to solve this class of problems is the proximal gradient method proposed by Chen et al. Motivated by the proximal Newton-type…

Optimization and Control · Mathematics 2025-01-17 Qinsi Wang , Wei Hong Yang

We propose a robust and scalable procedure for general optimization and inference problems on manifolds leveraging the classical idea of `median-of-means' estimation. This is motivated by ubiquitous examples and applications in modern data…

Methodology · Statistics 2020-06-16 Lizhen Lin , Drew Lazar , Bayan Sarpabayeva , David B. Dunson

We consider optimization problems on manifolds with equality and inequality constraints. A large body of work treats constrained optimization in Euclidean spaces. In this work, we consider extensions of existing algorithms from the…

Optimization and Control · Mathematics 2019-04-26 Changshuo Liu , Nicolas Boumal

We propose Riemannian preconditioned algorithms for the tensor completion problem via tensor ring decomposition. A new Riemannian metric is developed on the product space of the mode-2 unfolding matrices of the core tensors in tensor ring…

Optimization and Control · Mathematics 2023-11-15 Bin Gao , Renfeng Peng , Ya-xiang Yuan

The problem of determining the configuration of points from partial distance information, known as the Euclidean Distance Geometry (EDG) problem, is fundamental to many tasks in the applied sciences. In this paper, we propose two algorithms…

Optimization and Control · Mathematics 2024-10-10 Chandler Smith , HanQin Cai , Abiy Tasissa

This paper proposes a novel general framework of Riemannian conjugate gradient methods, that is, conjugate gradient methods on Riemannian manifolds. The conjugate gradient methods are important first-order optimization algorithms both in…

Optimization and Control · Mathematics 2022-11-21 Hiroyuki Sato

In this paper, we define the geometric median of a probability measure on a Riemannian manifold, give its characterization and a natural condition to ensure its uniqueness. In order to calculate the median in practical cases, we also…

Differential Geometry · Mathematics 2019-02-20 Le Yang

Optimization techniques are at the core of many scientific and engineering disciplines. The steepest descent methods play a foundational role in this area. In this paper we studied a generalized steepest descent method on Riemannian…

Optimization and Control · Mathematics 2025-02-28 Rashid A. , Amal A Samad

The symplectic Stiefel manifold, denoted by $\mathrm{Sp}(2p,2n)$, is the set of linear symplectic maps between the standard symplectic spaces $\mathbb{R}^{2p}$ and $\mathbb{R}^{2n}$. When $p=n$, it reduces to the well-known set of $2n\times…

Optimization and Control · Mathematics 2021-07-20 Bin Gao , Nguyen Thanh Son , P. -A. Absil , Tatjana Stykel

Riemannian structures on infinite-dimensional manifolds arise naturally in shape analysis and shape optimization. These applications lead to optimization problems on manifolds which are not modeled on Banach spaces. The present article…

Optimization and Control · Mathematics 2026-04-21 Valentina Zalbertus , Max Pfeffer , Alexander Schmeding

This paper deals with Riemannian optimization on the unit sphere in terms of $p$-norm with general $p > 1$. As a Riemannian submanifold of the Euclidean space, the geometry of the sphere with $p$-norm is investigated, and several geometric…

Optimization and Control · Mathematics 2022-02-24 Hiroyuki Sato

Matrix-valued optimization tasks, including those involving symmetric positive definite (SPD) matrices, arise in a wide range of applications in machine learning, data science and statistics. Classically, such problems are solved via…

Optimization and Control · Mathematics 2024-10-15 Andrew Cheng , Melanie Weber

Conjugate gradient (CG) methods are widely acknowledged as efficient for minimizing continuously differentiable functions in Euclidean spaces. In recent years, various CG methods have been extended to Riemannian manifold optimization, but…

Optimization and Control · Mathematics 2026-05-26 Chunming Tang , Shaohui Liang , Huangyue Chen

Constant rescaling of a Riemannian metric appears in many computational settings, often through a global scale parameter that is introduced either explicitly or implicitly. Although this operation is elementary, its consequences are not…

Machine Learning · Computer Science 2026-01-29 Kisung You

Modern machine learning increasingly leverages the insight that high-dimensional data often lie near low-dimensional, non-linear manifolds, an idea known as the manifold hypothesis. By explicitly modeling the geometric structure of data…

Machine Learning · Computer Science 2026-03-02 Willem Diepeveen , Deanna Needell

Variance parameter estimation in linear mixed models is a challenge for many classical nonlinear optimization algorithms due to the positive-definiteness constraint of the random effects covariance matrix. We take a completely novel view on…

Machine Learning · Statistics 2022-12-20 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

Solving the so-called geodesic endpoint problem, i.e., finding a geodesic that connects two given points on a manifold, is at the basis of virtually all data processing operations, including averaging, clustering, interpolation and…

Numerical Analysis · Mathematics 2021-07-15 Thomas Bendokat , Ralf Zimmermann

This paper addresses the numerical solution of nonlinear eigenvector problems such as the Gross-Pitaevskii and Kohn-Sham equation arising in computational physics and chemistry. These problems characterize critical points of energy…

Numerical Analysis · Mathematics 2022-04-19 Robert Altmann , Daniel Peterseim , Tatjana Stykel

High-dimensional data with intrinsic low-dimensional structure is ubiquitous in machine learning and data science. While various approaches allow one to learn a data manifold with a Riemannian structure from finite samples, performing…

Optimization and Control · Mathematics 2026-05-07 Willem Diepeveen , Melanie Weber

Graphs are ubiquitous, and learning on graphs has become a cornerstone in artificial intelligence and data mining communities. Unlike pixel grids in images or sequential structures in language, graphs exhibit a typical non-Euclidean…

Machine Learning · Computer Science 2026-02-12 Li Sun , Qiqi Wan , Suyang Zhou , Zhenhao Huang , Philip S. Yu