English
Related papers

Related papers: Computing Euclidean distance and maximum likelihoo…

200 papers

Many machine learning applications are naturally formulated as optimization problems on Riemannian manifolds. The main idea behind Riemannian optimization is to maintain the feasibility of the variables while moving along a descent…

Optimization and Control · Mathematics 2024-06-05 Andi Han , Pratik Jawanpuria , Bamdev Mishra

In this paper, we extend the proximal point algorithm for vector optimization from the Euclidean space to the Riemannian context. Under suitable assumptions on the objective function the well definition and full convergence of the method to…

Optimization and Control · Mathematics 2015-12-21 G. C. Bento , O. P. Ferreira , Y. R. L. Pereira

Optimization under the symplecticity constraint is an approach for solving various problems in quantum physics and scientific computing. Building on the results that this optimization problem can be transformed into an unconstrained problem…

Optimization and Control · Mathematics 2024-06-21 Bin Gao , Nguyen Thanh Son , Tatjana Stykel

Motivated by the problem of compressing point sets into as few bits as possible while maintaining information about approximate distances between points, we construct random nonlinear maps $\varphi_\ell$ that compress point sets in the…

Computational Geometry · Computer Science 2024-03-05 Brett Leroux , Luis Rademacher

The indicator matrix plays an important role in machine learning, but optimizing it is an NP-hard problem. We propose a new relaxation of the indicator matrix and prove that this relaxation forms a manifold, which we call the Relaxed…

Machine Learning · Computer Science 2025-04-14 Jinghui Yuan , Fangyuan Xie , Feiping Nie , Xuelong Li

This paper formulates the problem of Extremum Seeking for optimization of cost functions defined on Riemannian manifolds. We extend the conventional extremum seeking algorithms for optimization problems in Euclidean spaces to optimization…

Optimization and Control · Mathematics 2014-12-10 Farzin Taringoo , Peter M. Dower , Dragan Nesic , Ying Tan

Direct search methods represent a robust and reliable class of algorithms for solving black-box optimization problems. In this paper, we explore the application of those strategies to Riemannian optimization, wherein minimization is to be…

Optimization and Control · Mathematics 2022-02-23 Vyacheslav Kungurtsev , Francesco Rinaldi , Damiano Zeffiro

Projected gradient descent and its Riemannian variant belong to a typical class of methods for low-rank matrix estimation. This paper proposes a new Nesterov's Accelerated Riemannian Gradient algorithm by efficient orthographic retraction…

Optimization and Control · Mathematics 2023-06-05 Hongyi Li , Zhen Peng , Chengwei Pan , Di Zhao

Derivative-free Riemannian optimization (DFRO) aims to minimize an objective function using only function evaluations, under the constraint that the decision variables lie on a Riemannian manifold. The rapid increase in problem dimensions…

Optimization and Control · Mathematics 2026-01-14 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet

We present a new framework for statistical inference on Riemannian manifolds that achieves high-order accuracy, addressing the challenges posed by non-Euclidean parameter spaces frequently encountered in modern data science. Our approach…

Statistics Theory · Mathematics 2026-02-03 Chengzhu Huang , Anru R. Zhang

The symplectic Stiefel manifold, denoted by $\mathrm{Sp}(2p,2n)$, is the set of linear symplectic maps between the standard symplectic spaces $\mathbb{R}^{2p}$ and $\mathbb{R}^{2n}$. When $p=n$, it reduces to the well-known set of $2n\times…

Optimization and Control · Mathematics 2021-07-20 Bin Gao , Nguyen Thanh Son , P. -A. Absil , Tatjana Stykel

We consider the problem of reconstructing an embedding of a compact connected Riemannian manifold in a Euclidean space up to an almost isometry, given the information on intrinsic distances between points from its ``sufficiently large''…

Optimization and Control · Mathematics 2024-01-26 Nikita Puchkin , Vladimir Spokoiny , Eugene Stepanov , Dario Trevisan

In this paper, a descent method for nonsmooth multiobjective optimization problems on complete Riemannian manifolds is proposed. The objective functions are only assumed to be locally Lipschitz continuous instead of convexity used in…

Optimization and Control · Mathematics 2025-01-14 Chunming Tang , Hao He , Jinbao Jian , Miantao Chao

Solving the inverse kinematics problem is a fundamental challenge in motion planning, control, and calibration for articulated robots. Kinematic models for these robots are typically parametrized by joint angles, generating a complicated…

Robotics · Computer Science 2023-12-12 Filip Marić , Matthew Giamou , Adam W. Hall , Soroush Khoubyarian , Ivan Petrović , Jonathan Kelly

Smooth, non-convex optimization problems on Riemannian manifolds occur in machine learning as a result of orthonormality, rank or positivity constraints. First- and second-order necessary optimality conditions state that the Riemannian…

Optimization and Control · Mathematics 2019-10-24 Chris Criscitiello , Nicolas Boumal

Convex optimization is a well-established research area with applications in almost all fields. Over the decades, multiple approaches have been proposed to solve convex programs. The development of interior-point methods allowed solving a…

Optimization and Control · Mathematics 2020-01-08 Ahmed Douik , Babak Hassibi

Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both the lower and upper levels are constrained on Riemannian…

Optimization and Control · Mathematics 2024-11-05 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Akiko Takeda

We propose an extremely versatile approach to address a large family of matrix nearness problems, possibly with additional linear constraints. Our method is based on splitting a matrix nearness problem into two nested optimization problems,…

Numerical Analysis · Mathematics 2025-08-14 Miryam Gnazzo , Vanni Noferini , Lauri Nyman , Federico Poloni

There is extensive literature on accelerating first-order optimization methods in a Euclidean setting. Under which conditions such acceleration is feasible in Riemannian optimization problems is an active area of research. Motivated by the…

Optimization and Control · Mathematics 2025-09-23 Jiyoung Park , Abhishek Roy , Jonathan W. Siegel , Anirban Bhattacharya