English
Related papers

Related papers: Geoopt: Riemannian Optimization in PyTorch

200 papers

When learning policies for robotic systems from data, safety is a major concern, as violation of safety constraints may cause hardware damage. SafeOpt is an efficient Bayesian optimization (BO) algorithm that can learn policies while…

Robotics · Computer Science 2021-05-28 Dominik Baumann , Alonso Marco , Matteo Turchetta , Sebastian Trimpe

Several first order stochastic optimization methods commonly used in the Euclidean domain such as stochastic gradient descent (SGD), accelerated gradient descent or variance reduced methods have already been adapted to certain Riemannian…

Machine Learning · Computer Science 2019-02-19 Gary Bécigneul , Octavian-Eugen Ganea

Optimal transport tools (OTT-JAX) is a Python toolbox that can solve optimal transport problems between point clouds and histograms. The toolbox builds on various JAX features, such as automatic and custom reverse mode differentiation,…

Machine Learning · Computer Science 2022-01-31 Marco Cuturi , Laetitia Meng-Papaxanthos , Yingtao Tian , Charlotte Bunne , Geoff Davis , Olivier Teboul

This article deals with the conjugate gradient method on a Riemannian manifold with interest in global convergence analysis. The existing conjugate gradient algorithms on a manifold endowed with a vector transport need the assumption that…

Optimization and Control · Mathematics 2016-06-20 Hiroyuki Sato , Toshihiro Iwai

We consider the fundamental task of optimising a real-valued function defined in a potentially high-dimensional Euclidean space, such as the loss function in many machine-learning tasks or the logarithm of the probability distribution in…

Machine Learning · Statistics 2024-03-20 Marcelo Hartmann , Bernardo Williams , Hanlin Yu , Mark Girolami , Alessandro Barp , Arto Klami

This paper introduces the generalized quaternionic Stiefel manifold and studies its geometry for Riemannian optimization. We clarify its relationships with existing manifolds, especially the real generalized Stiefel manifold and the…

Optimization and Control · Mathematics 2026-03-17 Hiroyuki Sato

In this paper we propose a multigrid optimization algorithm (MG/OPT) for the numerical solution of a class of quasilinear variational inequalities of the second kind. This approach is enabled by the fact that the solution of the variational…

Numerical Analysis · Mathematics 2022-05-24 Sergio González-Andrade , Sofía López

Gaussian Processes (GPs) are flexible, nonparametric Bayesian models widely used for regression and classification because of their ability to capture complex data patterns and quantify predictive uncertainty. However, the O(n^3)…

Machine Learning · Computer Science 2026-01-14 Hua Huang , Tianshi Xu , Yuanzhe Xi , Edmond Chow

This paper presents a novel on-line path planning method that enables aerial robots to interact with surfaces. We present a solution to the problem of finding trajectories that drive a robot towards a surface and move along it. Triangular…

Robotics · Computer Science 2021-02-23 Michael Pantic , Lionel Ott , Cesar Cadena , Roland Siegwart , Juan Nieto

A primary challenge in using neural networks to approximate nonlinear dynamical systems governed by partial differential equations (PDEs) lies in recasting these systems into a tractable representation particularly when the dynamics are…

Machine Learning · Computer Science 2026-02-10 Pengyu Lai , Yixiao Chen , Dewu Yang , Rui Wang , Feng Wang , Hui Xu

Shape optimization is commonly applied in engineering to optimize shapes with respect to an objective functional relying on PDE solutions. In this paper, we view shape optimization as optimization on Riemannian shape manifolds. We consider…

Optimization and Control · Mathematics 2025-04-09 Estefania Loayza-Romero , Kathrin Welker

This paper considers a stochastic optimization problem over the fixed point sets of quasinonexpansive mappings on Riemannian manifolds. The problem enables us to consider Riemannian hierarchical optimization problems over complicated sets,…

Optimization and Control · Mathematics 2020-12-18 Hideaki Iiduka , Hiroyuki Sakai

The Euclidean space notion of convex sets (and functions) generalizes to Riemannian manifolds in a natural sense and is called geodesic convexity. Extensively studied computational problems such as convex optimization and sampling in convex…

Optimization and Control · Mathematics 2020-02-10 Navin Goyal , Abhishek Shetty

Riemannian geometry is a mathematical field which has been the cornerstone of revolutionary scientific discoveries such as the theory of general relativity. Despite early uses in robot design and recent applications for exploiting data with…

Robotics · Computer Science 2022-10-03 Noémie Jaquier , Tamim Asfour

Riemannian optimization has drawn a lot of attention due to its wide applications in practice. Riemannian stochastic first-order algorithms have been studied in the literature to solve large-scale machine learning problems over Riemannian…

Optimization and Control · Mathematics 2022-03-22 Bokun Wang , Shiqian Ma , Lingzhou Xue

Manifold learning has been proven to be an effective method for capturing the implicitly intrinsic structure of non-Euclidean data, in which one of the primary challenges is how to maintain the distortion-free (isometry) of the data…

Machine Learning · Computer Science 2024-09-24 Zihao Chen , Wenyong Wang , Yu Xiang

This paper proposes an original Riemmanian geometry for low-rank structured elliptical models, i.e., when samples are elliptically distributed with a covariance matrix that has a low-rank plus identity structure. The considered geometry is…

Differential Geometry · Mathematics 2020-01-07 Florent Bouchard , Arnaud Breloy , Guillaume Ginolhac , Alexandre Renaux , Frédéric Pascal

Euclidean gradient descent algorithms barely capture the geometry of objective function-induced hypersurfaces and risk driving update trajectories off the hypersurfaces. Riemannian gradient descent algorithms address these issues but fail…

Machine Learning · Computer Science 2026-03-10 Liwei Hu , Guangyao Li , Wenyong Wang , Xiaoming Zhang , Yu Xiang

Large language models have seen widespread adoption in math problem-solving. However, in geometry problems that usually require visual aids for better understanding, even the most advanced multi-modal models currently still face challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Shihao Cai , Keqin Bao , Hangyu Guo , Jizhi Zhang , Jun Song , Bo Zheng

Automated Machine Learning encompasses a set of meta-algorithms intended to design and apply machine learning techniques (e.g., model selection, hyperparameter tuning, model assessment, etc.). TPOT, a software for optimizing machine…

Machine Learning · Computer Science 2018-01-16 Unai Garciarena , Alexander Mendiburu , Roberto Santana