English
Related papers

Related papers: Averaging on Manifolds by Embedding Algorithm

200 papers

The techniques and analysis presented in this thesis provide new methods to solve optimization problems posed on Riemannian manifolds. These methods are applied to the subspace tracking problem found in adaptive signal processing and…

Optimization and Control · Mathematics 2013-05-09 Steven Thomas Smith

Nonlinear embedding manifold learning methods provide invaluable visual insights into the structure of high-dimensional data. However, due to a complicated nonconvex objective function, these methods can easily get stuck in local minima and…

Machine Learning · Computer Science 2019-12-30 Max Vladymyrov

Many of the tools available for robot learning were designed for Euclidean data. However, many applications in robotics involve manifold-valued data. A common example is orientation; this can be represented as a 3-by-3 rotation matrix or a…

Robotics · Computer Science 2024-05-15 P. C. Lopez-Custodio , K. Bharath , A. Kucukyilmaz , S. P. Preston

We propose a general scheme for solving convex and non-convex optimization problems on manifolds. The central idea is that, by adding a multiple of the squared retraction distance to the objective function in question, we "convexify" the…

Computation · Statistics 2020-10-20 Lizhen Lin , Bayan Saparbayeva , Michael Minyi Zhang , David B. Dunson

Variance parameter estimation in linear mixed models is a challenge for many classical nonlinear optimization algorithms due to the positive-definiteness constraint of the random effects covariance matrix. We take a completely novel view on…

Machine Learning · Statistics 2022-12-20 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

Eigenvalue problems are fundamental to mathematics and science. We present a simple algorithm for determining eigenvalues and eigenfunctions of the Laplace--Beltrami operator on rather general curved surfaces. Our algorithm, which is based…

Numerical Analysis · Mathematics 2011-09-13 Colin B. Macdonald , Jeremy Brandman , Steven J. Ruuth

Manifold learning has been proven to be an effective method for capturing the implicitly intrinsic structure of non-Euclidean data, in which one of the primary challenges is how to maintain the distortion-free (isometry) of the data…

Machine Learning · Computer Science 2024-09-24 Zihao Chen , Wenyong Wang , Yu Xiang

This paper presents a new performance bound for estimation problems where the parameter to estimate lies in a Riemannian manifold (a smooth manifold endowed with a Riemannian metric) and follows a given prior distribution. In this setup,…

Statistics Theory · Mathematics 2024-09-10 Florent Bouchard , Alexandre Renaux , Guillaume Ginolhac , Arnaud Breloy

Optimization over the Stiefel manifold is a fundamental computational problem in many scientific and engineering applications. Despite considerable research effort, high-dimensional optimization problems over the Stiefel manifold remain…

Optimization and Control · Mathematics 2025-05-16 Andy Yat-Ming Cheung , Jinxin Wang , Man-Chung Yue , Anthony Man-Cho So

We consider in this paper an area functional defined on submanifolds of fixed degree immersed into a graded manifold equipped with a Riemannian metric. Since the expression of this area depends on the degree, not all variations are…

Differential Geometry · Mathematics 2021-12-21 Giovanna Citti , Gianmarco Giovannardi , Manuel Ritoré

Although many machine learning algorithms involve learning subspaces with particular characteristics, optimizing a parameter matrix that is constrained to represent a subspace can be challenging. One solution is to use Riemannian…

Machine Learning · Computer Science 2017-03-10 Stephen Giguere , Francisco Garcia , Sridhar Mahadevan

We propose a stochastic variance-reduced cubic regularized Newton algorithm to optimize the finite-sum problem over a Riemannian submanifold of the Euclidean space. The proposed algorithm requires a full gradient and Hessian update at the…

Optimization and Control · Mathematics 2022-12-14 Dewei Zhang , Sam Davanloo Tajbakhsh

Variational Bayes (VB) has become a widely-used tool for Bayesian inference in statistics and machine learning. Nonetheless, the development of the existing VB algorithms is so far generally restricted to the case where the variational…

Machine Learning · Computer Science 2021-08-04 Minh-Ngoc Tran , Dang H. Nguyen , Duy Nguyen

The present research work proposes a new fast fixed-point averaging algorithm on the compact Stiefel manifold based on a mixed retraction/lifting pair. Numerical comparisons between fixed-point algorithms based on the proposed…

Numerical Analysis · Mathematics 2013-03-08 Simone Fiori , Tetsuya Kaneko , Toshihisa Tanaka

The space of embedded submanifolds plays an important role in applications such as computational anatomy and shape analysis. We can define two different classes on Riemannian metrics on this space: so-called outer metrics are metrics that…

Differential Geometry · Mathematics 2017-09-19 Martins Bruveris

Classical optimization is a cornerstone of the success of variational quantum algorithms, which often require determining the derivatives of the cost function relative to variational parameters. The computation of the cost function and its…

Quantum Physics · Physics 2025-07-15 Muhammad Umer , Eleftherios Mastorakis , Dimitris G. Angelakis

We study a continuous-time system that solves optimization problems over the set of orthonormal matrices, which is also known as the Stiefel manifold. The resulting optimization flow follows a path that is not always on the manifold but…

Optimization and Control · Mathematics 2022-08-02 Bin Gao , Simon Vary , Pierre Ablin , P. -A. Absil

Many machine learning problems involve regressing variables on a non-Euclidean manifold -- e.g. a discrete probability distribution, or the 6D pose of an object. One way to tackle these problems through gradient-based learning is to use a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Romain Brégier

Under the data manifold hypothesis, high-dimensional data are concentrated near a low-dimensional manifold. We study the problem of Riemannian optimization over such manifolds when they are given only implicitly through the data…

Machine Learning · Computer Science 2026-03-03 Andrey Kharitenko , Zebang Shen , Riccardo de Santi , Niao He , Florian Doerfler

Maps from a source manifold $ {\mathcal M}$ to a target manifold ${\mathcal N}$ appear in liquid crystals, colour image enhancement, texture mapping, brain mapping, and many other areas. A numerical framework to solve variational problems…

Numerical Analysis · Mathematics 2017-10-27 Nathan D. King , Steven J. Ruuth
‹ Prev 1 3 4 5 6 7 10 Next ›