English
Related papers

Related papers: A diffusion-map-based algorithm for gradient compu…

200 papers

Stochastic variance reduction algorithms have recently become popular for minimizing the average of a large, but finite, number of loss functions. In this paper, we propose a novel Riemannian extension of the Euclidean stochastic variance…

Machine Learning · Computer Science 2017-04-11 Hiroyuki Kasai , Hiroyuki Sato , Bamdev Mishra

We develop a computational approach to locate the source of a steady-state gradient of diffusing particles from the fluxes through narrow windows distributed either on the boundary of a three dimensional half-space or on a sphere. This…

Statistical Mechanics · Physics 2020-01-07 U. Dobramysl , D. Holcman

This paper investigates the formulation and implementation of Bayesian inverse problems to learn input parameters of partial differential equations (PDEs) defined on manifolds. Specifically, we study the inverse problem of determining the…

Numerical Analysis · Mathematics 2019-10-24 John Harlim , Daniel Sanz-Alonso , Ruiyi Yang

We address the problem of setting the kernel bandwidth used by Manifold Learning algorithms to construct the graph Laplacian. Exploiting the connection between manifold geometry, represented by the Riemannian metric, and the…

Machine Learning · Statistics 2014-06-03 Dominique Perrault-Joncas , Marina Meila

We present a generative learning framework for probabilistic sampling based on an extension of the Probabilistic Learning on Manifolds (PLoM) approach, which is designed to generate statistically consistent realizations of a random vector…

Machine Learning · Statistics 2025-06-04 Dimitris G Giovanis , Nikolaos Evangelou , Ioannis G Kevrekidis , Roger G Ghanem

We present a Riemannian optimization framework for Hartree-Fock theory formulated directly in the Sobolev space $H^1$. The orthonormality constraints are interpreted geometrically via infinite-dimensional Stiefel and Grassmann manifolds…

Quantum Physics · Physics 2026-03-18 Evgueni Dinvay

In this paper, we propose a general methodology for sampling from un-normalized densities defined on Riemannian manifolds, with a particular focus on multi-modal targets that remain challenging for existing sampling methods. Inspired by the…

Machine Learning · Statistics 2026-02-03 Alain Durmus , Maxence Noble , Thibaut Pellerin

Calculus and geometry are ubiquitous in the theoretical modelling of scientific phenomena, but have historically been very challenging to apply directly to real data as statistics. Diffusion geometry is a new theory that reformulates…

Differential Geometry · Mathematics 2026-02-09 Iolo Jones , David Lanners

Latent variable models are powerful tools for learning low-dimensional manifolds from high-dimensional data. However, when dealing with constrained data such as unit-norm vectors or symmetric positive-definite matrices, existing approaches…

Machine Learning · Computer Science 2025-03-10 Leonel Rozo , Miguel González-Duque , Noémie Jaquier , Søren Hauberg

Representing graphs as sets of node embeddings in certain curved Riemannian manifolds has recently gained momentum in machine learning due to their desirable geometric inductive biases, e.g., hierarchical structures benefit from hyperbolic…

Machine Learning · Computer Science 2020-06-09 Calin Cruceru , Gary Bécigneul , Octavian-Eugen Ganea

Many machine learning problems involve regressing variables on a non-Euclidean manifold -- e.g. a discrete probability distribution, or the 6D pose of an object. One way to tackle these problems through gradient-based learning is to use a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Romain Brégier

A variational formulation for accelerated optimization on normed vector spaces was recently introduced in Wibisono et al., and later generalized to the Riemannian manifold setting in Duruisseaux and Leok. This variational framework was…

Numerical Analysis · Mathematics 2022-05-18 Valentin Duruisseaux , Melvin Leok

This paper formulates the problem of Extremum Seeking for optimization of cost functions defined on Riemannian manifolds. We extend the conventional extremum seeking algorithms for optimization problems in Euclidean spaces to optimization…

Optimization and Control · Mathematics 2014-12-10 Farzin Taringoo , Peter M. Dower , Dragan Nesic , Ying Tan

Representation learning is a widely adopted framework for learning in data-scarce environments to obtain a feature extractor or representation from various different yet related tasks. Despite extensive research on representation learning,…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

The techniques and analysis presented in this thesis provide new methods to solve optimization problems posed on Riemannian manifolds. These methods are applied to the subspace tracking problem found in adaptive signal processing and…

Optimization and Control · Mathematics 2013-05-09 Steven Thomas Smith

Addressing real-world optimization problems becomes particularly challenging when analytic objective functions or constraints are unavailable. While numerous studies have addressed the issue of unknown objectives, limited research has…

This paper presents a Riemannian metric-based model to solve the optimal path planning problem on two-dimensional smooth submanifolds in high-dimensional space. Our model is based on constructing a new Riemannian metric on a two-dimensional…

Robotics · Computer Science 2025-07-03 Yu Zhang , Qi Zhou , Xiao-Song Yang

In the present work we studied a subfield of Applied Mathematics called Riemannian Optimization. The main goal of this subfield is to generalize algorithms, theorems and tools from Mathematical Optimization to the case in which the…

Optimization and Control · Mathematics 2024-03-25 Caio O. da Silva

In this paper, we propose nonlinear conjugate gradient methods for vector optimization on Riemannian manifolds. The concepts of Wolfe and Zoutendjik conditions are extended for Riemannian manifolds. Specifically, we establish the existence…

Optimization and Control · Mathematics 2025-09-03 Kangming Chen , Ellen H. Fukuda , Hiroyuki Sato

Score-based generative models exhibit state of the art performance on density estimation and generative modeling tasks. These models typically assume that the data geometry is flat, yet recent extensions have been developed to synthesize…