English
Related papers

Related papers: A diffusion-map-based algorithm for gradient compu…

200 papers

Decentralized optimization on Riemannian manifolds is foundational for many modern machine learning and signal processing applications in which data are non-Euclidean and generated and processed in a distributed manner. Although intrinsic…

Optimization and Control · Mathematics 2026-03-19 Duc Toan Nguyen , César A. Uribe

This work puts forth low-complexity Riemannian subspace descent algorithms for the minimization of functions over the symmetric positive definite (SPD) manifold. Different from the existing Riemannian gradient descent variants, the proposed…

Machine Learning · Statistics 2023-12-19 Yogesh Darmwal , Ketan Rajawat

In this paper, we extend the class of kernel methods, the so-called diffusion maps (DM) and ghost point diffusion maps (GPDM), to solve the time-dependent advection-diffusion PDE on unknown smooth manifolds without and with boundaries. The…

Numerical Analysis · Mathematics 2021-05-31 Qile Yan , Shixiao Willing Jiang , John Harlim

We consider a class of (possibly strongly) geodesically convex optimization problems on Hadamard manifolds, where the objective function splits into the sum of a smooth and a possibly nonsmooth function. We introduce an intrinsic convex…

Optimization and Control · Mathematics 2025-07-23 Ronny Bergmann , Hajg Jasa , Paula John , Max Pfeffer

We consider a class of nonsmooth optimization problems over the Stiefel manifold, in which the objective function is weakly convex in the ambient Euclidean space. Such problems are ubiquitous in engineering applications but still largely…

Optimization and Control · Mathematics 2021-03-26 Xiao Li , Shixiang Chen , Zengde Deng , Qing Qu , Zhihui Zhu , Anthony Man Cho So

We consider optimization problems on manifolds with equality and inequality constraints. A large body of work treats constrained optimization in Euclidean spaces. In this work, we consider extensions of existing algorithms from the…

Optimization and Control · Mathematics 2019-04-26 Changshuo Liu , Nicolas Boumal

In this paper, we propose a Riemannian smoothing steepest descent method to minimize a nonconvex and non-Lipschitz function on submanifolds. The generalized subdifferentials on Riemannian manifold and the Riemannian gradient sub-consistency…

Optimization and Control · Mathematics 2021-04-12 Chao Zhang , Xiaojun Chen , Shiqian Ma

We consider a parabolic equation driven by a nonlinear diffusive operator and we obtain a gradient estimate in the domain where the equation takes place. This estimate depends on the structural constants of the equation, on the geometry of…

Analysis of PDEs · Mathematics 2021-02-08 Serena Dipierro , Zu Gao , Enrico Valdinoci

We will propose a new algorithm for finding critical points of cost functions defined on a differential manifold. We will lift the initial cost function to a manifold that can be embedded in a Riemannian manifold (Euclidean space) and will…

Optimization and Control · Mathematics 2018-09-05 Petre Birtea , Dan Comănescu , Călin-Adrian Popa

We introduce Hodge Diffusion Maps, a novel manifold learning algorithm designed to analyze and extract topological information from high-dimensional data-sets. This method approximates the exterior derivative acting on differential forms,…

Machine Learning · Computer Science 2025-04-11 Alvaro Almeida Gomez , Jorge Duque Franco

The symplectic Stiefel manifold, denoted by $\mathrm{Sp}(2p,2n)$, is the set of linear symplectic maps between the standard symplectic spaces $\mathbb{R}^{2p}$ and $\mathbb{R}^{2n}$. When $p=n$, it reduces to the well-known set of $2n\times…

Optimization and Control · Mathematics 2021-07-13 Bin Gao , Nguyen Thanh Son , P. -A. Absil , Tatjana Stykel

The conjugate gradient method is a crucial first-order optimization method that generally converges faster than the steepest descent method, and its computational cost is much lower than that of second-order methods. However, while various…

Optimization and Control · Mathematics 2024-03-13 Jun Chen , Haishan Ye , Mengmeng Wang , Tianxin Huang , Guang Dai , Ivor W. Tsang , Yong Liu

The manifold scattering transform is a deep feature extractor for data defined on a Riemannian manifold. It is one of the first examples of extending convolutional neural network-like operators to general manifolds. The initial work on this…

Eigenvalue problems are fundamental to mathematics and science. We present a simple algorithm for determining eigenvalues and eigenfunctions of the Laplace--Beltrami operator on rather general curved surfaces. Our algorithm, which is based…

Numerical Analysis · Mathematics 2011-09-13 Colin B. Macdonald , Jeremy Brandman , Steven J. Ruuth

In this paper, we present an adaptive gradient descent method for geodesically convex optimization on a Riemannian manifold with nonnegative sectional curvature. The method automatically adapts to the local geometry of the function and does…

Optimization and Control · Mathematics 2025-09-16 Aban Ansari-Önnestam , Yura Malitsky

This work introduces the Grassmannian Diffusion Maps, a novel nonlinear dimensionality reduction technique that defines the affinity between points through their representation as low-dimensional subspaces corresponding to points on the…

Machine Learning · Computer Science 2021-06-02 K. R. M. dos Santos , D. G. Giovanis , M. D. Shields

Consensus algorithms are popular distributed algorithms for computing aggregate quantities, such as averages, in ad-hoc wireless networks. However, existing algorithms mostly address the case where the measurements lie in a Euclidean space.…

Dynamical Systems · Mathematics 2012-02-02 Roberto Tron , Bijan Afsari , René Vidal

We describe the first gradient methods on Riemannian manifolds to achieve accelerated rates in the non-convex case. Under Lipschitz assumptions on the Riemannian gradient and Hessian of the cost function, these methods find approximate…

Optimization and Control · Mathematics 2021-11-29 Christopher Criscitiello , Nicolas Boumal

In this paper, the Riemannian gradient algorithm and the natural gradient algorithm are applied to solve descent direction problems on the manifold of positive definite Hermitian matrices, where the geodesic distance is considered as the…

Optimization and Control · Mathematics 2021-06-01 Xiaomin Duan , Huafei Sun , Linyu Peng

The affine Grassmannian is a noncompact smooth manifold that parameterizes all affine subspaces of a fixed dimension. It is a natural generalization of Euclidean space, points being zero-dimensional affine subspaces. We will realize the…

Methodology · Statistics 2018-06-26 Lek-Heng Lim , Ken Sze-Wai Wong , Ke Ye