English
Related papers

Related papers: A gradient flow method for smooth splines versus l…

200 papers

The scarcity of labeled data is a long-standing challenge for many machine learning tasks. We propose our gradient flow method to leverage the existing dataset (i.e., source) to generate new samples that are close to the dataset of interest…

Machine Learning · Computer Science 2023-11-06 Xinru Hua , Truyen Nguyen , Tam Le , Jose Blanchet , Viet Anh Nguyen

Adaptive stochastic gradient algorithms in the Euclidean space have attracted much attention lately. Such explorations on Riemannian manifolds, on the other hand, are relatively new, limited, and challenging. This is because of the…

Machine Learning · Computer Science 2019-07-01 Hiroyuki Kasai , Pratik Jawanpuria , Bamdev Mishra

To predict smooth physical phenomena from observations, spline interpolation provides an interpretable framework by minimizing an energy functional associated with the Laplacian operator. This work proposes a methodology to construct a…

Computation · Statistics 2026-03-26 Charlie Sire , Mike Pereira

This paper concerns an extension of discrete gradient methods to finite-dimensional Riemannian manifolds termed discrete Riemannian gradients, and their application to dissipative ordinary differential equations. This includes Riemannian…

Numerical Analysis · Mathematics 2018-10-10 Elena Celledoni , Sølve Eidnes , Brynjulf Owren , Torbjørn Ringholm

We address the problem of fitting parametric curves on the Grassmann manifold for the purpose of intrinsic parametric regression. As customary in the literature, we start from the energy minimization formulation of linear least-squares in…

Computer Vision and Pattern Recognition · Computer Science 2015-05-15 Yi Hong , Nikhil Singh , Roland Kwitt , Nuno Vasconcelos , Marc Niethammer

The capability to accurately predict flood flows via numerical simulations is a key component of contemporary flood risk management practice. However, modern flood models lack the capacity to accurately model flow interactions with linear…

Fluid Dynamics · Physics 2024-12-09 James Mckenna , Vassilis Glenis , Chris Kilsby

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

We study a continuous-time system that solves optimization problems over the set of orthonormal matrices, which is also known as the Stiefel manifold. The resulting optimization flow follows a path that is not always on the manifold but…

Optimization and Control · Mathematics 2022-08-02 Bin Gao , Simon Vary , Pierre Ablin , P. -A. Absil

This paper considers optimization problems on Riemannian manifolds and analyzes iteration-complexity for gradient and subgradient methods on manifolds with non-negative curvature. By using tools from the Riemannian convex analysis and…

Numerical Analysis · Mathematics 2016-09-19 G. C. Bento , O. P. Ferreira , J. G. Melo

In this paper, we introduce the notion of generalized $\epsilon$-stationarity for a class of nonconvex and nonsmooth composite minimization problems on compact Riemannian submanifold embedded in Euclidean space. To find a generalized…

Optimization and Control · Mathematics 2023-10-31 Zheng Peng , Weihe Wu , Jiang Hu , Kangkang Deng

Recently, a Riemannian proximal Newton method has been developed for optimizing problems in the form of $\min_{x\in\mathcal{M}} f(x) + \mu \|x\|_1$, where $\mathcal{M}$ is a compact embedded submanifold and $f(x)$ is smooth. Although this…

Optimization and Control · Mathematics 2025-03-25 Wen Huang , Wutao Si

Graph-based multi-view spectral clustering methods have achieved notable progress recently, yet they often fall short in either oversimplifying pairwise relationships or struggling with inefficient spectral decompositions in…

Machine Learning · Computer Science 2025-11-14 Murong Yang , Shihui Ying , Xin-Jian Xu , Yue Gao

We study the convergence of gradient flows related to learning deep linear neural networks (where the activation function is the identity map) from data. In this case, the composition of the network layers amounts to simply multiplying the…

Optimization and Control · Mathematics 2020-10-16 Bubacarr Bah , Holger Rauhut , Ulrich Terstiege , Michael Westdickenberg

There has been increasing interest in statistical analysis of data lying in manifolds. This paper generalizes a smoothing spline fitting method to Riemannian manifold data based on the technique of unrolling and unwrapping originally…

Methodology · Statistics 2020-09-17 Kwang-Rae Kim , Ian L. Dryden , Huiling Le , Katie E. Severn

In this paper, we consider the problem of minimizing a smooth function on a Riemannian manifold and present a Riemannian gradient method with momentum. The proposed algorithm represents a substantial and nontrivial extension of a recently…

Optimization and Control · Mathematics 2026-03-05 Filippo Leggio , Diego Scuppa

We consider the optimization problem with a generally quadratic matrix constraint of the form $X^TAX = J$, where $A$ is a given nonsingular, symmetric $n\times n$ matrix and $J$ is a given $k\times k$ symmetric matrix, with $k\leq n$,…

Optimization and Control · Mathematics 2026-05-26 Dinh Van Tiep , Nguyen Thanh Son

In this paper, we address the problem of optimizing flows on generalized graphs that feature multiple entry points and multiple populations, each with varying cost structures. We tackle this problem by considering the multi-population…

Systems and Control · Electrical Eng. & Systems 2025-04-23 Tigran Bakaryan , Christoph Aoun , Ricardo de Lima Ribeiro , Naira Hovakimyan , Diogo Gomes

Flow matching is a scalable generative framework for characterizing continuous normalizing flows with wide-range applications. However, current state-of-the-art methods are not well-suited for modeling dynamical systems, as they construct…

Machine Learning · Computer Science 2026-05-15 Santanu Subhash Rathod , Pietro Liò , Xiao Zhang

We present variational approximations of boundary value problems for curvature flow (curve shortening flow) and elastic flow (curve straightening flow) in two-dimensional Riemannian manifolds that are conformally flat. For the evolving open…

Numerical Analysis · Mathematics 2021-11-03 Harald Garcke , Robert Nürnberg

Gradient descent methods are fundamental first-order optimization algorithms in both Euclidean spaces and Riemannian manifolds. However, the exact gradient is not readily available in many scenarios. This paper proposes a novel inexact…

Optimization and Control · Mathematics 2024-09-18 Juan Zhou , Kangkang Deng , Hongxia Wang , Zheng Peng