English
Related papers

Related papers: Differential Evolution for Grassmann Manifold Opti…

200 papers

We propose a conjugate gradient type optimization technique for the computation of the Karcher mean on the set of complex linear subspaces of fixed dimension, modeled by the so-called Grassmannian. The identification of the Grassmannian…

Differential Geometry · Mathematics 2012-09-17 Knut Hüper , Martin Kleinsteuber , Hao Shen

We propose Riemannian Denoising Diffusion Probabilistic Models (RDDPMs) for learning distributions on submanifolds of Euclidean space that are level sets of functions, including most of the manifolds relevant to applications. Existing…

Machine Learning · Computer Science 2026-02-17 Zichen Liu , Wei Zhang , Christof Schütte , Tiejun Li

In the paper, we study a class of useful minimax problems on Riemanian manifolds and propose a class of effective Riemanian gradient-based methods to solve these minimax problems. Specifically, we propose an effective Riemannian gradient…

Machine Learning · Computer Science 2023-01-04 Feihu Huang , Shangqian Gao

This paper investigates structure-preserving $H_2$-optimal model order reduction (MOR) for linear systems with quadratic outputs. Within a Petrov-Galerkin projection framework, the $H_2$-optimal MOR problem is first formulated as an…

Optimization and Control · Mathematics 2025-08-19 Xiaolong Wang , Chenglong Liu , Tongtu Tian

We study stochastic projection-free methods for constrained optimization of smooth functions on Riemannian manifolds, i.e., with additional constraints beyond the parameter domain being a manifold. Specifically, we introduce stochastic…

Optimization and Control · Mathematics 2021-04-06 Melanie Weber , Suvrit Sra

We develop Riemannian Stein Variational Gradient Descent (RSVGD), a Bayesian inference method that generalizes Stein Variational Gradient Descent (SVGD) to Riemann manifold. The benefits are two-folds: (i) for inference tasks in Euclidean…

Machine Learning · Statistics 2017-12-01 Chang Liu , Jun Zhu

The theory of optimal design of experiments has been traditionally developed on an Euclidean space. In this paper, new theoretical results and an algorithm for finding the optimal design of an experiment located on a Riemannian manifold are…

Statistics Theory · Mathematics 2023-02-03 Hang Li , Enrique Del Castillo

This study presents a population-based evolutionary optimization algorithm (Adaptive Differential Evolution with Diversification Strategies or ADEDS). The algorithm developed using the sinusoidal objective function and subsequently…

Neural and Evolutionary Computing · Computer Science 2023-10-09 Sarit Maitra

In this work, multi-variable derivative-free optimization algorithms for unconstrained optimization problems are developed. A novel procedure for approximating the gradient of multi-variable objective functions based on non-commutative maps…

Optimization and Control · Mathematics 2021-11-17 Jan Feiling , Mohamed-Ali Belabbas , Christian Ebenbauer

This paper exploits a basic connection between sequential quadratic programming and Riemannian gradient optimization to address the general question of selecting a metric in Riemannian optimization, in particular when the Riemannian…

Optimization and Control · Mathematics 2016-03-10 Bamdev Mishra , Rodolphe Sepulchre

There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors $D$ is large, one encounters a daunting problem in attempting to estimate a $D$-dimensional surface…

Statistics Theory · Mathematics 2014-06-17 Yun Yang , David B. Dunson

Many real-world datasets live on high-dimensional Stiefel and Grassmannian manifolds, $V_k(\mathbb{R}^N)$ and $Gr(k, \mathbb{R}^N)$ respectively, and benefit from projection onto lower-dimensional Stiefel and Grassmannian manifolds. In this…

Computational Geometry · Computer Science 2025-04-16 Andrew Lee , Harlin Lee , Jose A. Perea , Nikolas Schonsheck , Madeleine Weinstein

Minimal and efficient graph representations are key to store, communicate, and sample the search space of graphs and networks while meeting user-defined criteria. In this paper, we investigate the feasibility of gradient-free optimization…

Discrete Mathematics · Computer Science 2023-12-15 Victor Parque , Tomoyuki Miyashita

This paper proposes novel algorithm for non-convex multimodal constrained optimisation problems. It is based on sequential solving restrictions of problem to sections of feasible set by random subspaces (in general, manifolds) of low…

Optimization and Control · Mathematics 2023-03-28 Dmitry A. Pasechnyuk , Alexander Gornov

Riemannian submanifold optimization with momentum is computationally challenging because, to ensure that the iterates remain on the submanifold, we often need to solve difficult differential equations. Here, we simplify such difficulties…

Machine Learning · Statistics 2024-03-19 Wu Lin , Valentin Duruisseaux , Melvin Leok , Frank Nielsen , Mohammad Emtiyaz Khan , Mark Schmidt

We present a Riemannian optimization framework for Hartree-Fock theory formulated directly in the Sobolev space $H^1$. The orthonormality constraints are interpreted geometrically via infinite-dimensional Stiefel and Grassmann manifolds…

Quantum Physics · Physics 2026-03-18 Evgueni Dinvay

The dynamic mode decomposition (DMD) has become a leading tool for data-driven modeling of dynamical systems, providing a regression framework for fitting linear dynamical models to time-series measurement data. We present a simple…

Numerical Analysis · Mathematics 2017-04-11 Travis Askham , J. Nathan Kutz

Graphs are ubiquitous in social networks and biochemistry, where Graph Neural Networks (GNN) are the state-of-the-art models for prediction. Graphs can be evolving and it is vital to formally model and understand how a trained GNN responds…

Machine Learning · Computer Science 2024-03-12 Yazheng Liu , Xi Zhang , Sihong Xie

We study optimization problems on Hadamard manifolds, motivated by recent advances in geometric approaches to optimization on curved spaces, particularly those involving the structure of Busemann functions. We introduce a projection based…

Optimization and Control · Mathematics 2026-03-03 R. Díaz Millán , O. P. Ferreira , M. S. Louzeiro , J. Ugon

We introduce a generalized Rayleigh-quotient on the tensor product of Grassmannians enabling a unified approach to well-known optimization tasks from different areas of numerical linear algebra, such as best low-rank approximations of…

Optimization and Control · Mathematics 2011-12-01 O. Curtef , G. Dirr , U. Helmke