English
Related papers

Related papers: A Framework for Population-Based Stochastic Optimi…

200 papers

This paper introduces smoothed pseudo-population bootstrap methods for the purposes of variance estimation and the construction of confidence intervals for finite population quantiles. In an i.i.d. context, it has been shown that resampling…

Methodology · Statistics 2025-09-30 Vanessa McNealis , Christian Léger

Optimization over the embedded submanifold defined by constraints $c(x) = 0$ has attracted much interest over the past few decades due to its wide applications in various areas. Plenty of related optimization packages have been developed…

Optimization and Control · Mathematics 2024-10-15 Nachuan Xiao , Xiaoyin Hu , Xin Liu , Kim-Chuan Toh

We extend decision tree and random forest algorithms to product space manifolds: Cartesian products of Euclidean, hyperspherical, and hyperbolic manifolds. Such spaces have extremely expressive geometries capable of representing many…

Machine Learning · Computer Science 2025-05-08 Philippe Chlenski , Quentin Chu , Itsik Pe'er

The last decade has witnessed an explosion in the development of models, theory and computational algorithms for "big data" analysis. In particular, distributed computing has served as a natural and dominating paradigm for statistical…

Machine Learning · Statistics 2018-11-02 Bayan Saparbayeva , Michael Minyi Zhang , Lizhen Lin

Low-rank optimization problems with sparse simplex constraints involve variables that must satisfy nonnegativity, sparsity, and sum-to-1 conditions, making their optimization particularly challenging due to the interplay between low-rank…

Optimization and Control · Mathematics 2026-03-24 Flavia Esposito , Andersen Ang

Asymptotic efficiency theory is one of the pillars in the foundations of modern mathematical statistics. Not only does it serve as a rigorous theoretical benchmark for evaluating statistical methods, but it also sheds light on how to…

Statistics Theory · Mathematics 2025-10-16 Lvfang Sun , Zhenhua Lin , Lin Liu

Stochastic minimax optimization on Riemannian manifolds has recently attracted significant attention due to its broad range of applications, such as robust training of neural networks and robust maximum likelihood estimation. Existing…

Optimization and Control · Mathematics 2026-02-11 Hongye Wang , Chang He , Bo Jiang

This paper presents tensorflow-riemopt, a Python library for geometric machine learning in TensorFlow. The library provides efficient implementations of neural network layers with manifold-constrained parameters, geometric operations on…

Mathematical Software · Computer Science 2025-12-18 Oleg Smirnov

How can one analyze detailed 3D biological objects, such as neurons and botanical trees, that exhibit complex geometrical and topological variation? In this paper, we develop a novel mathematical framework for representing, comparing, and…

Machine Learning · Computer Science 2023-11-28 Guan Wang , Hamid Laga , Anuj Srivastava

This entry contains the core material of my habilitation thesis, soon to be officially submitted. It provides a self-contained presentation of the original results in this thesis, in addition to their detailed proofs. The motivation of…

Statistics Theory · Mathematics 2021-01-27 Salem Said

We present Riemannian Gaussian Variational Flow Matching (RG-VFM), a geometric extension of Variational Flow Matching (VFM) for generative modeling on manifolds. Motivated by the benefits of VFM, we derive a variational flow matching…

Machine Learning · Computer Science 2026-03-13 Olga Zaghen , Floor Eijkelboom , Alison Pouplin , Cong Liu , Max Welling , Jan-Willem van de Meent , Erik J. Bekkers

We introduce Random Projection Flows (RPFs), a principled framework for injective normalizing flows that leverages tools from random matrix theory and the geometry of random projections. RPFs employ random semi-orthogonal matrices, drawn…

Machine Learning · Computer Science 2025-11-26 Ahmad Ayaz Amin , Baha Uddin Kazi

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

In this dissertation, an abstract formalism extending information geometry is introduced. This framework encompasses a broad range of modelling problems, including possible applications in machine learning and in the information theoretical…

Mathematical Physics · Physics 2015-01-06 Ben Anthonis

Orthogonality constraints naturally appear in many machine learning problems, from principal component analysis to robust neural network training. They are usually solved using Riemannian optimization algorithms, which minimize the…

Machine Learning · Statistics 2025-08-08 Pierre Ablin , Simon Vary , Bin Gao , P. -A. Absil

The problem of finding suitable point embedding or geometric configurations given only Euclidean distance information of point pairs arises both as a core task and as a sub-problem in a variety of machine learning applications. In this…

Machine Learning · Computer Science 2024-10-23 Ipsita Ghosh , Abiy Tasissa , Christian Kümmerle

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

This paper addresses the computational challenges in reliability-based topology optimization (RBTO) of structures associated with the estimation of statistics of the objective and constraints using standard sampling methods, and overcomes…

Optimization and Control · Mathematics 2021-07-27 Subhayan De , Kurt Maute , Alireza Doostan

The Riemannian barycentre is one of the most widely used statistical descriptors for probability distributions on Riemannian manifolds. At present, existing algorithms are able to compute the Riemannian barycentre of a probability…

Probability · Mathematics 2020-02-26 Salem Said

Representing images and videos with Symmetric Positive Definite (SPD) matrices, and considering the Riemannian geometry of the resulting space, has been shown to yield high discriminative power in many visual recognition tasks.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-23 Mehrtash Harandi , Mathieu Salzmann , Richard Hartley