中文
相关论文

相关论文: Optimal transport natural gradient for statistical…

200 篇论文

Optimal Transport (OT) metrics allow for defining discrepancies between two probability measures. Wasserstein distance is for longer the celebrated OT-distance frequently-used in the literature, which seeks probability distributions to be…

机器学习 · 计算机科学 2021-10-14 Mokhtar Z. Alaya , Gilles Gasso , Maxime Berar , Alain Rakotomamonjy

We introduce and study a novel model-selection strategy for Bayesian learning, based on optimal transport, along with its associated predictive posterior law: the Wasserstein population barycenter of the posterior law over models. We first…

机器学习 · 统计学 2022-11-10 Julio Backhoff-Veraguas , Joaquin Fontbona , Gonzalo Rios , Felipe Tobar

The proximal algorithm is a powerful tool to minimize nonlinear and nonsmooth functionals in a general metric space. Motivated by the recent progress in studying the training dynamics of the noisy gradient descent algorithm on two-layer…

最优化与控制 · 数学 2026-05-19 Shuailong Zhu , Xiaohui Chen

As the problem of minimizing functionals on the Wasserstein space encompasses many applications in machine learning, different optimization algorithms on $\mathbb{R}^d$ have received their counterpart analog on the Wasserstein space. We…

最优化与控制 · 数学 2024-11-20 Clément Bonet , Théo Uscidda , Adam David , Pierre-Cyril Aubin-Frankowski , Anna Korba

We consider Monge-Kantorovich optimal transport problems on $\mathbb{R}^d$, $d\ge 1$, with a convex cost function given by the cumulant generating function of a probability measure. Examples include the Wasserstein-2 transport whose cost…

概率论 · 数学 2017-08-29 Soumik Pal

Natural gradient descent is an optimization method traditionally motivated from the perspective of information geometry, and works well for many applications as an alternative to stochastic gradient descent. In this paper we critically…

机器学习 · 计算机科学 2020-09-22 James Martens

We study the behavior of the Wasserstein-$2$ distance between discrete measures $\mu$ and $\nu$ in $\mathbb{R}^d$ when both measures are smoothed by small amounts of Gaussian noise. This procedure, known as Gaussian-smoothed optimal…

统计理论 · 数学 2022-06-15 Yunzi Ding , Jonathan Niles-Weed

Adapting large-scale foundation models to new domains with limited supervision remains a fundamental challenge due to latent distribution mismatch, unstable optimization dynamics, and miscalibrated uncertainty propagation. This paper…

机器学习 · 计算机科学 2026-03-27 Aueaphum Aueawatthanaphisut , Kuepon Auewattanapisut

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density $\pi$ given only its score $\nabla \log \pi$. Our method approximates the Wasserstein gradient flow on…

机器学习 · 计算机科学 2025-10-21 Vasily Ilin , Peter Sushko , Jingwei Hu

Variational quantum algorithms, optimized using gradient-based methods, often exhibit sub-optimal convergence performance due to their dependence on Euclidean geometry. Quantum natural gradient descent (QNGD) is a more efficient method that…

量子物理 · 物理学 2025-06-05 Mohammad Aamir Sohail , Mohsen Heidari , S. Sandeep Pradhan

Wasserstein barycenters provide a principled approach for aggregating probability measures, while preserving the geometry of their ambient space. Existing discrete methods are not scalable as they assume access to the complete set of…

机器学习 · 统计学 2026-03-10 Eduardo Fernandes Montesuma , Yassir Bendou , Mike Gartrell

We present a novel computational framework for density control in high-dimensional state spaces. The considered dynamical system consists of a large number of indistinguishable agents whose behaviors can be collectively modeled as a…

最优化与控制 · 数学 2023-07-26 Shaojun Ma , Mengxue Hou , Xiaojing Ye , Haomin Zhou

Wasserstein gradient flows are continuous time dynamics that define curves of steepest descent to minimize an objective function over the space of probability measures (i.e., the Wasserstein space). This objective is typically a divergence…

最优化与控制 · 数学 2021-02-23 Adil Salim , Anna Korba , Giulia Luise

We study a variant of the dynamical optimal transport problem in which the energy to be minimised is modulated by the covariance matrix of the distribution. Such transport metrics arise naturally in mean-field limits of certain ensemble…

偏微分方程分析 · 数学 2024-12-23 Martin Burger , Matthias Erbar , Franca Hoffmann , Daniel Matthes , André Schlichting

The sliced Wasserstein metric compares probability measures on $\mathbb{R}^d$ by taking averages of the Wasserstein distances between projections of the measures to lines. The distance has found a range of applications in statistics and…

偏微分方程分析 · 数学 2024-11-25 Sangmin Park , Dejan Slepčev

Let $\mathsf{H}$ be a separable Hilbert space. We prove that the Grassmannian $\mathsf{P}_c(\mathsf{H})$ of the finite dimensional subspaces of $\mathsf{H}$ is an Alexandrov space of nonnegative curvature and we employ its metric geometry…

微分几何 · 数学 2021-04-07 Paolo Antonini , Fabio Cavalletti

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

机器学习 · 统计学 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

We study discretizations of Hamiltonian systems on the probability density manifold equipped with the $L^2$-Wasserstein metric. Based on discrete optimal transport theory, several Hamiltonian systems on graph (lattice) with different…

数值分析 · 数学 2020-06-17 Jianbo Cui , Luca Dieci , Haomin Zhou

This brief note aims to introduce the recent paradigm of distributional robustness in the field of shape and topology optimization. Acknowledging that the probability law of uncertain physical data is rarely known beyond a rough…

最优化与控制 · 数学 2023-01-13 Charles Dapogny , Franck Iutzeler , Andrea Meda , Boris Thibert

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

统计理论 · 数学 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle