中文
相关论文

相关论文: Hessian-guided Perturbed Wasserstein Gradient Flow…

200 篇论文

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

最优化与控制 · 数学 2026-05-28 Tam Le

Wasserstein barycenters provide a geometric notion of the weighted average of probability measures based on optimal transport. In this paper, we present a scalable algorithm to compute Wasserstein-2 barycenters given sample access to the…

机器学习 · 计算机科学 2022-01-02 Alexander Korotin , Lingxiao Li , Justin Solomon , Evgeny Burnaev

As the problem of minimizing functionals on the Wasserstein space encompasses many applications in machine learning, different optimization algorithms on $\mathbb{R}^d$ have received their counterpart analog on the Wasserstein space. We…

最优化与控制 · 数学 2024-11-20 Clément Bonet , Théo Uscidda , Adam David , Pierre-Cyril Aubin-Frankowski , Anna Korba

We prove that the sequence of marginals obtained from the iterations of the Sinkhorn algorithm or the iterative proportional fitting procedure (IPFP) on joint densities, converges to an absolutely continuous curve on the $2$-Wasserstein…

概率论 · 数学 2026-04-21 Nabarun Deb , Young-Heon Kim , Soumik Pal , Geoffrey Schiebinger

Gradient descent-ascent (GDA) flows play a central role in finding saddle points of bivariate functionals, with applications in optimization, game theory, and robust control. While they are well-understood in Hilbert and Banach spaces via…

泛函分析 · 数学 2025-06-26 Noboru Isobe , Sho Shimoyama

State estimation in non-linear models is performed by tracking the posterior distribution recursively. A plethora of algorithms have been proposed for this task. Among them, the Gaussian particle filter uses a weighted set of particles to…

信号处理 · 电气工程与系统科学 2022-07-05 Karthik Comandur , Yunpeng Li , Santosh Nannuru

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

最优化与控制 · 数学 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

We address the problem of efficiently computing Wasserstein distances for multiple pairs of distributions drawn from a meta-distribution. To this end, we propose a fast estimation method based on regressing Wasserstein distance on sliced…

机器学习 · 统计学 2026-03-04 Khai Nguyen , Hai Nguyen , Nhat Ho

Despite the growing prominence of generative adversarial networks (GANs), optimization in GANs is still a poorly understood topic. In this paper, we analyze the "gradient descent" form of GAN optimization i.e., the natural setting where we…

机器学习 · 计算机科学 2018-01-16 Vaishnavh Nagarajan , J. Zico Kolter

We study the Wasserstein gradient flow of the Sinkhorn divergence when both the source and the target are Gaussian distributions. We prove the existence of a flow that stays in the class of Gaussian distributions, and is unique in the…

偏微分方程分析 · 数学 2026-02-20 Mathis Hardion , Théo Lacombe

This paper proposes novel gradient-flow schemes that yield convergence to the optimal point of a convex optimization problem within a \textit{fixed} time from any given initial condition for unconstrained optimization, constrained…

最优化与控制 · 数学 2022-04-27 Kunal Garg , Dimitra Panagou

Recently used in various machine learning contexts, the Gromov-Wasserstein distance (GW) allows for comparing distributions whose supports do not necessarily lie in the same metric space. However, this Optimal Transport (OT) distance…

机器学习 · 统计学 2022-10-21 Titouan Vayer , Rémi Flamary , Romain Tavenard , Laetitia Chapel , Nicolas Courty

Wasserstein-Fisher-Rao (WFR) gradient flows have been recently proposed as a powerful sampling tool that combines the advantages of pure Wasserstein (W) and pure Fisher-Rao (FR) gradient flows. Existing algorithmic developments implicitly…

机器学习 · 统计学 2026-03-02 Francesca Romana Crucinio , Sahani Pathiraja

The Stein Variational Gradient Descent (SVGD) algorithm is a deterministic particle method for sampling. However, a mean-field analysis reveals that the gradient flow corresponding to the SVGD algorithm (i.e., the Stein Variational Gradient…

机器学习 · 统计学 2024-05-10 Ye He , Krishnakumar Balasubramanian , Bharath K. Sriperumbudur , Jianfeng Lu

Optimizing non-convex functions is of primary importance in the vast majority of machine learning algorithms. Even though many gradient descent based algorithms have been studied, successive convex approximation based algorithms have been…

最优化与控制 · 数学 2019-03-06 Amrit Singh Bedi , Ketan Rajawat , Vaneet Aggarwal

We study data-driven decision problems where historical observations are generated by a time-evolving distribution whose consecutive shifts are bounded in Wasserstein distance. We address this nonstationarity using a distributionally robust…

最优化与控制 · 数学 2025-12-25 Dominic S. T. Keehan , Edward J. Anderson , Wolfram Wiesemann

There has been recent interest in developing scalable Bayesian sampling methods such as stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD) for big-data analysis. A standard SG-MCMC algorithm simulates samples…

机器学习 · 统计学 2018-07-11 Changyou Chen , Ruiyi Zhang , Wenlin Wang , Bai Li , Liqun Chen

This paper contains two contributions in the study of optimal transport on metric graphs. Firstly, we prove a Benamou-Brenier formula for the Wasserstein distance, which establishes the equivalence of static and dynamical optimal transport.…

偏微分方程分析 · 数学 2022-05-02 Matthias Erbar , Dominik Forkert , Jan Maas , Delio Mugnolo

We design and compute first-order implicit-in-time variational schemes with high-order spatial discretization for initial value gradient flows in generalized optimal transport metric spaces. We first review some examples of gradient flows…

数值分析 · 数学 2023-08-16 Guosheng Fu , Stanley Osher , Wuchen Li

The Gromov-Wasserstein (GW) framework adapts ideas from optimal transport to allow for the comparison of probability distributions defined on different metric spaces. Scalable computation of GW distances and associated matchings on graphs…

机器学习 · 计算机科学 2021-05-05 Samir Chowdhury , David Miller , Tom Needham