中文
相关论文

相关论文: Optimal Neural Network Approximation of Wasserstei…

200 篇论文

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

最优化与控制 · 数学 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

Wasserstein distance (WD) and the associated optimal transport plan have been proven useful in many applications where probability measures are at stake. In this paper, we propose a new proxy of the squared WD, coined min-SWGG, that is…

机器学习 · 统计学 2023-10-31 Guillaume Mahey , Laetitia Chapel , Gilles Gasso , Clément Bonet , Nicolas Courty

Making sense of Wasserstein distances between discrete measures in high-dimensional settings remains a challenge. Recent work has advocated a two-step approach to improve robustness and facilitate the computation of optimal transport, using…

机器学习 · 计算机科学 2019-09-04 François-Pierre Paty , Marco Cuturi

We provide a framework to approximate the 2-Wasserstein distance and the optimal transport map, amenable to efficient training as well as statistical and geometric analysis. With the quadratic cost and considering the Kantorovich dual form…

最优化与控制 · 数学 2019-02-20 Amirhossein Taghvaei , Amin Jalali

We study a natural Wasserstein gradient flow on manifolds of probability distributions with discrete sample spaces. We derive the Riemannian structure for the probability simplex from the dynamical formulation of the Wasserstein distance on…

最优化与控制 · 数学 2021-04-19 Wuchen Li , Guido Montufar

We address high-dimensional zero-one random parameters in two-stage convex conic optimization problems. Such parameters typically represent failures of network elements and constitute rare, high-impact random events in several applications.…

最优化与控制 · 数学 2021-07-20 Anirudh Subramanyam , Mohamed El Tonbari , Kibaek Kim

We consider the NP-hard problem of minimizing a convex quadratic function over the integer lattice ${\bf Z}^n$. We present a simple semidefinite programming (SDP) relaxation for obtaining a nontrivial lower bound on the optimal value of the…

最优化与控制 · 数学 2017-03-16 Jaehyun Park , Stephen Boyd

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

最优化与控制 · 数学 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

We investigate a simple approximation scheme, based on overlapping linear decision rules, for solving data-driven two-stage distributionally robust optimization problems with the type-$\infty$ Wasserstein ambiguity set. Our main result…

最优化与控制 · 数学 2020-11-05 Dimitris Bertsimas , Shimrit Shtern , Bradley Sturt

Variational Optimization forms a differentiable upper bound on an objective. We show that approaches such as Natural Evolution Strategies and Gaussian Perturbation, are special cases of Variational Optimization in which the expectations are…

机器学习 · 统计学 2018-09-14 Thomas Bird , Julius Kunze , David Barber

Gradient boosting is a sequential ensemble method that fits a new weaker learner to pseudo residuals at each iteration. We propose Wasserstein gradient boosting, a novel extension of gradient boosting that fits a new weak learner to…

统计方法学 · 统计学 2024-08-30 Takuo Matsubara

We study multi-objective optimization over probability distributions in Wasserstein space. Recently, Nguyen et al. (2025) introduced Multiple Wasserstein Gradient Descent (MWGraD) algorithm, which exploits the geometric structure of…

机器学习 · 计算机科学 2026-01-28 Dai Hai Nguyen , Duc Dung Nguyen , Atsuyoshi Nakamura , Hiroshi Mamitsuka

This paper provides a simple procedure to fit generative networks to target distributions, with the goal of a small Wasserstein distance (or other optimal transport costs). The approach is based on two principles: (a) if the source…

机器学习 · 计算机科学 2019-06-12 Yucheng Chen , Matus Telgarsky , Chao Zhang , Bolton Bailey , Daniel Hsu , Jian Peng

We propose a descent subgradient algorithm for unconstrained nonsmooth nonconvex multiobjective optimization problems. To find a descent direction, we present an iterative process that efficiently approximates the Goldstein subdifferential…

最优化与控制 · 数学 2024-06-24 Morteza Maleknia , Majid Soleimani-damaneh

Recently, optimization on the Riemannian manifold have provided valuable insights to the optimization community. In this regard, extending these methods to to the Wasserstein space is of particular interest, since optimization on…

机器学习 · 计算机科学 2025-11-05 Mingyang Yi , Bohan Wang

This manuscript introduces a regression-type formulation for approximating the Perron-Frobenius Operator by relying on distributional snapshots of data. These snapshots may represent densities of particles. The Wasserstein metric is…

最优化与控制 · 数学 2020-11-03 Amirhossein Karimi , Tryphon T. Georgiou

We study non-convex subgradient flows for training two-layer ReLU neural networks from a convex geometry and duality perspective. We characterize the implicit bias of unregularized non-convex gradient flow as convex regularization of an…

机器学习 · 计算机科学 2021-10-14 Yifei Wang , Mert Pilanci

In this article, we formulate topology optimization problems concerning the mass distribution as minimization problems for functionals on the Wasserstein space. We relax optimization problems regarding non-convex objective functions on the…

最优化与控制 · 数学 2026-01-22 Fumiya Okazaki , Takayuki Yamada

We address the problem of efficiently computing Wasserstein distances for multiple pairs of distributions drawn from a meta-distribution. To this end, we propose a fast estimation method based on regressing Wasserstein distance on sliced…

机器学习 · 统计学 2026-03-04 Khai Nguyen , Hai Nguyen , Nhat Ho

In generative modeling, the Wasserstein distance (WD) has emerged as a useful metric to measure the discrepancy between generated and real data distributions. Unfortunately, it is challenging to approximate the WD of high-dimensional…

计算机视觉与模式识别 · 计算机科学 2019-04-16 Jiqing Wu , Zhiwu Huang , Dinesh Acharya , Wen Li , Janine Thoma , Danda Pani Paudel , Luc Van Gool