English
Related papers

Related papers: Geometrical Insights for Implicit Generative Model…

200 papers

We propose a methodology for intercomparing climate models and evaluating their performance against benchmarks based on the use of the Wasserstein distance (WD). This distance provides a rigorous way to measure quantitatively the difference…

Atmospheric and Oceanic Physics · Physics 2020-11-16 Gabriele Vissio , Valerio Lembo , Valerio Lucarini , Michael Ghil

One of the main challenges in the parametrization of geological models is the ability to capture complex geological structures often observed in the subsurface. In recent years, generative adversarial networks (GAN) were proposed as an…

Machine Learning · Statistics 2019-04-10 Shing Chan , Ahmed H. Elsheikh

Given any deep fully connected neural network, initialized with random Gaussian parameters, we bound from above the quadratic Wasserstein distance between its output distribution and a suitable Gaussian process. Our explicit inequalities…

Machine Learning · Computer Science 2023-09-25 Andrea Basteri , Dario Trevisan

We study the implicit bias of generic optimization methods, such as mirror descent, natural gradient descent, and steepest descent with respect to different potentials and norms, when optimizing underdetermined linear regression or…

Machine Learning · Statistics 2020-06-24 Suriya Gunasekar , Jason Lee , Daniel Soudry , Nathan Srebro

Wasserstein barycenters have become popular due to their ability to represent the average of probability measures in a geometrically meaningful way. In this paper, we present an algorithm to approximate the Wasserstein-2 barycenters of…

Machine Learning · Computer Science 2023-01-10 Alexander Korotin , Vage Egiazarian , Lingxiao Li , Evgeny Burnaev

We propose conditional flows of the maximum mean discrepancy (MMD) with the negative distance kernel for posterior sampling and conditional generative modeling. This MMD, which is also known as energy distance, has several advantageous…

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Machine Learning · Computer Science 2026-05-22 Arthur Gretton , Li Kevin Wenliang , Alexandre Galashov , James Thornton , Valentin De Bortoli , Arnaud Doucet

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

Machine Learning · Computer Science 2021-01-06 Jaeho Lee , Maxim Raginsky

It is common in nonparametric estimation problems to impose a certain low-dimensional structure on the unknown parameter to avoid the curse of dimensionality. This paper considers a nonparametric distribution estimation problem with a…

Statistics Theory · Mathematics 2025-02-28 Jeyong Lee , Hyeok Kyu Kwon , Minwoo Chae

Motivated by the statistical and computational challenges of computing Wasserstein distances in high-dimensional contexts, machine learning researchers have defined modified Wasserstein distances based on computing distances between…

Probability · Mathematics 2022-06-02 Jiaqi Xi , Jonathan Niles-Weed

This work presents several expected generalization error bounds based on the Wasserstein distance. More specifically, it introduces full-dataset, single-letter, and random-subset bounds, and their analogues in the randomized subsample…

Machine Learning · Statistics 2022-03-29 Borja Rodríguez-Gálvez , Germán Bassi , Ragnar Thobaben , Mikael Skoglund

We study the interaction between entropy and Wasserstein distance in free probability theory. In particular, we give lower bounds for several versions of free entropy dimension along Wasserstein geodesics, as well as study their topological…

Operator Algebras · Mathematics 2025-07-08 David Jekel

We develop a projected Wasserstein distance for the two-sample test, a fundamental problem in statistics and machine learning: given two sets of samples, to determine whether they are from the same distribution. In particular, we aim to…

Machine Learning · Statistics 2024-04-01 Jie Wang , Rui Gao , Yao Xie

Distances between probability distributions that take into account the geometry of their sample space,like the Wasserstein or the Maximum Mean Discrepancy (MMD) distances have received a lot of attention in machine learning as they can, for…

Machine Learning · Computer Science 2020-04-29 Gaëtan Hadjeres , Frank Nielsen

We study a class of optimization problems in the Wasserstein space (the space of probability measures) where the objective function is nonconvex along generalized geodesics. Specifically, the objective exhibits some difference-of-convex…

Optimization and Control · Mathematics 2025-01-08 Hoang Phuc Hau Luu , Hanlin Yu , Bernardo Williams , Petrus Mikkola , Marcelo Hartmann , Kai Puolamäki , Arto Klami

The use of optimal transport cost for learning generative models has become popular with Wasserstein Generative Adversarial Networks (WGAN). Training of WGAN relies on a theoretical background: the calculation of the gradient of the optimal…

Machine Learning · Statistics 2024-04-04 Antoine Houdard , Arthur Leclaire , Nicolas Papadakis , Julien Rabin

A generalization of the Wasserstein metric, the integrated transportation distance, establishes a novel distance between probability kernels of Markov systems. This metric serves as the foundation for an efficient approximation technique,…

Machine Learning · Computer Science 2023-12-07 Zhengqi Lin , Andrzej Ruszczynski

The Wasserstein probability metric has received much attention from the machine learning community. Unlike the Kullback-Leibler divergence, which strictly measures change in probability, the Wasserstein metric reflects the underlying…

Machine Learning · Computer Science 2017-06-01 Marc G. Bellemare , Ivo Danihelka , Will Dabney , Shakir Mohamed , Balaji Lakshminarayanan , Stephan Hoyer , Rémi Munos

This work considers the problem of computing distances between structured objects such as undirected graphs, seen as probability distributions in a specific metric space. We consider a new transportation distance (i.e. that minimizes a…

Machine Learning · Statistics 2019-05-14 Titouan Vayer , Laetitia Chapel , Rémi Flamary , Romain Tavenard , Nicolas Courty

Defining meaningful distances between samples in a dataset is a fundamental problem in machine learning. Optimal Transport (OT) lifts a distance between features (the "ground metric") to a geometrically meaningful distance between samples.…

Machine Learning · Statistics 2022-07-20 Geert-Jan Huizing , Laura Cantini , Gabriel Peyré
‹ Prev 1 4 5 6 7 8 10 Next ›