English
Related papers

Related papers: Geometrical Insights for Implicit Generative Model…

200 papers

Intractable generative models are models for which the likelihood is unavailable but sampling is possible. Most approaches to parameter inference in this setting require the computation of some discrepancy between the data and the…

Computation · Statistics 2022-07-05 Ziang Niu , Johanna Meier , François-Xavier Briol

Generalized Wasserstein distances allow to quantitatively compare two continuous or atomic mass distributions with equal or different total mass. In this paper, we propose four numerical methods for the approximation of three different…

Analysis of PDEs · Mathematics 2025-10-21 Maya Briani , Emiliano Cristiani , Giovanni Franzina , Francesca L. Ignoto

Score-based generative models are trained in high-dimensional ambient spaces, yet many data distributions are supported on low-dimensional nonlinear structures. We prove that, for compact $d$-dimensional smooth manifolds $\mathcal{M}…

Machine Learning · Computer Science 2026-05-18 Guoji Fu , Taiji Suzuki , Wee Sun Lee , Atsushi Nitanda

Generative Adversarial Networks (GANs) have shown great promise in modeling high dimensional data. The learning objective of GANs usually minimizes some measure discrepancy, \textit{e.g.}, $f$-divergence~($f$-GANs) or Integral Probability…

Machine Learning · Computer Science 2020-04-07 Yuxuan Song , Qiwei Ye , Minkai Xu , Tie-Yan Liu

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

Machine Learning · Statistics 2023-06-01 Titouan Vayer , Rémi Gribonval

Wasserstein Barycenter is a principled approach to represent the weighted mean of a given set of probability distributions, utilizing the geometry induced by optimal transport. In this work, we present a novel scalable algorithm to…

Machine Learning · Computer Science 2021-11-30 Jiaojiao Fan , Amirhossein Taghvaei , Yongxin Chen

We address the problem of efficiently computing Wasserstein distances for multiple pairs of distributions drawn from a meta-distribution. To this end, we propose a fast estimation method based on regressing Wasserstein distance on sliced…

Machine Learning · Statistics 2026-03-04 Khai Nguyen , Hai Nguyen , Nhat Ho

Monge-Kantorovich distances, otherwise known as Wasserstein distances, have received a growing attention in statistics and machine learning as a powerful discrepancy measure for probability distributions. In this paper, we focus on…

Machine Learning · Statistics 2018-01-30 François Bachoc , Fabrice Gamboa , Jean-Michel Loubes , Nil Venet

Sliced Wasserstein distances preserve properties of classic Wasserstein distances while being more scalable for computation and estimation in high dimensions. The goal of this work is to quantify this scalability from three key aspects: (i)…

Machine Learning · Statistics 2022-10-18 Sloan Nietert , Ritwik Sadhu , Ziv Goldfeld , Kengo Kato

Data represented by probability measures arise as empirical distributions, posterior distributions, and feature-based representations of complex objects. We study heterogeneity in a population of probability measures through the expected…

Methodology · Statistics 2026-03-17 Kisung You

We propose a manifold matching approach to generative models which includes a distribution generator (or data generator) and a metric generator. In our framework, we view the real data set as some manifold embedded in a high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Mengyu Dai , Haibin Hang

We introduce a principled way of computing the Wasserstein distance between two distributions in a federated manner. Namely, we show how to estimate the Wasserstein distance between two samples stored and kept on different devices/clients…

Machine Learning · Computer Science 2023-10-04 Alain Rakotomamonjy , Kimia Nadjahi , Liva Ralaivola

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

The problem of efficiently generating random samples from high-dimensional and non-log-concave posterior measures arising from nonlinear regression problems is considered. Extending investigations from arXiv:2009.05298, local and global…

Statistics Theory · Mathematics 2023-04-18 Jan Bohr , Richard Nickl

The Gromov-Wasserstein (GW) distances define a family of metrics, based on ideas from optimal transport, which enable comparisons between probability measures defined on distinct metric spaces. They are particularly useful in areas such as…

Deep generative models learn a mapping from a low dimensional latent space to a high-dimensional data space. Under certain regularity conditions, these models parameterize nonlinear manifolds in the data space. In this paper, we investigate…

Machine Learning · Computer Science 2017-11-23 Hang Shao , Abhishek Kumar , P. Thomas Fletcher

We propose a fundamental metric for measuring the distance between two distributions. This metric, referred to as the decision-focused (DF) divergence, is tailored to stochastic linear optimization problems in which the objective…

Statistics Theory · Mathematics 2026-02-04 Suhan Liu , Mo Liu

Neural networks trained with standard objectives exhibit behaviors characteristic of probabilistic inference: soft clustering, prototype specialization, and Bayesian uncertainty tracking. These phenomena appear across architectures -- in…

Machine Learning · Computer Science 2026-01-01 Alan Oursland

We introduce a novel approach to Maximum A Posteriori inference based on discrete graphical models. By utilizing local Wasserstein distances for coupling assignment measures across edges of the underlying graph, a given discrete objective…

Machine Learning · Computer Science 2018-05-29 Ruben Hühnerbein , Fabrizio Savarino , Freddie Åström , Christoph Schnörr

We introduce LOT Wassmap, a computationally feasible algorithm to uncover low-dimensional structures in the Wasserstein space. The algorithm is motivated by the observation that many datasets are naturally interpreted as probability…

Machine Learning · Computer Science 2023-02-16 Alexander Cloninger , Keaton Hamm , Varun Khurana , Caroline Moosmüller