中文
相关论文

相关论文: Asymptotic Guarantees for Generative Modeling Base…

200 篇论文

Past research has indicated that the covariance of the Stochastic Gradient Descent (SGD) error done via minibatching plays a critical role in determining its regularization and escape from low potential points. Motivated by some new…

机器学习 · 统计学 2023-03-02 Riddhiman Bhattacharya , Tiefeng Jiang

Motivated by the growing popularity of variants of the Wasserstein distance in statistics and machine learning, we study statistical inference for the Sliced Wasserstein distance--an easily computable variant of the Wasserstein distance.…

统计理论 · 数学 2022-04-05 Tudor Manole , Sivaraman Balakrishnan , Larry Wasserman

This paper provides a simple procedure to fit generative networks to target distributions, with the goal of a small Wasserstein distance (or other optimal transport costs). The approach is based on two principles: (a) if the source…

机器学习 · 计算机科学 2019-06-12 Yucheng Chen , Matus Telgarsky , Chao Zhang , Bolton Bailey , Daniel Hsu , Jian Peng

Optimal transport has been very successful for various machine learning tasks; however, it is known to suffer from the curse of dimensionality. Hence, dimensionality reduction is desirable when applied to high-dimensional data with…

机器学习 · 统计学 2025-07-21 Jie Wang , March Boedihardjo , Yao Xie

Wasserstein distance (WD) and the associated optimal transport plan have been proven useful in many applications where probability measures are at stake. In this paper, we propose a new proxy of the squared WD, coined min-SWGG, that is…

机器学习 · 统计学 2023-10-31 Guillaume Mahey , Laetitia Chapel , Gilles Gasso , Clément Bonet , Nicolas Courty

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

机器学习 · 计算机科学 2021-01-06 Jaeho Lee , Maxim Raginsky

We study the problem of robust distribution estimation under the Wasserstein distance, a popular discrepancy measure between probability distributions rooted in optimal transport (OT) theory. Given $n$ samples from an unknown distribution…

机器学习 · 统计学 2024-09-25 Sloan Nietert , Rachel Cummings , Ziv Goldfeld

Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is…

计算机视觉与模式识别 · 计算机科学 2018-03-30 Ishan Deshpande , Ziyu Zhang , Alexander Schwing

We introduce the observable Wasserstein distance, a framework for deriving lower bounds on the Wasserstein distance between probability measures on Polish metric spaces, designed to bypass the computational intractability of exact optimal…

In data-driven learning and inference tasks, the high cost of acquiring samples from the target distribution often limits performance. A common strategy to mitigate this challenge is to augment the limited target samples with data from a…

统计理论 · 数学 2025-02-06 Barron Han , Danil Akhtiamov , Reza Ghane , Babak Hassibi

We propose a novel approach for comparing distributions whose supports do not necessarily lie on the same metric space. Unlike Gromov-Wasserstein (GW) distance which compares pairwise distances of elements from each distribution, we…

机器学习 · 统计学 2021-04-23 Mokhtar Z. Alaya , Maxime Bérar , Gilles Gasso , Alain Rakotomamonjy

While likelihood-based inference and its variants provide a statistically efficient and widely applicable approach to parametric inference, their application to models involving intractable likelihoods poses challenges. In this work, we…

统计方法学 · 统计学 2019-06-17 Francois-Xavier Briol , Alessandro Barp , Andrew B. Duncan , Mark Girolami

Estimating a $d$-dimensional distribution $\mu$ by the empirical measure $\hat{\mu}_n$ of its samples is an important task in probability theory, statistics and machine learning. It is well known that $\mathbb{E}[\mathcal{W}_p(\hat{\mu}_n,…

概率论 · 数学 2026-03-24 Martin Larsson , Jonghwa Park , Johannes Wiesel

We obtain explicit $p$-Wasserstein distance error bounds between the distribution of the multi-parameter MLE and the multivariate normal distribution. Our general bounds are given for possibly high-dimensional, independent and identically…

统计理论 · 数学 2021-12-28 Andreas Anastasiou , Robert E. Gaunt

Wasserstein distributionally robust optimization estimators are obtained as solutions of min-max problems in which the statistician selects a parameter minimizing the worst-case loss among all probability models within a certain distance…

统计理论 · 数学 2021-03-04 Jose Blanchet , Karthyek Murthy , Nian Si

Through an uncertainty quantification (UQ) perspective, we show that score-based generative models (SGMs) are provably robust to the multiple sources of error in practical implementation. Our primary tool is the Wasserstein uncertainty…

Wasserstein geometry and information geometry are two important structures to be introduced in a manifold of probability distributions. Wasserstein geometry is defined by using the transportation cost between two distributions, so it…

统计理论 · 数学 2021-01-01 Shun-ichi Amari , Takeru Matsuda

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

机器学习 · 统计学 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension…

机器学习 · 统计学 2022-06-01 Adam Block , Zeyu Jia , Yury Polyanskiy , Alexander Rakhlin

The empirical Wasserstein projection (WP) distance quantifies the Wasserstein distance from the empirical distribution to a set of probability measures satisfying given expectation constraints. The WP is a powerful tool because it mitigates…

统计理论 · 数学 2024-08-22 Sirui Lin , Jose Blanchet , Peter Glynn , Viet Anh Nguyen