English
Related papers

Related papers: Asymptotic Guarantees for Generative Modeling Base…

200 papers

While the asymptotic normality of the maximum likelihood estimator under regularity conditions is long established, this paper derives explicit bounds for the bounded Wasserstein distance between the distribution of the maximum likelihood…

Statistics Theory · Mathematics 2016-09-29 Andreas Anastasiou , Gesine Reinert

Standard Distributional Synthetic Controls (DSC) estimate counterfactual distributions by minimizing the Euclidean $L_2$ distance between quantile functions. We demonstrate that this geometric reliance renders estimators fragile: they lack…

Econometrics · Economics 2026-01-27 Xinran Liu

The sliced Wasserstein (SW) distances between two probability measures are defined as the expectation of the Wasserstein distance between two one-dimensional projections of the two measures. The randomness comes from a projecting direction…

Machine Learning · Statistics 2024-02-20 Khai Nguyen , Nhat Ho

Non-adversarial generative models such as variational auto-encoder (VAE), Wasserstein auto-encoders with maximum mean discrepancy (WAE-MMD), sliced-Wasserstein auto-encoder (SWAE) are relatively easy to train and have less mode collapse…

Machine Learning · Statistics 2021-03-05 Kuo Gai , Shihua Zhang

Self-supervised learning is one of the most promising approaches to acquiring knowledge from limited labeled data. Despite the substantial advancements made in recent years, self-supervised models have posed a challenge to practitioners, as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Franciskus Xaverius Erick , Mina Rezaei , Johanna Paula Müller , Bernhard Kainz

Denoising diffusion models are a recent class of generative models exhibiting state-of-the-art performance in image and audio synthesis. Such models approximate the time-reversal of a forward noising process from a target distribution to a…

Machine Learning · Statistics 2023-05-30 Valentin De Bortoli

The density weighted average derivative (DWAD) of a regression function is a canonical parameter of interest in economics. Classical first-order large sample distribution theory for kernel-based DWAD estimators relies on tuning parameter…

Econometrics · Economics 2024-02-16 Matias D. Cattaneo , Max H. Farrell , Michael Jansson , Ricardo Masini

Goodness-of-fit tests based on the empirical Wasserstein distance are proposed for simple and composite null hypotheses involving general multivariate distributions. For group families, the procedure is to be implemented after preliminary…

Methodology · Statistics 2021-01-28 Marc Hallin , Gilles Mordant , Johan Segers

Parameter estimation is a fundamental challenge in machine learning, crucial for tasks such as neural network weight fitting and Bayesian inference. This paper focuses on the complexity of estimating translation $\boldsymbol{\mu} \in…

Machine Learning · Computer Science 2025-01-20 Valentio Iverson , Stephen Vavasis

Wasserstein GAN(WGAN) is a model that minimizes the Wasserstein distance between a data distribution and sample distribution. Recent studies have proposed stabilizing the training process for the WGAN and implementing the Lipschitz…

Machine Learning · Computer Science 2018-10-08 Cheolhyeong Kim , Seungtae Park , Hyung Ju Hwang

Let $(X_t)_{t \geq 0}$ be a diffusion process defined on a compact Riemannian manifold, and for $\alpha > 0$, let $$ \mu_t^{(\alpha)} = \frac{\alpha}{t^\alpha} \int_{0}^{t} \delta_{X_s} \, s^{\alpha - 1} \mathrm{d} s $$ be the associated…

Probability · Mathematics 2023-10-04 Jie-Xiang Zhu

The following type exponential convergence is proved for (non-degenerate or degenerate) McKean-Vlasov SDEs: $$W_2(\mu_t,\mu_\infty)^2 +{\rm Ent}(\mu_t|\mu_\infty)\le c {\rm e}^{-\lambda t} \min\big\{W_2(\mu_0, \mu_\infty)^2,{\rm…

Probability · Mathematics 2024-10-01 Panpan Ren , Feng-Yu Wang

This short note is on a property of the $\mathcal{W}_2$ Wasserstein distance which indicates that independent elliptical distributions minimize their $\mathcal{W}_2$ Wasserstein distance from given independent elliptical distributions with…

Statistics Theory · Mathematics 2020-12-08 Song Fang , Quanyan Zhu

We provide non asymptotic rates of convergence of the Wasserstein Generative Adversarial networks (WGAN) estimator. We build neural networks classes representing the generators and discriminators which yield a GAN that achieves the minimax…

Statistics Theory · Mathematics 2025-03-13 Arthur Stéphanovitch , Eddie Aamari , Clément Levrard

The lower the distortion of an estimator, the more the distribution of its outputs generally deviates from the distribution of the signals it attempts to estimate. This phenomenon, known as the perception-distortion tradeoff, has captured…

Image and Video Processing · Electrical Eng. & Systems 2021-07-07 Dror Freirich , Tomer Michaeli , Ron Meir

We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the $L^2$-Wasserstein metric tensor in the probability density space to a parameter space, equipping the…

Optimization and Control · Mathematics 2024-08-20 Yifan Chen , Wuchen Li

We introduce sliced optimal transport dataset distance (s-OTDD), a model-agnostic, embedding-agnostic approach for dataset comparison that requires no training, is robust to variations in the number of classes, and can handle disjoint label…

Machine Learning · Computer Science 2025-05-16 Khai Nguyen , Hai Nguyen , Tuan Pham , Nhat Ho

We propose a generative model that achieves minimax-optimal convergence rates for estimating probability distributions supported on unknown low-dimensional manifolds. Building on Fefferman's solution to the geometric Whitney problem, our…

Statistics Theory · Mathematics 2025-06-25 Arthur Stéphanovitch

Statistical solutions of incompressible Euler describe turbulent dynamics as time-parameterized laws on $L^2$ whose multi-point correlations satisfy an infinite hierarchy of weak identities. Modern generative samplers for PDE forecasting…

Analysis of PDEs · Mathematics 2026-02-24 Victor Armegioiu

A growing number of generative statistical models do not permit the numerical evaluation of their likelihood functions. Approximate Bayesian computation (ABC) has become a popular approach to overcome this issue, in which one simulates…

Methodology · Statistics 2019-05-10 Espen Bernton , Pierre E. Jacob , Mathieu Gerber , Christian P. Robert