English
Related papers

Related papers: Wasserstein Bounds for generative diffusion models…

200 papers

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

Score-based generative modeling, implemented through probability flow ODEs, has shown impressive results in numerous practical settings. However, most convergence guarantees rely on restrictive regularity assumptions on the target…

Machine Learning · Statistics 2025-10-21 Gitte Kremling , Francesco Iafrate , Mahsa Taheri , Johannes Lederer

Through an uncertainty quantification (UQ) perspective, we show that score-based generative models (SGMs) are provably robust to the multiple sources of error in practical implementation. Our primary tool is the Wasserstein uncertainty…

Machine Learning · Statistics 2024-05-27 Nikiforos Mimikos-Stamatopoulos , Benjamin J. Zhang , Markos A. Katsoulakis

Score-based generative models (SGMs) have achieved remarkable empirical success, motivating their application to a broad range of data distributions. However, extending them to heavy-tailed targets remains a largely open problem. Although…

Machine Learning · Statistics 2026-05-15 Tiziano Fassina , Gabriel Cardoso , Sylvan Le Corff , Thomas Romary

In this paper we propose tight upper and lower bounds for the Wasserstein distance between any two {{univariate continuous distributions}} with probability densities $p_1$ and $p_2$ having nested supports. These explicit bounds are…

Probability · Mathematics 2015-10-21 Christophe Ley , Gesine Reinert , Yvik Swan

Score-based generative models (SGMs) is a recent class of deep generative models with state-of-the-art performance in many applications. In this paper, we establish convergence guarantees for a general class of SGMs in 2-Wasserstein…

Machine Learning · Computer Science 2025-02-18 Xuefeng Gao , Hoang M. Nguyen , Lingjiong Zhu

Generative Adversarial Networks (GANs) have been used to model the underlying probability distribution of sample based datasets. GANs are notoriuos for training difficulties and their dependence on arbitrary hyperparameters. One recent…

Machine Learning · Computer Science 2019-10-03 Thomas Pinetz , Daniel Soukup , Thomas Pock

Generalization error bounds are essential to understanding machine learning algorithms. This paper presents novel expected generalization error upper bounds based on the average joint distribution between the output hypothesis and each…

Information Theory · Computer Science 2022-02-25 Gholamali Aminian , Yuheng Bu , Gregory Wornell , Miguel Rodrigues

Score-based diffusion models have emerged as powerful tools in generative modeling, yet their theoretical foundations remain underexplored. In this work, we focus on the Wasserstein convergence analysis of score-based diffusion models.…

Machine Learning · Statistics 2025-02-10 Yifeng Yu , Lu Yu

Concentration inequalities form an essential toolkit in the study of high dimensional (HD) statistical methods. Most of the relevant statistics literature in this regard is based on sub-Gaussian or sub-exponential tail assumptions. In this…

Statistics Theory · Mathematics 2023-01-09 Arun Kumar Kuchibhotla , Abhishek Chakrabortty

We establish minimax convergence rates for score-based generative models (SGMs) under the $1$-Wasserstein distance. Assuming the target density $p^\star$ lies in a nonparametric $\beta$-smooth H\"older class with either compact support or…

Statistics Theory · Mathematics 2025-07-08 Arthur Stéphanovitch , Eddie Aamari , Clément Levrard

In this work, we look at Score-based generative models (also called diffusion generative models) from a geometric perspective. From a new view point, we prove that both the forward and backward process of adding noise and generating from…

Machine Learning · Computer Science 2023-02-10 Sandesh Ghimire , Jinyang Liu , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

Markov chains and diffusion processes are indispensable tools in machine learning and statistics that are used for inference, sampling, and modeling. With the growth of large-scale datasets, the computational cost associated with simulating…

Statistics Theory · Mathematics 2017-08-31 Jonathan H. Huggins , James Zou

We analyze the complexity of sampling from a class of heavy-tailed distributions by discretizing a natural class of It\^o diffusions associated with weighted Poincar\'e inequalities. Based on a mean-square analysis, we establish the…

Statistics Theory · Mathematics 2023-03-03 Ye He , Tyler Farghly , Krishnakumar Balasubramanian , Murat A. Erdogdu

We derive Wasserstein distance bounds between the probability distributions of a stochastic integral (It\^o) process with jumps $(X_t)_{t\in [0,T]}$ and a jump-diffusion process $(X^\ast_t)_{t\in [0,T]}$. Our bounds are expressed using the…

Probability · Mathematics 2022-12-12 Jean-Christophe Breton , Nicolas Privault

The Wasserstein distance is a metric on a space of probability measures that has seen a surge of applications in statistics, machine learning, and applied mathematics. However, statistical aspects of Wasserstein distances are bottlenecked…

Probability · Mathematics 2022-03-02 Ziv Goldfeld , Kengo Kato , Sloan Nietert , Gabriel Rioux

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

Statistics Theory · Mathematics 2020-01-29 Jing Lei

This paper demonstrates the robustness of Lipschitz-regularized $\alpha$-divergences as objective functionals in generative modeling, showing they enable stable learning across a wide range of target distributions with minimal assumptions.…

Machine Learning · Statistics 2025-09-09 Ziyu Chen , Hyemin Gu , Markos A. Katsoulakis , Luc Rey-Bellet , Wei Zhu

In generative modeling, the Wasserstein distance (WD) has emerged as a useful metric to measure the discrepancy between generated and real data distributions. Unfortunately, it is challenging to approximate the WD of high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Jiqing Wu , Zhiwu Huang , Dinesh Acharya , Wen Li , Janine Thoma , Danda Pani Paudel , Luc Van Gool

In generative modeling, the Wasserstein distance (WD) has emerged as a useful metric to measure the discrepancy between generated and real data distributions. Unfortunately, it is challenging to approximate the WD of high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Jiqing Wu , Zhiwu Huang , Dinesh Acharya , Wen Li , Janine Thoma , Danda Pani Paudel , Luc Van Gool