中文
相关论文

相关论文: Score-based Generative Modeling Secretly Minimizes…

200 篇论文

Score-based generative models (SGMs) aim at estimating a target data distribution by learning score functions using only noise-perturbed samples from the target.Recent literature has focused extensively on assessing the error between the…

We establish minimax convergence rates for score-based generative models (SGMs) under the $1$-Wasserstein distance. Assuming the target density $p^\star$ lies in a nonparametric $\beta$-smooth H\"older class with either compact support or…

统计理论 · 数学 2025-07-08 Arthur Stéphanovitch , Eddie Aamari , Clément Levrard

Diffusion models are one of the most important families of deep generative models. In this note, we derive a quantitative upper bound on the Wasserstein distance between the data-generating distribution and the distribution learned by a…

机器学习 · 计算机科学 2024-09-17 Sokhna Diarra Mbacke , Omar Rivasplata

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

机器学习 · 计算机科学 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

统计理论 · 数学 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

机器学习 · 统计学 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

In this work, we look at Score-based generative models (also called diffusion generative models) from a geometric perspective. From a new view point, we prove that both the forward and backward process of adding noise and generating from…

机器学习 · 计算机科学 2023-02-10 Sandesh Ghimire , Jinyang Liu , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and…

机器学习 · 计算机科学 2025-09-23 Stefano Bruno , Sotirios Sabanis

This paper provides a simple procedure to fit generative networks to target distributions, with the goal of a small Wasserstein distance (or other optimal transport costs). The approach is based on two principles: (a) if the source…

机器学习 · 计算机科学 2019-06-12 Yucheng Chen , Matus Telgarsky , Chao Zhang , Bolton Bailey , Daniel Hsu , Jian Peng

Score-based generative models (SGMs) is a recent class of deep generative models with state-of-the-art performance in many applications. In this paper, we establish convergence guarantees for a general class of SGMs in 2-Wasserstein…

机器学习 · 计算机科学 2025-02-18 Xuefeng Gao , Hoang M. Nguyen , Lingjiong Zhu

We present an estimate of the Wasserstein distance between the data distribution and the generation of score-based generative models. The sampling complexity with respect to dimension is $\mathcal{O}(\sqrt{d})$, with a logarithmic constant.…

机器学习 · 计算机科学 2025-10-06 Xixian Wang , Zhongjian Wang

Score-based generative modeling (SGM) has grown to be a hugely successful method for learning to generate samples from complex data distributions such as that of images and audio. It is based on evolving an SDE that transforms white noise…

机器学习 · 计算机科学 2022-10-04 Holden Lee , Jianfeng Lu , Yixin Tan

Through an uncertainty quantification (UQ) perspective, we show that score-based generative models (SGMs) are provably robust to the multiple sources of error in practical implementation. Our primary tool is the Wasserstein uncertainty…

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

机器学习 · 计算机科学 2025-11-14 Eliot Beyler , Francis Bach

Diffusion models are commonly interpreted as learning the score function, i.e., the gradient of the log-density of noisy data. However, this assumption implies that the target of learning is a conservative vector field, which is not…

机器学习 · 计算机科学 2025-09-03 An B. Vuong , Michael T. McCann , Javier E. Santos , Yen Ting Lin

Minimum distance estimation (MDE) gained recent attention as a formulation of (implicit) generative modeling. It considers minimizing, over model parameters, a statistical distance between the empirical data distribution and the model. This…

统计理论 · 数学 2020-10-21 Ziv Goldfeld , Kristjan Greenewald , Kengo Kato

In generative modeling, the Wasserstein distance (WD) has emerged as a useful metric to measure the discrepancy between generated and real data distributions. Unfortunately, it is challenging to approximate the WD of high-dimensional…

计算机视觉与模式识别 · 计算机科学 2019-04-16 Jiqing Wu , Zhiwu Huang , Dinesh Acharya , Wen Li , Janine Thoma , Danda Pani Paudel , Luc Van Gool

In generative modeling, the Wasserstein distance (WD) has emerged as a useful metric to measure the discrepancy between generated and real data distributions. Unfortunately, it is challenging to approximate the WD of high-dimensional…

计算机视觉与模式识别 · 计算机科学 2019-04-17 Jiqing Wu , Zhiwu Huang , Dinesh Acharya , Wen Li , Janine Thoma , Danda Pani Paudel , Luc Van Gool

Diffusion generative models have emerged as powerful tools for producing synthetic data from an empirically observed distribution. A common approach involves simulating the time-reversal of an Ornstein-Uhlenbeck (OU) process initialized at…

机器学习 · 统计学 2025-12-02 Valentin de Bortoli , Romuald Elie , Anna Kazeykina , Zhenjie Ren , Jiacheng Zhang

Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is…

计算机视觉与模式识别 · 计算机科学 2018-03-30 Ishan Deshpande , Ziyu Zhang , Alexander Schwing
‹ 上一页 1 2 3 10 下一页 ›