中文
相关论文

相关论文: Advancing Wasserstein Convergence Analysis of Scor…

200 篇论文

Diffusion models are one of the most important families of deep generative models. In this note, we derive a quantitative upper bound on the Wasserstein distance between the data-generating distribution and the distribution learned by a…

机器学习 · 计算机科学 2024-09-17 Sokhna Diarra Mbacke , Omar Rivasplata

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

统计理论 · 数学 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

统计计算 · 统计学 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

Discretized Langevin diffusions are efficient Monte Carlo methods for sampling from high dimensional target densities that are log-Lipschitz-smooth and (strongly) log-concave. In particular, the Euclidean Langevin Monte Carlo sampling…

统计理论 · 数学 2020-02-12 Kelvin Shuangjian Zhang , Gabriel Peyré , Jalal Fadili , Marcelo Pereyra

We present an estimate of the Wasserstein distance between the data distribution and the generation of score-based generative models. The sampling complexity with respect to dimension is $\mathcal{O}(\sqrt{d})$, with a logarithmic constant.…

机器学习 · 计算机科学 2025-10-06 Xixian Wang , Zhongjian Wang

Score diffusion methods can learn probability densities from samples. The score of the noise-corrupted density is estimated using a deep neural network, which is then used to iteratively transport a Gaussian white noise density to a target…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Zahra Kadkhodaie , Stéphane Mallat , Eero P. Simoncelli

Wasserstein Discriminant Analysis (WDA) is a new supervised method that can improve classification of high-dimensional data by computing a suitable linear map onto a lower dimensional subspace. Following the blueprint of classical Linear…

机器学习 · 统计学 2018-09-21 Rémi Flamary , Marco Cuturi , Nicolas Courty , Alain Rakotomamonjy

Diffusion and flow matching models generate high-fidelity data by simulating paths defined by Ordinary or Stochastic Differential Equations (ODEs/SDEs), starting from a tractable prior distribution. The probability flow ODE formulation…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Liangyu Yuan , Ruoyu Wang , Tong Zhao , Dingwen Fu , Mingkun Lei , Beier Zhu , Chi Zhang

While diffusion models show promising results in image editing given a target prompt, achieving both prompt fidelity and background preservation remains difficult. Recent works have introduced score distillation techniques that leverage the…

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals --…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Chicago Y. Park , Michael T. McCann , Cristina Garcia-Cardona , Brendt Wohlberg , Ulugbek S. Kamilov

In this paper, we establish sharp upper and lower bounds on the convergence rate of the empirical measures of point processes under the Wasserstein distance. To this end, we first introduce a new metric on the space of counting measures…

统计理论 · 数学 2026-04-28 Dongzhou Huang , Tianyi Jiang , Haonan Wang

Score-based generative models have emerged as a powerful approach for sampling high-dimensional probability distributions. Despite their effectiveness, their theoretical underpinnings remain relatively underdeveloped. In this work, we study…

机器学习 · 计算机科学 2025-04-22 Daniel Zhengyu Huang , Jiaoyang Huang , Zhengjiang Lin

Diffusion models are a new class of generative models that revolve around the estimation of the score function associated with a stochastic differential equation. Subsequent to its acquisition, the approximated score function is then…

统计理论 · 数学 2024-09-13 Giovanni Conforti , Alain Durmus , Marta Gentiloni Silveri

Wasserstein gradient flows provide a powerful means of understanding and solving many diffusion equations. Specifically, Fokker-Planck equations, which model the diffusion of probability measures, can be understood as gradient descent over…

机器学习 · 计算机科学 2021-10-26 Petr Mokrov , Alexander Korotin , Lingxiao Li , Aude Genevay , Justin Solomon , Evgeny Burnaev

Conventional score-based diffusion models (DMs) may struggle with anisotropic Gaussian diffusion processes due to the required inversion of covariance matrices in the denoising score matching training objective…

图像与视频处理 · 电气工程与系统科学 2025-11-18 Jeffrey Alido , Tongyu Li , Yu Sun , Lei Tian

Diffusion Models (DMs), also referred to as score-based diffusion models, utilize neural networks to specify score functions. Unlike most other probabilistic models, DMs directly model the score functions, which makes them more flexible to…

机器学习 · 计算机科学 2023-04-11 Weijian Luo

Diffusion models accomplish remarkable success in data generation tasks across various domains. However, the iterative sampling process is computationally expensive. Consistency models are proposed to learn consistency functions to map from…

机器学习 · 计算机科学 2025-05-07 Yiding Chen , Yiyi Zhang , Owen Oertell , Wen Sun

Von Renesse and the author (Ann. Prob. '09) developed a second order calculus on the Wasserstein space P([0,1]) of probability measures on the unit interval. The basic objects of interest had been Dirichlet form, semigroup and continuous…

概率论 · 数学 2011-05-20 Karl-Theodor Sturm

The squared Wasserstein distance is a natural quantity to compare probability distributions in a non-parametric setting. This quantity is usually estimated with the plug-in estimator, defined via a discrete optimal transport problem which…

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

机器学习 · 计算机科学 2025-01-03 Gen Li , Yuling Yan