中文
相关论文

相关论文: Wasserstein proximal operators describe score-base…

200 篇论文

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually…

机器学习 · 计算机科学 2022-11-23 Valentin De Bortoli , Emile Mathieu , Michael Hutchinson , James Thornton , Yee Whye Teh , Arnaud Doucet

Score-based generative models (SGMs) synthesize new data samples from Gaussian white noise by running a time-reversed Stochastic Differential Equation (SDE) whose drift coefficient depends on some probabilistic score. The discretization of…

机器学习 · 计算机科学 2022-08-11 Florentin Guth , Simon Coste , Valentin De Bortoli , Stephane Mallat

Most existing generative models are limited to learning a single probability distribution from the training data and cannot generalize to novel distributions for unseen data. An architecture that can generate samples from both trained…

机器学习 · 计算机科学 2024-10-16 Xinyu Liao , Aoyang Qin , Jacob Seidman , Junqi Wang , Wei Wang , Paris Perdikaris

We consider the problem of sampling from a distribution governed by a potential function. This work proposes an explicit score based MCMC method that is deterministic, resulting in a deterministic evolution for particles rather than a…

机器学习 · 统计学 2023-10-03 Hong Ye Tan , Stanley Osher , Wuchen Li

The Gromov-Wasserstein (GW) framework adapts ideas from optimal transport to allow for the comparison of probability distributions defined on different metric spaces. Scalable computation of GW distances and associated matchings on graphs…

机器学习 · 计算机科学 2021-05-05 Samir Chowdhury , David Miller , Tom Needham

This paper studies the approximation and generalization abilities of score-based neural network generative models (SGMs) in estimating an unknown distribution $P_0$ from $n$ i.i.d. observations in $d$ dimensions. Assuming merely that $P_0$…

机器学习 · 计算机科学 2025-10-28 Guoji Fu , Wee Sun Lee

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

机器学习 · 计算机科学 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

This study investigates the dynamics of Score-based Generative Models (SGMs) by treating the score estimation error as a stochastic source driving the Fokker-Planck equation. Departing from particle-centric SDE analyses, we employ an SPDE…

机器学习 · 计算机科学 2026-02-10 Junsu Seo

Score-based generative models (SGMs) have emerged as one of the most popular classes of generative models. A substantial body of work now exists on the analysis of SGMs, focusing either on discretization aspects or on their statistical…

机器学习 · 统计学 2026-02-10 Benjamin Dupuis , Dario Shariatian , Maxime Haddouche , Alain Durmus , Umut Simsekli

Score-based generative modeling (SGM) is a highly successful approach for learning a probability distribution from data and generating further samples. We prove the first polynomial convergence guarantees for the core mechanic behind SGM:…

机器学习 · 计算机科学 2023-05-04 Holden Lee , Jianfeng Lu , Yixin Tan

Score-based generative models (SGMs) have revolutionized the field of generative modeling, achieving unprecedented success in generating realistic and diverse content. Despite empirical advances, the theoretical basis for why optimizing the…

机器学习 · 计算机科学 2024-08-30 Gen Li , Yuling Yan

In this paper, we elucidate the geometry of Stein's method of moments (SMoM). SMoM is a parameter estimation method based on the Stein operator, and yields a wide class of estimators that do not depend on the normalizing constant. We…

统计理论 · 数学 2026-03-16 Mitsuki Nagai , Keisuke Yano

Wasserstein Policy Optimization (WPO) is a recently proposed reinforcement learning algorithm that leverages Wasserstein gradient flows to optimize stochastic policies in continuous action spaces. Despite its empirical success, the…

机器学习 · 计算机科学 2026-05-22 David Šiška , Yufei Zhang

We study policy gradient methods for continuous-action, entropy-regularized reinforcement learning through the lens of Wasserstein geometry. Starting from a Wasserstein proximal update, we derive Wasserstein Proximal Policy Gradient (WPPG)…

机器学习 · 计算机科学 2026-03-04 Zhaoyu Zhu , Shuhan Zhang , Rui Gao , Shuang Li

We establish global well-posedness and convergence of the score-based generative models (SGM) under minimal general assumptions of initial data for score estimation. For the smooth case, we start from a Lipschitz bound of the score function…

机器学习 · 计算机科学 2024-05-28 Connor Mooney , Zhongjian Wang , Jack Xin , Yifeng Yu

Score-based generative models (SGMs) are a recent breakthrough in generating fake images. SGMs are known to surpass other generative models, e.g., generative adversarial networks (GANs) and variational autoencoders (VAEs). Being inspired by…

机器学习 · 计算机科学 2022-06-20 Jayoung Kim , Chaejeong Lee , Yehjin Shin , Sewon Park , Minjung Kim , Noseong Park , Jihoon Cho

Generative modeling typically concerns transporting a single source distribution to a target distribution via simple probability flows. However, in fields like computer graphics and single-cell genomics, samples themselves can be viewed as…

机器学习 · 计算机科学 2025-05-20 Doron Haviv , Aram-Alexandre Pooladian , Dana Pe'er , Brandon Amos

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

统计理论 · 数学 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

Score estimation is the backbone of score-based generative models (SGMs), especially denoising diffusion probabilistic models (DDPMs). A key result in this area shows that with accurate score estimates, SGMs can efficiently generate samples…

机器学习 · 统计学 2025-04-08 Sinho Chewi , Alkis Kalavasis , Anay Mehrotra , Omar Montasser

Variational inference, such as the mean-field (MF) approximation, requires certain conjugacy structures for efficient computation. These can impose unnecessary restrictions on the viable prior distribution family and further constraints on…

统计理论 · 数学 2023-09-11 Rentian Yao , Yun Yang