English
Related papers

Related papers: Beyond Log-Concavity and Score Regularity: Improve…

200 papers

Discrete time analogues of ergodic stochastic differential equations (SDEs) are one of the most popular and flexible tools for sampling high-dimensional probability measures. Non-asymptotic analysis in the $L^2$ Wasserstein distance of…

Probability · Mathematics 2019-10-11 Mateusz B. Majka , Aleksandar Mijatović , Lukasz Szpruch

Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling, due to their state-of-the art performance in many generation tasks while relying on mathematical foundations such as stochastic…

Machine Learning · Computer Science 2023-11-28 Teo Deveney , Jan Stanczuk , Lisa Maria Kreusser , Chris Budd , Carola-Bibiane Schönlieb

Score-based generative models are shown to achieve remarkable empirical performances in various applications such as image generation and audio synthesis. However, a theoretical understanding of score-based diffusion models is still…

Machine Learning · Computer Science 2022-12-14 Dohyun Kwon , Ying Fan , Kangwook Lee

Score-based generative modeling with probability flow ordinary differential equations (ODEs) has achieved remarkable success in a variety of applications. While various fast ODE-based samplers have been proposed in the literature and…

Machine Learning · Statistics 2025-08-12 Xuefeng Gao , Lingjiong Zhu

We establish global well-posedness and convergence of the score-based generative models (SGM) under minimal general assumptions of initial data for score estimation. For the smooth case, we start from a Lipschitz bound of the score function…

Machine Learning · Computer Science 2024-05-28 Connor Mooney , Zhongjian Wang , Jack Xin , Yifeng Yu

Diffusion models are a new class of generative models that revolve around the estimation of the score function associated with a stochastic differential equation. Subsequent to its acquisition, the approximated score function is then…

Statistics Theory · Mathematics 2024-09-13 Giovanni Conforti , Alain Durmus , Marta Gentiloni Silveri

Score-based Generative Models (SGMs) is one leading method in generative modeling, renowned for their ability to generate high-quality samples from complex, high-dimensional data distributions. The method enjoys empirical success and is…

Machine Learning · Computer Science 2024-01-30 Sixu Li , Shi Chen , Qin Li

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

Machine Learning · Computer Science 2025-11-14 Eliot Beyler , Francis Bach

Score-based generative models (SGMs) have revolutionized the field of generative modeling, achieving unprecedented success in generating realistic and diverse content. Despite empirical advances, the theoretical basis for why optimizing the…

Machine Learning · Computer Science 2024-08-30 Gen Li , Yuling Yan

Score-based generative models (SGMs) have demonstrated remarkable synthesis quality. SGMs rely on a diffusion process that gradually perturbs the data towards a tractable distribution, while the generative model learns to denoise. The…

Machine Learning · Statistics 2022-03-28 Tim Dockhorn , Arash Vahdat , Karsten Kreis

We study the regularity of the score function in score-based generative models and show that it naturally adapts to the smoothness of the data distribution. Under minimal assumptions, we establish Lipschitz estimates that directly support…

Statistics Theory · Mathematics 2025-06-25 Arthur Stéphanovitch

Symmetry is ubiquitous in many real-world phenomena and tasks, such as physics, images, and molecular simulations. Empirical studies have demonstrated that incorporating symmetries into generative models can provide better generalization…

Machine Learning · Statistics 2026-05-12 Ziyu Chen , Markos A. Katsoulakis , Benjamin J. Zhang

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually…

Machine Learning · Computer Science 2022-11-23 Valentin De Bortoli , Emile Mathieu , Michael Hutchinson , James Thornton , Yee Whye Teh , Arnaud Doucet

Diffusion models have quickly become some of the most popular and powerful generative models for high-dimensional data. The key insight that enabled their development was the realization that access to the score -- the gradient of the…

Machine Learning · Computer Science 2025-12-01 Zhenghan Fang , Mateo Díaz , Sam Buchanan , Jeremias Sulam

Multiscale dynamical systems characterized by interacting fast and slow processes are ubiquitous across scientific domains, from climate dynamics to fluid mechanics. Accurate modeling of such systems requires capturing both the long-term…

Chaotic Dynamics · Physics 2025-11-07 Giulio Del Felice , Ludovico Theo Giorgini

Score-based generative models, which transform noise into data by learning to reverse a diffusion process, have become a cornerstone of modern generative AI. This paper contributes to establishing theoretical guarantees for the probability…

Machine Learning · Statistics 2025-02-03 Jiaqi Tang , Yuling Yan

We focus on the fundamental mathematical structure of score-based generative models (SGMs). We first formulate SGMs in terms of the Wasserstein proximal operator (WPO) and demonstrate that, via mean-field games (MFGs), the WPO formulation…

Machine Learning · Statistics 2024-02-12 Benjamin J. Zhang , Siting Liu , Wuchen Li , Markos A. Katsoulakis , Stanley J. Osher

Score-based generative models are a popular class of generative modelling techniques relying on stochastic differential equations (SDE). From their inception, it was realized that it was also possible to perform generation using ordinary…

Machine Learning · Statistics 2024-02-13 Joe Benton , George Deligiannidis , Arnaud Doucet

The incorporation of generative models as regularisers within variational formulations for inverse problems has proven effective across numerous image reconstruction tasks. However, the resulting optimisation problem is often non-convex and…

Machine Learning · Computer Science 2024-08-14 Pascal Fernsel , Željko Kereta , Alexander Denker

Shot noise processes have been extensively studied due to their mathematical properties and their relevance in several applications. Here, we consider nonnegative shot noise processes and prove their weak convergence to L\'evy-driven…

Probability · Mathematics 2021-02-24 Massimiliano Tamborrino , Petr Lansky