English
Related papers

Related papers: Convergence of Score-Based Discrete Diffusion Mode…

200 papers

We study score-based diffusion modelling in infinite-dimensional separable Hilbert spaces through Malliavin calculus, extending the analysis of generative models beyond the finite-dimensional setting. The forward diffusion process is…

Probability · Mathematics 2026-03-30 Ehsan Mirafzali , Frank Proske , Daniele Venturi , Razvan Marinescu

Mathematically modelling diffusive and advective transport of particles in heterogeneous layered media is important to many applications in computational, biological and medical physics. While deterministic continuum models of such…

Computational Physics · Physics 2024-09-16 Elliot J. Carr

Denoising Diffusion Probabilistic Models (DDPM) are powerful state-of-the-art methods used to generate synthetic data from high-dimensional data distributions and are widely used for image, audio, and video generation as well as many more…

Machine Learning · Statistics 2025-04-25 Iskander Azangulov , George Deligiannidis , Judith Rousseau

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

We provide the first convergence guarantees for the Consistency Models (CMs), a newly emerging type of one-step generative models that can generate comparable samples to those generated by Diffusion Models. Our main result is that, under…

Numerical Analysis · Mathematics 2023-08-23 Junlong Lyu , Zhitang Chen , Shoubo Feng

Discrete diffusion has recently emerged as a promising paradigm in discrete data modeling. However, existing methods typically rely on a fixed rate transition matrix during training, which not only limits the expressiveness of latent…

Machine Learning · Computer Science 2025-05-27 Hengli Li , Yuxuan Wang , Song-Chun Zhu , Ying Nian Wu , Zilong Zheng

Discrete diffusion models offer a flexible, controllable approach to structured sequence generation, yet they still lag behind causal language models in expressive power. A key limitation lies in their reliance on the Markovian assumption,…

Diffusion models are state-of-the-art methods in generative modeling when samples from a target probability distribution are available, and can be efficiently sampled, using score matching to estimate score vectors guiding a Langevin…

Machine Learning · Statistics 2024-06-21 Omar Chehab , Anna Korba

Score-based Generative Models (SGMs) have demonstrated exceptional synthesis outcomes across various tasks. However, the current design landscape of the forward diffusion process remains largely untapped and often relies on physical…

Machine Learning · Computer Science 2023-10-13 Kushagra Pandey , Stephan Mandt

Denoising diffusion probabilistic models and score-matching models have proven to be very powerful for generative tasks. While these approaches have also been applied to the generation of discrete graphs, they have, so far, relied on…

Machine Learning · Computer Science 2023-08-17 Kilian Konstantin Haefeli , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

We are interested in the kernel of one-dimensional diffusion equations with continuous coefficients as evaluated by means of explicit discretization schemes of uniform step $h>0$ in the limit as $h\to0$. We consider both semidiscrete…

Numerical Analysis · Mathematics 2007-11-02 Claudio Albanese

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

Machine Learning · Computer Science 2025-11-14 Eliot Beyler , Francis Bach

We propose a novel sequential Monte Carlo (SMC) method for sampling from unnormalized target distributions based on a reverse denoising diffusion process. While recent diffusion-based samplers simulate the reverse diffusion using…

Computation · Statistics 2025-11-06 Luhuan Wu , Yi Han , Christian A. Naesseth , John P. Cunningham

Diffusion models have emerged as a promising alternative to autoregressive models in modeling discrete categorical data. However, diffusion models that directly work on discrete data space fail to fully exploit the power of iterative…

Machine Learning · Computer Science 2025-10-24 Jaehyeong Jo , Sung Ju Hwang

Near the critical point, Markov Chain Monte Carlo (MCMC) simulations of lattice quantum field theories (LQFT) become increasingly inefficient due to critical slowing down. In this work, we investigate score-based symmetry-preserving…

High Energy Physics - Lattice · Physics 2025-11-04 Octavio Vega , Javad Komijani , Aida El-Khadra , Marina Marinkovic

For a wide class of continuous-time Markov processes, including all irreducible hypoelliptic diffusions evolving on an open, connected subset of $\RL^d$, the following are shown to be equivalent: (i) The process satisfies (a slightly weaker…

Probability · Mathematics 2016-04-27 Ioannis Kontoyiannis , Sean P. Meyn

Diffusion generative models have emerged as powerful tools for producing synthetic data from an empirically observed distribution. A common approach involves simulating the time-reversal of an Ornstein-Uhlenbeck (OU) process initialized at…

Machine Learning · Statistics 2025-12-02 Valentin de Bortoli , Romuald Elie , Anna Kazeykina , Zhenjie Ren , Jiacheng Zhang

Cardiac computed tomography (CT) has emerged as a major imaging modality for the diagnosis and monitoring of cardiovascular diseases. High temporal resolution is essential to ensure diagnostic accuracy. Limited-angle data acquisition can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-12 Shuo Han , Yongshun Xu , Dayang Wang , Bahareh Morovati , Li Zhou , Jonathan S. Maltz , Ge Wang , Hengyong Yu

Selecting an appropriate divergence measure is a critical aspect of machine learning, as it directly impacts model performance. Among the most widely used, we find the Kullback-Leibler (KL) divergence, originally introduced in kinetic…

Mathematical Physics · Physics 2025-07-16 Gennaro Auricchio , Giovanni Brigati , Paolo Giudici , Giuseppe Toscani

Score-based diffusion models have emerged as a powerful class of generative methods, achieving state-of-the-art performance across diverse domains. Despite their empirical success, the mathematical foundations of those models remain only…

Optimization and Control · Mathematics 2026-05-13 Kang Liu , Enrique Zuazua