English
Related papers

Related papers: Convergence for score-based generative modeling wi…

200 papers

Score-based generative models (SGMs) are generative models that are in the spotlight these days. Time-series frequently occurs in our daily life, e.g., stock data, climate data, and so on. Especially, time-series forecasting and…

Machine Learning · Computer Science 2023-01-23 Haksoo Lim , Minjung Kim , Sewon Park , Noseong Park

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

How do score-based generative models (SBMs) learn the data distribution supported on a low-dimensional manifold? We investigate the score model of a trained SBM through its linear approximations and subspaces spanned by local feature…

Machine Learning · Statistics 2023-11-17 Li Kevin Wenliang , Ben Moran

Score-based generative models (SGMs) have recently demonstrated impressive results in terms of both sample quality and distribution coverage. However, they are usually applied directly in data space and often require thousands of network…

Machine Learning · Statistics 2021-12-03 Arash Vahdat , Karsten Kreis , Jan Kautz

Score-based generative models (SGMs) have demonstrated unparalleled sampling quality and diversity in numerous fields, such as image generation, voice synthesis, and tabular data synthesis, etc. Inspired by those outstanding results, we…

Machine Learning · Computer Science 2025-11-27 Haksoo Lim , Jaehoon Lee , Sewon Park , Minjung Kim , Noseong Park

Score-based generative models (SGMs) are a recent breakthrough in generating fake images. SGMs are known to surpass other generative models, e.g., generative adversarial networks (GANs) and variational autoencoders (VAEs). Being inspired by…

Machine Learning · Computer Science 2022-06-20 Jayoung Kim , Chaejeong Lee , Yehjin Shin , Sewon Park , Minjung Kim , Noseong Park , Jihoon Cho

We give an improved theoretical analysis of score-based generative modeling. Under a score estimate with small $L^2$ error (averaged across timesteps), we provide efficient convergence guarantees for any data distribution with second-order…

Machine Learning · Computer Science 2023-02-03 Hongrui Chen , Holden Lee , Jianfeng Lu

Score-based generative models (SGMs) have achieved remarkable empirical success, motivating their application to a broad range of data distributions. However, extending them to heavy-tailed targets remains a largely open problem. Although…

Machine Learning · Statistics 2026-05-15 Tiziano Fassina , Gabriel Cardoso , Sylvan Le Corff , Thomas Romary

Score-based diffusion modeling is a generative machine learning algorithm that can be used to sample from complex distributions. They achieve this by learning a score function, i.e., the gradient of the log-probability density of the data,…

Machine Learning · Computer Science 2025-12-17 Dibyajyoti Chakraborty , Haiwen Guan , Jason Stock , Troy Arcomano , Guido Cervone , Romit Maulik

This paper studies the approximation and generalization abilities of score-based neural network generative models (SGMs) in estimating an unknown distribution $P_0$ from $n$ i.i.d. observations in $d$ dimensions. Assuming merely that $P_0$…

Machine Learning · Computer Science 2025-10-28 Guoji Fu , Wee Sun Lee

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

Machine Learning · Computer Science 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

Score-based generative modelling (SGM) has proven to be a very effective method for modelling densities on finite-dimensional spaces. In this work we propose to extend this methodology to learn generative models over functional spaces. To…

Plug-and-play (PnP) methods are widely used for solving imaging inverse problems by incorporating a denoiser into optimization algorithms. Score-based diffusion models (SBDMs) have recently demonstrated strong generative performance through…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Chicago Y. Park , Edward P. Chandler , Yuyang Hu , Michael T. McCann , Cristina Garcia-Cardona , Brendt Wohlberg , Ulugbek S. Kamilov

Score-based generative models (SGMs) aim at estimating a target data distribution by learning score functions using only noise-perturbed samples from the target.Recent literature has focused extensively on assessing the error between the…

Statistics Theory · Mathematics 2025-01-28 Stanislas Strasman , Antonio Ocello , Claire Boyer , Sylvain Le Corff , Vincent Lemaire

Score-based generative models (SGMs) have emerged as one of the most popular classes of generative models. A substantial body of work now exists on the analysis of SGMs, focusing either on discretization aspects or on their statistical…

Machine Learning · Statistics 2026-02-10 Benjamin Dupuis , Dario Shariatian , Maxime Haddouche , Alain Durmus , Umut Simsekli

Score-based generative models (SGMs) have demonstrated remarkable synthesis quality. SGMs rely on a diffusion process that gradually perturbs the data towards a tractable distribution, while the generative model learns to denoise. The…

Machine Learning · Statistics 2022-03-28 Tim Dockhorn , Arash Vahdat , Karsten Kreis

Recent advances in generative models have made exploring design spaces easier for de novo molecule generation. However, popular generative models like GANs and normalizing flows face challenges such as training instabilities due to…

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. The key idea is to produce high-quality images by recurrently adding Gaussian noises and gradients to a Gaussian sample until converging…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jingfeng Zhang , Jianfeng Feng

In practical compressed sensing (CS), the obtained measurements typically necessitate quantization to a limited number of bits prior to transmission or storage. This nonlinear quantization process poses significant recovery challenges,…

Signal Processing · Electrical Eng. & Systems 2024-01-09 Xiangming Meng , Yoshiyuki Kabashima

We present SURE-Score: an approach for learning score-based generative models using training samples corrupted by additive Gaussian noise. When a large training set of clean samples is available, solving inverse problems via score-based…

Machine Learning · Computer Science 2025-04-23 Asad Aali , Marius Arvinte , Sidharth Kumar , Jonathan I. Tamir