English
Related papers

Related papers: A Good Score Does not Lead to A Good Generative Mo…

200 papers

Score-based generative models (SGMs) need to approximate the scores $\nabla \log p_t$ of the intermediate distributions as well as the final distribution $p_T$ of the forward process. The theoretical underpinnings of the effects of these…

Machine Learning · Statistics 2022-10-18 Jakiw Pidstrigach

Score-based generative modeling (SGM) is a highly successful approach for learning a probability distribution from data and generating further samples. We prove the first polynomial convergence guarantees for the core mechanic behind SGM:…

Machine Learning · Computer Science 2023-05-04 Holden Lee , Jianfeng Lu , Yixin Tan

Score-based generative modeling (SGM) has grown to be a hugely successful method for learning to generate samples from complex data distributions such as that of images and audio. It is based on evolving an SDE that transforms white noise…

Machine Learning · Computer Science 2022-10-04 Holden Lee , Jianfeng Lu , Yixin Tan

A valuable step in the modeling of multiscale dynamical systems in fields such as computational chemistry, biology, materials science and more, is the representative sampling of the phase space over long timescales of interest; this task is…

Machine Learning · Computer Science 2023-12-29 Ellis R. Crabtree , Juan M. Bello-Rivas , Ioannis G. Kevrekidis

Score-based generative models (SGMs) are generative models that are in the spotlight these days. Time-series frequently occurs in our daily life, e.g., stock data, climate data, and so on. Especially, time-series forecasting and…

Machine Learning · Computer Science 2023-01-23 Haksoo Lim , Minjung Kim , Sewon Park , Noseong Park

While score-based generative models (SGMs) have achieved remarkable success in enormous image generation tasks, their mathematical foundations are still limited. In this paper, we analyze the approximation and generalization of SGMs in…

Machine Learning · Statistics 2024-02-26 Frank Cole , Yulong Lu

Score-based generative models (SGMs) sample from a target distribution by iteratively transforming noise using the score function of the perturbed target. For any finite training set, this score function can be evaluated in closed form, but…

Machine Learning · Computer Science 2025-05-07 Christopher Scarvelis , Haitz Sáez de Ocáriz Borde , Justin Solomon

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually…

Machine Learning · Computer Science 2022-11-23 Valentin De Bortoli , Emile Mathieu , Michael Hutchinson , James Thornton , Yee Whye Teh , Arnaud Doucet

Score-based generative models (SGMs) are a recent breakthrough in generating fake images. SGMs are known to surpass other generative models, e.g., generative adversarial networks (GANs) and variational autoencoders (VAEs). Being inspired by…

Machine Learning · Computer Science 2022-06-20 Jayoung Kim , Chaejeong Lee , Yehjin Shin , Sewon Park , Minjung Kim , Noseong Park , Jihoon Cho

Score-based generative modelling (SGM) has proven to be a very effective method for modelling densities on finite-dimensional spaces. In this work we propose to extend this methodology to learn generative models over functional spaces. To…

Score-based generative models can produce high quality image samples comparable to GANs, without requiring adversarial optimization. However, existing training procedures are limited to images of low resolution (typically below 32x32), and…

Machine Learning · Computer Science 2020-10-27 Yang Song , Stefano Ermon

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. The key idea is to produce high-quality images by recurrently adding Gaussian noises and gradients to a Gaussian sample until converging…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jingfeng Zhang , Jianfeng Feng

Score-based generative models (SGMs) are a popular family of deep generative models that achieve leading image generation quality. Early studies extend SGMs to tackle class-conditional generation by coupling an unconditional SGM with the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Paul Kuo-Ming Huang , Si-An Chen , Hsuan-Tien Lin

Score-based generative models (SGMs) have emerged as one of the most popular classes of generative models. A substantial body of work now exists on the analysis of SGMs, focusing either on discretization aspects or on their statistical…

Machine Learning · Statistics 2026-02-10 Benjamin Dupuis , Dario Shariatian , Maxime Haddouche , Alain Durmus , Umut Simsekli

Score-based generative models (SGMs) have recently demonstrated impressive results in terms of both sample quality and distribution coverage. However, they are usually applied directly in data space and often require thousands of network…

Machine Learning · Statistics 2021-12-03 Arash Vahdat , Karsten Kreis , Jan Kautz

Score-based generative models have demonstrated significant practical success in data-generating tasks. The models establish a diffusion process that perturbs the ground truth data to Gaussian noise and then learn the reverse process to…

Machine Learning · Computer Science 2024-05-24 Ziqing Wen , Xiaoge Deng , Ping Luo , Tao Sun , Dongsheng Li

Score-based generative models (SGMs) are powerful tools to sample from complex data distributions. Their underlying idea is to (i) run a forward process for time $T_1$ by adding noise to the data, (ii) estimate its score function, and (iii)…

Machine Learning · Computer Science 2024-06-06 Francesco Pedrotti , Jan Maas , Marco Mondelli

Score-based generative models can effectively learn the distribution of data by estimating the gradient of the distribution. Due to the multi-step denoising characteristic, researchers have recently considered combining score-based…

Machine Learning · Computer Science 2024-12-17 Changyuan Zhao , Hongyang Du , Guangyuan Liu , Dusit Niyato

How do score-based generative models (SBMs) learn the data distribution supported on a low-dimensional manifold? We investigate the score model of a trained SBM through its linear approximations and subspaces spanned by local feature…

Machine Learning · Statistics 2023-11-17 Li Kevin Wenliang , Ben Moran

We provide theoretical convergence guarantees for score-based generative models (SGMs) such as denoising diffusion probabilistic models (DDPMs), which constitute the backbone of large-scale real-world generative models such as DALL$\cdot$E…

Machine Learning · Computer Science 2023-04-18 Sitan Chen , Sinho Chewi , Jerry Li , Yuanzhi Li , Adil Salim , Anru R. Zhang
‹ Prev 1 2 3 10 Next ›