English
Related papers

Related papers: Preconditioned Score-based Generative Models

200 papers

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

Score-based Generative Models (SGMs) have demonstrated exceptional synthesis outcomes across various tasks. However, the current design landscape of the forward diffusion process remains largely untapped and often relies on physical…

Machine Learning · Computer Science 2023-10-13 Kushagra Pandey , Stephan Mandt

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. The key idea is to produce high-quality images by recurrently adding Gaussian noises and gradients to a Gaussian sample until converging…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jingfeng Zhang , Jianfeng Feng

Score-based generative models (SGMs) have demonstrated remarkable synthesis quality. SGMs rely on a diffusion process that gradually perturbs the data towards a tractable distribution, while the generative model learns to denoise. The…

Machine Learning · Statistics 2022-03-28 Tim Dockhorn , Arash Vahdat , Karsten Kreis

Score-based generative models have demonstrated significant practical success in data-generating tasks. The models establish a diffusion process that perturbs the ground truth data to Gaussian noise and then learn the reverse process to…

Machine Learning · Computer Science 2024-05-24 Ziqing Wen , Xiaoge Deng , Ping Luo , Tao Sun , Dongsheng Li

Diffusion models have emerged as an expressive family of generative models rivaling GANs in sample quality and autoregressive models in likelihood scores. Standard diffusion models typically require hundreds of forward passes through the…

Machine Learning · Computer Science 2022-02-14 Daniel Watson , William Chan , Jonathan Ho , Mohammad Norouzi

Score-based generative models (SGMs) are powerful tools to sample from complex data distributions. Their underlying idea is to (i) run a forward process for time $T_1$ by adding noise to the data, (ii) estimate its score function, and (iii)…

Machine Learning · Computer Science 2024-06-06 Francesco Pedrotti , Jan Maas , Marco Mondelli

We introduce Posterior Distillation Sampling (PDS), a novel optimization method for parametric image editing based on diffusion models. Existing optimization-based methods, which leverage the powerful 2D prior of diffusion models to handle…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Juil Koo , Chanho Park , Minhyuk Sung

Diffusion-based generative models (DGMs) have recently attracted attention in speech enhancement research (SE) as previous works showed a remarkable generalization capability. However, DGMs are also computationally intensive, as they…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Chenda Li , Samuele Cornell , Shinji Watanabe , Yanmin Qian

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Diffusion models have emerged as powerful generative tools, rivaling GANs in sample quality and mirroring the likelihood scores of autoregressive models. A subset of these models, exemplified by DDIMs, exhibit an inherent asymmetry: they…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yixuan Wang , Shuangyin Li

A valuable step in the modeling of multiscale dynamical systems in fields such as computational chemistry, biology, materials science and more, is the representative sampling of the phase space over long timescales of interest; this task is…

Machine Learning · Computer Science 2023-12-29 Ellis R. Crabtree , Juan M. Bello-Rivas , Ioannis G. Kevrekidis

Recent advancements in diffusion models have been leveraged to address inverse problems without additional training, and Diffusion Posterior Sampling (DPS) (Chung et al., 2022a) is among the most popular approaches. Previous analyses…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Tongda Xu , Xiyan Cai , Xinjie Zhang , Xingtong Ge , Dailan He , Ming Sun , Jingjing Liu , Ya-Qin Zhang , Jian Li , Yan Wang

Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the analytical intractability of the time-dependent likelihood score. To bridge this gap, we…

Optimization and Control · Mathematics 2026-05-28 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu

We provide theoretical convergence guarantees for score-based generative models (SGMs) such as denoising diffusion probabilistic models (DDPMs), which constitute the backbone of large-scale real-world generative models such as DALL$\cdot$E…

Machine Learning · Computer Science 2023-04-18 Sitan Chen , Sinho Chewi , Jerry Li , Yuanzhi Li , Adil Salim , Anru R. Zhang

Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling. In this work we conduct a systematic comparison and theoretical analysis of different approaches to learning conditional…

Machine Learning · Computer Science 2021-11-29 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb , Christian Etmann

In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems…

Computational Engineering, Finance, and Science · Computer Science 2024-08-30 Yankun Hong , Harshit Bansal , Karen Veroy

Diffusion models have recently shown great promise for generative modeling, outperforming GANs on perceptual quality and autoregressive models at density estimation. A remaining downside is their slow sampling time: generating high quality…

Machine Learning · Computer Science 2022-06-08 Tim Salimans , Jonathan Ho

Score-based generative models based on stochastic differential equations (SDEs) achieve impressive performance in sampling from unknown distributions, but often fail to satisfy underlying constraints. We propose a constrained generative…

Machine Learning · Statistics 2025-10-29 Adam Nordenhög , Akash Sharma

Diffusion models have been achieving state-of-the-art results across various generation tasks. However, a notable drawback is their sequential generation process, requiring long-sequence step-by-step generation. Existing methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Wenju Xu
‹ Prev 1 2 3 10 Next ›