English
Related papers

Related papers: Multi-scale Generative Modeling for Fast Sampling

200 papers

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their sampling process is slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Hengyuan Ma , Xiatian Zhu , Jianfeng Feng , Li Zhang

This paper explores the use of score-based diffusion models for Bayesian image reconstruction. Diffusion models are an efficient tool for generative modeling. Diffusion models can also be used for solving image reconstruction problems. We…

Image and Video Processing · Electrical Eng. & Systems 2025-10-06 Michael T. McCann , Hyungjin Chung , Jong Chul Ye , Marc L. Klasky

We explore the methodology and theory of reward-directed generation via conditional diffusion models. Directed generation aims to generate samples with desired properties as measured by a reward function, which has broad applications in…

Machine Learning · Computer Science 2023-07-17 Hui Yuan , Kaixuan Huang , Chengzhuo Ni , Minshuo Chen , Mengdi Wang

Score-based diffusion models have significantly advanced generative deep learning for image processing. Measurement conditioned models have also been applied to inverse problems such as CT reconstruction. However, the conventional approach,…

Medical Physics · Physics 2025-02-24 Matthew Tivnan , Dufan Wu , Quanzheng Li

Learning generative models for graph-structured data is challenging because graphs are discrete, combinatorial, and the underlying data distribution is invariant to the ordering of nodes. However, most of the existing generative models for…

Machine Learning · Computer Science 2020-03-03 Chenhao Niu , Yang Song , Jiaming Song , Shengjia Zhao , Aditya Grover , Stefano Ermon

Diffusion models have shown remarkable performance in generation problems over various domains including images, videos, text, and audio. A practical bottleneck of diffusion models is their sampling speed, due to the repeated evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Taehong Moon , Moonseok Choi , EungGu Yun , Jongmin Yoon , Gayoung Lee , Jaewoong Cho , Juho Lee

Generative diffusion models synthesize new samples by reversing a diffusive process that converts a given data set to generic noise. This is accomplished by training a neural network to match the gradient of the log of the probability…

Machine Learning · Computer Science 2023-10-11 Akhil Premkumar

We investigate the approximation efficiency of score functions by deep neural networks in diffusion-based generative modeling. While existing approximation theories utilize the smoothness of score functions, they suffer from the curse of…

Machine Learning · Computer Science 2023-09-21 Song Mei , Yuchen Wu

Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the analytical intractability of the time-dependent likelihood score. To bridge this gap, we…

Optimization and Control · Mathematics 2026-05-28 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu

Score-based generative models (SGMs) have demonstrated remarkable synthesis quality. SGMs rely on a diffusion process that gradually perturbs the data towards a tractable distribution, while the generative model learns to denoise. The…

Machine Learning · Statistics 2022-03-28 Tim Dockhorn , Arash Vahdat , Karsten Kreis

Recently, Denoising Diffusion Probabilistic Models (DDPMs) have attained leading performances across a diverse range of generative tasks. However, in the field of speech synthesis, although DDPMs exhibit impressive performance, their long…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Xiangyu Zhang , Daijiao Liu , Hexin Liu , Qiquan Zhang , Hanyu Meng , Leibny Paola Garcia , Eng Siong Chng , Lina Yao

Generative modeling of time series is a central challenge in time series analysis, particularly under data-scarce conditions. Despite recent advances in generative modeling, a comprehensive understanding of how state-of-the-art generative…

Machine Learning · Computer Science 2025-05-28 Tal Gonen , Itai Pemper , Ilan Naiman , Nimrod Berman , Omri Azencot

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

The reconstruction of unsteady flow fields from limited measurements is a challenging and crucial task for many engineering applications. Machine learning models are gaining popularity for solving this problem due to their ability to learn…

Fluid Dynamics · Physics 2026-01-09 Marc Amorós-Trepat , Luis Medrano-Navarro , Qiang Liu , Luca Guastoni , Nils Thuerey

Variable selection for high-dimensional, highly correlated data has long been a challenging problem, often yielding unstable and unreliable models. We propose a resample-aggregate framework that exploits diffusion models' ability to…

Methodology · Statistics 2025-08-20 Minjie Wang , Xiaotong Shen , Wei Pan

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

Machine Learning · Statistics 2025-06-13 Justin Le

We present a novel approach to reconstruct gas and dark matter projected density maps of galaxy clusters using score-based generative modeling. Our diffusion model takes in mock SZ and X-ray images as conditional inputs, and generates…

Cosmology and Nongalactic Astrophysics · Physics 2025-07-16 Alan Hsu , Matthew Ho , Joyce Lin , Carleen Markey , Michelle Ntampaka , Hy Trac , Barnabás Póczos

Score-based Generative Models (SGMs) is one leading method in generative modeling, renowned for their ability to generate high-quality samples from complex, high-dimensional data distributions. The method enjoys empirical success and is…

Machine Learning · Computer Science 2024-01-30 Sixu Li , Shi Chen , Qin Li

Score-based generative models and diffusion probabilistic models have been successful at generating high-quality samples in continuous domains such as images and audio. However, due to their Langevin-inspired sampling mechanisms, their…

Sound · Computer Science 2021-11-29 Gautam Mittal , Jesse Engel , Curtis Hawthorne , Ian Simon

Diffusion models have shown impressive performance for image generation, often times outperforming other generative models. Since their introduction, researchers have extended the powerful noise-to-image denoising pipeline to discriminative…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu