中文
相关论文

相关论文: S$^{2}$-DMs:Skip-Step Diffusion Models

200 篇论文

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang

Diffusion models (DMs) have demonstrated exceptional generative capabilities across various domains, including image, video, and so on. A key factor contributing to their effectiveness is the high quantity and quality of data used during…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Qianlong Xiang , Miao Zhang , Yuzhang Shang , Jianlong Wu , Yan Yan , Liqiang Nie

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Denoising diffusion probabilistic models (DDPMs) have achieved high quality image generation without adversarial training, yet they require simulating a Markov chain for many steps to produce a sample. To accelerate sampling, we present…

机器学习 · 计算机科学 2022-10-07 Jiaming Song , Chenlin Meng , Stefano Ermon

Denoising diffusion probabilistic models (DDPMs) have emerged as competitive generative models yet brought challenges to efficient sampling. In this paper, we propose novel bilateral denoising diffusion models (BDDMs), which take…

机器学习 · 计算机科学 2021-09-15 Max W. Y. Lam , Jun Wang , Rongjie Huang , Dan Su , Dong Yu

Diffusion models are powerful generative models but suffer from slow sampling, often taking 1000 sequential denoising steps for one sample. As a result, considerable efforts have been directed toward reducing the number of denoising steps,…

机器学习 · 计算机科学 2023-10-17 Andy Shih , Suneel Belkhale , Stefano Ermon , Dorsa Sadigh , Nima Anari

With the incorporation of the UNet architecture, diffusion probabilistic models have become a dominant force in image generation tasks. One key design in UNet is the skip connections between the encoder and decoder blocks. Although skip…

机器学习 · 计算机科学 2024-02-26 Jiajun Ma , Shuchen Xue , Tianyang Hu , Wenjia Wang , Zhaoqiang Liu , Zhenguo Li , Zhi-Ming Ma , Kenji Kawaguchi

Diffusion models generate high-quality images but require dozens of forward passes. We introduce Distribution Matching Distillation (DMD), a procedure to transform a diffusion model into a one-step image generator with minimal impact on…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Tianwei Yin , Michaël Gharbi , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman , Taesung Park

Despite the proliferation of generative models, achieving fast sampling during inference without compromising sample diversity and quality remains challenging. Existing models such as Denoising Diffusion Probabilistic Models (DDPM) deliver…

机器学习 · 计算机科学 2023-10-12 Yanwu Xu , Mingming Gong , Shaoan Xie , Wei Wei , Matthias Grundmann , Kayhan Batmanghelich , Tingbo Hou

The Stable Diffusion Model (SDM) is a popular and efficient text-to-image (t2i) generation and image-to-image (i2i) generation model. Although there have been some attempts to reduce sampling steps, model distillation, and network…

计算机视觉与模式识别 · 计算机科学 2024-03-06 Jinchao Zhu , Yuxuan Wang , Xiaobing Tu , Siyuan Pan , Pengfei Wan , Gao Huang

Denoising Diffusion Models (DDMs) have become a popular tool for generating high-quality samples from complex data distributions. These models are able to capture sophisticated patterns and structures in the data, and can generate samples…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Emanuele Aiello , Diego Valsesia , Enrico Magli

Diffusion models (DMs) have become the leading choice for generative tasks across diverse domains. However, their reliance on multiple sequential forward passes significantly limits real-time performance. Previous acceleration methods have…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Ziming Liu , Yifan Yang , Chengruidong Zhang , Yiqi Zhang , Lili Qiu , Yang You , Yuqing Yang

Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Tianwei Yin , Michaël Gharbi , Taesung Park , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman

Score-based diffusion models, while achieving remarkable empirical performance, often suffer from low sampling speed, due to extensive function evaluations needed during the sampling phase. Despite a flurry of recent activities towards…

机器学习 · 计算机科学 2024-03-07 Gen Li , Yu Huang , Timofey Efimov , Yuting Wei , Yuejie Chi , Yuxin Chen

Denoising diffusion probabilistic models (DDPM) are a class of generative models which have recently been shown to produce excellent samples. We show that with a few simple modifications, DDPMs can also achieve competitive log-likelihoods…

机器学习 · 计算机科学 2021-02-22 Alex Nichol , Prafulla Dhariwal

Diffusion models have demonstrated impressive generative capabilities, but their \textit{exposure bias} problem, described as the input mismatch between training and sampling, lacks in-depth exploration. In this paper, we systematically…

机器学习 · 计算机科学 2024-04-12 Mang Ning , Mingxiao Li , Jianlin Su , Albert Ali Salah , Itir Onal Ertugrul

Strong generative models can accurately learn channel distributions. This could save recurring costs for physical measurements of the channel. Moreover, the resulting differentiable channel model supports training neural encoders by…

信息论 · 计算机科学 2024-06-12 Muah Kim , Rick Fritschek , Rafael F. Schaefer

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

图像与视频处理 · 电气工程与系统科学 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Diffusion Models~(DMs) have emerged as the dominant approach in Generative Artificial Intelligence (GenAI), owing to their remarkable performance in tasks such as text-to-image synthesis. However, practical DMs, such as stable diffusion,…

机器学习 · 计算机科学 2025-08-18 Xuhui Fan , Zhangkai Wu , Hongyu Wu

Diffusion modeling (DM) has high-quality generative performance, and the sampling problem is an important part of the DM performance. Thanks to efficient differential equation solvers, the sampling speed can be reduced while higher sampling…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Zitong Cheng