English
Related papers

Related papers: Elucidating the Design Space of Diffusion-Based Ge…

200 papers

Extensive empirical evidence demonstrates that conditional generative models are easier to train and perform better than unconditional ones by exploiting the labels of data. So do score-based diffusion models. In this paper, we analyze the…

Machine Learning · Computer Science 2022-12-02 Fan Bao , Chongxuan Li , Jiacheng Sun , Jun Zhu

We present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks, normalizing flows, variational auto-encoders, are usually considered as…

Machine Learning · Computer Science 2023-10-24 Yanfang Liu , Minglei Yang , Zezhong Zhang , Feng Bao , Yanzhao Cao , Guannan Zhang

Diffusion generative models transform noise into data by inverting a process that progressively adds noise to data samples. Inspired by concepts from the renormalization group in physics, which analyzes systems across different scales, we…

Machine Learning · Computer Science 2024-10-04 Mathis Gerdes , Max Welling , Miranda C. N. Cheng

Structural topology optimization, which aims to find the optimal physical structure that maximizes mechanical performance, is vital in engineering design applications in aerospace, mechanical, and civil engineering. Generative adversarial…

Machine Learning · Computer Science 2022-12-07 François Mazé , Faez Ahmed

Consistency models are a nascent family of generative models that can sample high quality data in one step without the need for adversarial training. Current consistency models achieve optimal sample quality by distilling from pre-trained…

Machine Learning · Computer Science 2023-10-24 Yang Song , Prafulla Dhariwal

Consistency models (CMs) are a powerful class of diffusion-based generative models optimized for fast sampling. Most existing CMs are trained using discretized timesteps, which introduce additional hyperparameters and are prone to…

Machine Learning · Computer Science 2025-03-04 Cheng Lu , Yang Song

Generated images of score-based models can suffer from errors in their spatial means, an effect, referred to as a color shift, which grows for larger images. This paper investigates a previously-introduced approach to mitigate color shifts…

Machine Learning · Computer Science 2023-11-30 Katherine Deck , Tobias Bischoff

Guided diffusion is a technique for conditioning the output of a diffusion model at sampling time without retraining the network for each specific task. One drawback of diffusion models, however, is their slow sampling process. Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Suttisak Wizadwongsa , Supasorn Suwajanakorn

Diffusion models are generative models that have shown significant advantages compared to other generative models in terms of higher generation quality and more stable training. However, the computational need for training diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Gulcin Baykal , Halil Faruk Karagoz , Taha Binhuraib , Gozde Unal

Recent advancements in diffusion models have revolutionized generative modeling. However, the impressive and vivid outputs they produce often come at the cost of significant model scaling and increased computational demands. Consequently,…

Machine Learning · Computer Science 2025-04-03 Jincheng Zhong , Xiangcheng Zhang , Jianmin Wang , Mingsheng Long

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

Machine Learning · Computer Science 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

The advancements in generative modeling, particularly the advent of diffusion models, have sparked a fundamental question: how can these models be effectively used for discriminative tasks? In this work, we find that generative models can…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Mihir Prabhudesai , Tsung-Wei Ke , Alexander C. Li , Deepak Pathak , Katerina Fragkiadaki

Diffusion generative models have achieved remarkable success in generating images with a fixed resolution. However, existing models have limited ability to generalize to different resolutions when training data at those resolutions are not…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Alex Havrilla , Kevin Rojas , Wenjing Liao , Molei Tao

Edge detection is typically viewed as a pixel-level classification problem mainly addressed by discriminative methods. Recently, generative edge detection methods, especially diffusion model based solutions, are initialized in the edge…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Caixia Zhou , Yaping Huang , Mochu Xiang , Jiahui Ren , Haibin Ling , Jing Zhang

We introduce Spectral Guidance, a framework for controlling diffusion models by leveraging the intrinsic geometry of the generative process. As data is progressively corrupted by noise, only a small number of features remain informative for…

Machine Learning · Computer Science 2026-05-29 Gabriel Moreira , Manuel Marques , João Paulo Costeira , Chenyan Xiong

Generative models, such as GANs and diffusion models, have been used to augment training sets and boost performances in different tasks. We focus on generative models for cell detection instead, i.e., locating and classifying cells in given…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chen Li , Xiaoling Hu , Shahira Abousamra , Meilong Xu , Chao Chen

Despite the remarkable generation capabilities of Diffusion Models (DMs), conducting training and inference remains computationally expensive. Previous works have been devoted to accelerating diffusion sampling, but achieving data-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yize Li , Yihua Zhang , Sijia Liu , Xue Lin

Diffusion models have demonstrated exceptional efficacy in various generative applications. While existing models focus on minimizing a weighted sum of denoising score matching losses for data distribution modeling, their training primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Ling Yang , Haotian Qian , Zhilong Zhang , Jingwei Liu , Bin Cui

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen

Diffusion models suffer from slow sample generation at inference time. Therefore, developing a principled framework for fast deterministic/stochastic sampling for a broader class of diffusion models is a promising direction. We propose two…

Machine Learning · Computer Science 2023-10-13 Kushagra Pandey , Maja Rudolph , Stephan Mandt