English
Related papers

Related papers: Not All Noises Are Created Equally:Diffusion Noise…

200 papers

Diffusion models have achieved remarkable success in generating samples from unknown data distributions. Most popular stochastic differential equation-based diffusion models perturb the target distribution by adding Gaussian noise,…

Machine Learning · Statistics 2026-05-20 Wenpin Tang , Nizar Touzi , Zikun Zhang , Xun Yu Zhou

Diffusion models have achieved remarkable success in image and video generation. In this work, we demonstrate that diffusion models can also \textit{generate high-performing neural network parameters}. Our approach is simple, utilizing an…

Machine Learning · Computer Science 2025-01-03 Kai Wang , Dongwen Tang , Boya Zeng , Yida Yin , Zhaopan Xu , Yukun Zhou , Zelin Zang , Trevor Darrell , Zhuang Liu , Yang You

Diffusion models are distinguished by their exceptional generative performance, particularly in producing high-quality samples through iterative denoising. While current theory suggests that the number of denoising steps required for…

Machine Learning · Computer Science 2025-04-08 Gen Li , Changxiao Cai , Yuting Wei

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

Machine Learning · Computer Science 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

We explore the problem of generating minority samples using diffusion models. The minority samples are instances that lie on low-density regions of a data manifold. Generating a sufficient number of such minority instances is important,…

Machine Learning · Computer Science 2024-02-27 Soobin Um , Suhyeon Lee , Jong Chul Ye

We tackle the problem of sampling from intractable high-dimensional density functions, a fundamental task that often appears in machine learning and statistics. We extend recent sampling-based approaches that leverage controlled stochastic…

Machine Learning · Computer Science 2024-03-12 Dinghuai Zhang , Ricky T. Q. Chen , Cheng-Hao Liu , Aaron Courville , Yoshua Bengio

This paper proposes a new unsupervised audio-visual speech enhancement (AVSE) approach that combines a diffusion-based audio-visual speech generative model with a non-negative matrix factorization (NMF) noise model. First, the diffusion…

Sound · Computer Science 2025-01-16 Jean-Eudes Ayilo , Mostafa Sadeghi , Romain Serizel , Xavier Alameda-Pineda

Diffusion models have become a leading paradigm in generative AI, with score estimation via denoising score matching as a central component. While recent theory provides strong statistical guarantees, it typically relies on…

Machine Learning · Computer Science 2026-04-21 Yinbin Han , Meisam Razaviyayn , Renyuan Xu

Denoising diffusion probabilistic models (DDPMs) have achieved impressive performance on various image generation tasks, including image super-resolution. By learning to reverse the process of gradually diffusing the data distribution into…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Kai Zhao , Alex Ling Yu Hung , Kaifeng Pang , Haoxin Zheng , Kyunghyun Sung

This paper studies stable learning methods for generative models that enable high-quality data generation. Noise injection is commonly used to stabilize learning. However, selecting a suitable noise distribution is challenging.…

Machine Learning · Statistics 2024-10-29 Yoshitaka Koike , Takumi Nakagawa , Hiroki Waida , Takafumi Kanamori

Diffusion models trained on different, non-overlapping subsets of a dataset often produce strikingly similar outputs when given the same noise seed. We trace this consistency to a simple linear effect: the shared Gaussian statistics across…

Machine Learning · Computer Science 2026-02-04 Binxu Wang , Jacob Zavatone-Veth , Cengiz Pehlevan

Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used to generate samples from Gaussian noise. However, real world data often takes place in discrete-state…

Machine Learning · Computer Science 2023-05-19 Javier E Santos , Zachary R. Fox , Nicholas Lubbers , Yen Ting Lin

Classical diffusion models typically rely on isotropic Gaussian noise, treating all regions uniformly and overlooking structural information important for high-quality generation. We introduce an edge-preserving diffusion process that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jente Vandersanden , Sascha Holl , Xingchang Huang , Gurprit Singh

Score-based model research in the last few years has produced state of the art generative models by employing Gaussian denoising score-matching (DSM). However, the Gaussian noise assumption has several high-dimensional limitations,…

Machine Learning · Computer Science 2022-04-13 Jacob Deasy , Nikola Simidjievski , Pietro Liò

Low-light photography produces images with low signal-to-noise ratios due to limited photons. In such conditions, common approximations like the Gaussian noise model fall short, and many denoising techniques fail to remove noise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Liying Lu , Raphaël Achddou , Sabine Süsstrunk

Noise is one of the primary sources of interference in seismic exploration. Many authors have proposed various methods to remove noise from seismic data; however, in the face of strong noise conditions, satisfactory results are often not…

Geophysics · Physics 2024-04-04 Junheng Peng , Yong Li , Yingtian Liu , Zhangquan Liao

As one of the most popular and sought-after generative models in the recent years, diffusion models have sparked the interests of many researchers and steadily shown excellent advantage in various generative tasks such as image synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Zhiyuan Ma , Yuzhu Zhang , Guoli Jia , Liangliang Zhao , Yichao Ma , Mingjie Ma , Gaofeng Liu , Kaiyan Zhang , Jianjun Li , Bowen Zhou

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

Statistical Mechanics · Physics 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

Recently, research on denoising diffusion models has expanded its application to the field of image restoration. Traditional diffusion-based image restoration methods utilize degraded images as conditional input to effectively guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zhenning Shi , Haoshuai Zheng , Chen Xu , Changsheng Dong , Bin Pan , Xueshuo Xie , Along He , Tao Li , Huazhu Fu