English
Related papers

Related papers: How Much is Enough? A Study on Diffusion Times in …

200 papers

With significant advancements in diffusion models, addressing the potential risks of dataset bias becomes increasingly important. Since generated outputs directly suffer from dataset bias, mitigating latent bias becomes a key factor in…

Machine Learning · Computer Science 2024-03-05 Yeongmin Kim , Byeonghu Na , Minsang Park , JoonHo Jang , Dongjun Kim , Wanmo Kang , Il-Chul Moon

Diffusion models that can generate high-quality data from randomly sampled Gaussian noises have become the mainstream generative method in both academia and industry. Are randomly sampled Gaussian noises equally good for diffusion models?…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zipeng Qi , Lichen Bai , Haoyi Xiong , Zeke Xie

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

Machine Learning · Statistics 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

This work explores the theoretical and practical foundations of denoising diffusion probabilistic models (DDPMs) and score-based generative models, which leverage stochastic processes and Brownian motion to model complex data distributions.…

Machine Learning · Computer Science 2024-12-30 Jathin Korrapati , Tanish Baranwal , Rahul Shah

Recent advances in diffusion models bring state-of-the-art performance on image generation tasks. However, empirical results from previous research in diffusion models imply an inverse correlation between density estimation and sample…

Machine Learning · Computer Science 2022-06-14 Dongjun Kim , Seungjae Shin , Kyungwoo Song , Wanmo Kang , Il-Chul Moon

We propose an efficient framework for amortized conditional inference by leveraging exact conditional score-guided diffusion models to train a non-reversible neural network as a conditional generative model. Traditional normalizing flow…

Computational Engineering, Finance, and Science · Computer Science 2025-06-24 Zezhong Zhang , Caroline Tatsuoka , Dongbin Xiu , Guannan Zhang

Score-based methods, such as diffusion models and Bayesian inverse problems, are often interpreted as learning the data distribution in the low-noise limit ($\sigma \to 0$). In this work, we propose an alternative perspective: their success…

Machine Learning · Statistics 2026-03-17 Xiang Li , Zebang Shen , Ya-Ping Hsieh , Niao He

Multi-target detection (MTD) is the problem of estimating an image from a large, noisy measurement that contains randomly translated and rotated copies of the image. Motivated by the single-particle cryo-electron microscopy technology, we…

Signal Processing · Electrical Eng. & Systems 2023-12-15 Alon Zabatani , Shay Kreymer , Tamir Bendory

Diffusion models have become a leading framework in generative modeling, yet their theoretical understanding -- especially for high-dimensional data concentrated on low-dimensional structures -- remains incomplete. This paper investigates…

Machine Learning · Computer Science 2026-04-29 Zixuan Zhang , Kaixuan Huang , Tuo Zhao , Mengdi Wang , Minshuo Chen

Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have…

Machine Learning · Computer Science 2024-06-10 Adrien Carrel

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underline noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

Machine Learning · Computer Science 2021-06-17 Eliya Nachmani , Robin San Roman , Lior Wolf

Diffusion models, emerging as powerful deep generative tools, excel in various applications. They operate through a two-steps process: introducing noise into training samples and then employing a model to convert random noise into new…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Huijie Zhang , Yifu Lu , Ismail Alkhouri , Saiprasad Ravishankar , Dogyoon Song , Qing Qu

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

Machine Learning · Computer Science 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

We consider the problem of parameter estimation for a class of continuous-time state space models. In particular, we explore the case of a partially observed diffusion, with data also arriving according to a diffusion process. Based upon a…

Computation · Statistics 2021-03-16 Alexandros Beskos , Dan Crisan , Ajay Jasra , Nikolas Kantas , Hamza Ruzayqat

Diffusion models have quickly become some of the most popular and powerful generative models for high-dimensional data. The key insight that enabled their development was the realization that access to the score -- the gradient of the…

Machine Learning · Computer Science 2025-12-01 Zhenghan Fang , Mateo Díaz , Sam Buchanan , Jeremias Sulam

Recent works have proposed incorporating heavy-tailed (HT) noise into diffusion- and flow-based generative models, with the goals of better recovering the tails of target distributions and improving generative diversity. This motivation is…

Machine Learning · Computer Science 2026-05-14 Hamza Cherkaoui , Hélène Halconruy , Antonio Ocello

Progressively applying Gaussian noise transforms complex data distributions to approximately Gaussian. Reversing this dynamic defines a generative model. When the forward noising process is given by a Stochastic Differential Equation (SDE),…

Machine Learning · Statistics 2023-04-06 Valentin De Bortoli , James Thornton , Jeremy Heng , Arnaud Doucet

Diffusion models are commonly interpreted as learning the score function, i.e., the gradient of the log-density of noisy data. However, this assumption implies that the target of learning is a conservative vector field, which is not…

Machine Learning · Computer Science 2025-09-03 An B. Vuong , Michael T. McCann , Javier E. Santos , Yen Ting Lin

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu