English
Related papers

Related papers: Dimension-Free Convergence of Diffusion Models for…

200 papers

Diffusion probabilistic models (DPMs) have emerged as a promising technique in generative modeling. The success of DPMs relies on two ingredients: time reversal of diffusion processes and score matching. In view of possibly unguaranteed…

Machine Learning · Computer Science 2024-10-15 Wenpin Tang , Hanyang Zhao

Denoising Diffusion Probabilistic Models (DDPMs) have established a new state-of-the-art in generative image synthesis, yet their deployment is hindered by significant computational overhead during inference, often requiring up to 1,000…

Machine Learning · Computer Science 2025-11-25 Srishti Gupta , Yashasvee Taiwade

Symmetric positive definite~(SPD) matrices have shown important value and applications in statistics and machine learning, such as FMRI analysis and traffic prediction. Previous works on SPD matrices mostly focus on discriminative models,…

Machine Learning · Computer Science 2023-12-14 Yunchen Li , Zhou Yu , Gaoqi He , Yunhang Shen , Ke Li , Xing Sun , Shaohui Lin

Deep Generative Models (DGMs) are widely used to create innovative designs across multiple industries, ranging from fashion to the automotive sector. In addition to generating images of high visual quality, the task of structural design…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Jiajie Fan , Laure Vuaille , Thomas Bäck , Hao Wang

Diffusion models, as a novel generative paradigm, have achieved remarkable success in various image generation tasks such as image inpainting, image-to-text translation, and video generation. Graph generation is a crucial computational task…

Machine Learning · Computer Science 2023-08-29 Chengyi Liu , Wenqi Fan , Yunqing Liu , Jiatong Li , Hang Li , Hui Liu , Jiliang Tang , Qing Li

Diffusion models approximate the denoising distribution as a Gaussian and predict its mean, whereas flow matching models reparameterize the Gaussian mean as flow velocity. However, they underperform in few-step sampling due to…

Machine Learning · Computer Science 2025-09-03 Hansheng Chen , Kai Zhang , Hao Tan , Zexiang Xu , Fujun Luan , Leonidas Guibas , Gordon Wetzstein , Sai Bi

Diffusion models benefit from instillation of task-specific information into the score function to steer the sample generation towards desired properties. Such information is coined as guidance. For example, in text-to-image synthesis, text…

Machine Learning · Computer Science 2024-03-05 Yuchen Wu , Minshuo Chen , Zihao Li , Mengdi Wang , Yuting Wei

Denoising diffusion probabilistic models (DDPMs) have been proven capable of synthesizing high-quality images with remarkable diversity when trained on large amounts of data. However, to our knowledge, few-shot image generation tasks have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

It has been recognized that the data generated by the denoising diffusion probabilistic model (DDPM) improves adversarial training. After two years of rapid development in diffusion models, a question naturally arises: can better diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Zekai Wang , Tianyu Pang , Chao Du , Min Lin , Weiwei Liu , Shuicheng Yan

We present a class of diffusion-based algorithms to draw samples from high-dimensional probability distributions given their unnormalized densities. Ideally, our methods can transport samples from a Gaussian distribution to a specified…

Machine Learning · Computer Science 2025-02-04 Anand Jerry George , Nicolas Macris

Diffusion generative models are currently the most popular generative models. However, their underlying modeling process is quite complex, and starting directly with the seminal paper Denoising Diffusion Probability Model (DDPM) can be…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Wang Zhen , Dong Yunyun

Diffusion probabilistic models have quickly become a major approach for generative modeling of images, 3D geometry, video and other domains. However, to adapt diffusion generative modeling to these domains the denoising network needs to be…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Peiye Zhuang , Samira Abnar , Jiatao Gu , Alex Schwing , Joshua M. Susskind , Miguel Ángel Bautista

Generative AI models have revolutionized various fields by enabling the creation of realistic and diverse data samples. Among these models, diffusion models have emerged as a powerful approach for generating high-quality images, text, and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Gaurav Raut , Apoorv Singh

Solving partial differential equations (PDEs) on fine spatio-temporal scales for high-fidelity solutions is critical for numerous scientific breakthroughs. Yet, this process can be prohibitively expensive, owing to the inherent complexities…

Numerical Analysis · Mathematics 2024-04-09 Yulong Lu , Wuzhe Xu

We present a novel generative approach based on Denoising Diffusion Models (DDMs), which produces high-quality image samples along with their losslessly compressed bit-stream representations. This is obtained by replacing the standard…

Image and Video Processing · Electrical Eng. & Systems 2025-07-29 Guy Ohayon , Hila Manor , Tomer Michaeli , Michael Elad

We consider the problem of clustering data points in high dimensions, i.e. when the number of data points may be much smaller than the number of dimensions. Specifically, we consider a Gaussian mixture model (GMM) with non-spherical…

Statistics Theory · Mathematics 2014-06-10 Martin Azizyan , Aarti Singh , Larry Wasserman

Diffusion models (DMs) have proven to be effective in modeling high-dimensional distributions, leading to their widespread adoption for representing complex priors in Bayesian inverse problems (BIPs). However, current DM-based posterior…

Machine Learning · Computer Science 2025-06-06 Haoxuan Chen , Yinuo Ren , Martin Renqiang Min , Lexing Ying , Zachary Izzo

Diffusion models (DMs) are one of the most widely used generative models for producing high quality images. However, a flurry of recent papers points out that DMs are least private forms of image generators, by extracting a significant…

Machine Learning · Statistics 2025-03-06 Michael F. Liu , Saiyue Lyu , Margarita Vinaroz , Mijung Park

Riemannian diffusion models draw inspiration from standard Euclidean space diffusion models to learn distributions on general manifolds. Unfortunately, the additional geometric complexity renders the diffusion transition term inexpressible…

Machine Learning · Computer Science 2023-11-01 Aaron Lou , Minkai Xu , Stefano Ermon

Despite the recent visually-pleasing results achieved, the massive computational cost has been a long-standing flaw for diffusion probabilistic models (DPMs), which, in turn, greatly limits their applications on resource-limited platforms.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Xingyi Yang , Daquan Zhou , Jiashi Feng , Xinchao Wang