English
Related papers

Related papers: Improving the Euclidean Diffusion Generation of Ma…

200 papers

Diffusion models have achieved huge empirical success in data generation tasks. Recently, some efforts have been made to adapt the framework of diffusion models to discrete state space, providing a more natural approach for modeling…

Machine Learning · Statistics 2024-02-15 Hongrui Chen , Lexing Ying

In the realm of text-to-3D generation, utilizing 2D diffusion models through score distillation sampling (SDS) frequently leads to issues such as blurred appearances and multi-faced geometry, primarily due to the intrinsically noisy nature…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Pengsheng Guo , Hans Hao , Adam Caccavale , Zhongzheng Ren , Edward Zhang , Qi Shan , Aditya Sankar , Alexander G. Schwing , Alex Colburn , Fangchang Ma

We introduce diffusion geometry as a new framework for geometric and topological data analysis. Diffusion geometry uses the Bakry-Emery $\Gamma$-calculus of Markov diffusion operators to define objects from Riemannian geometry on a wide…

Metric Geometry · Mathematics 2024-07-03 Iolo Jones

Diffusion probabilistic models have achieved remarkable success in generative tasks across diverse data types. While recent studies have explored alternative degradation processes beyond Gaussian noise, this paper bridges two key diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Hao-Chien Hsueh , Chi-En Yen , Wen-Hsiao Peng , Ching-Chun Huang

Diffusion models are routinely guided in practice by combining multiple score fields, yet the mathematical structure of score mixing is still poorly understood. We study the small-time generation dynamics driven by mixed scores $$…

Optimization and Control · Mathematics 2026-05-13 Kang Liu , Enrique Zuazua

Denoising is intuitively related to projection. Indeed, under the manifold hypothesis, adding random noise is approximately equivalent to orthogonal perturbation. Hence, learning to denoise is approximately learning to project. In this…

Machine Learning · Computer Science 2024-06-04 Frank Permenter , Chenyang Yuan

Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential…

Machine Learning · Computer Science 2026-05-29 Jiayi Fu , Yuxia Wang

Diffusion models have demonstrated remarkable performance in generating high-dimensional samples across domains such as vision, language, and the sciences. Although continuous-state diffusion models have been extensively studied both…

Machine Learning · Computer Science 2026-02-17 Aadithya Srikanth , Mudit Gaur , Vaneet Aggarwal

We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structure to be incorporated…

Machine Learning · Statistics 2025-07-10 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang , Wei Zhu

Diffusion models have emerged as powerful deep generative techniques, producing high-quality and diverse samples in applications in various domains including audio. While existing reviews provide overviews, there remains limited in-depth…

Sound · Computer Science 2026-01-16 Ge Zhu , Yutong Wen , Zhiyao Duan

Sampling based on score diffusions has led to striking empirical results, and has attracted considerable attention from various research communities. It depends on availability of (approximate) Stein score functions for various levels of…

Statistics Theory · Mathematics 2026-01-01 M. J. Wainwright

Classical paradigms for distributed learning, such as federated or decentralized gradient descent, employ consensus mechanisms to enforce homogeneity among agents. While these strategies have proven effective in i.i.d. scenarios, they can…

Machine Learning · Computer Science 2023-04-18 Shreya Wadehra , Roula Nassif , Stefan Vlaski

Krylov subspace, which is generated by multiplying a given vector by the matrix of a linear transformation and its successive powers, has been extensively studied in classical optimization literature to design algorithms that converge…

Machine Learning · Computer Science 2024-02-20 Hyungjin Chung , Suhyeon Lee , Jong Chul Ye

Inference-time scaling has achieved remarkable success in language models, yet its adaptation to diffusion models remains underexplored. We observe that the efficacy of recent Sequential Monte Carlo (SMC)-based methods largely stems from…

Machine Learning · Computer Science 2025-08-19 Xun Su , Jianming Huang , Yang Yusen , Zhongxi Fang , Hiroyuki Kasai

Score-based (denoising diffusion) generative models have recently gained a lot of success in generating realistic and diverse data. These approaches define a forward diffusion process for transforming data to noise and generate data by…

Machine Learning · Computer Science 2021-06-01 Alexia Jolicoeur-Martineau , Ke Li , Rémi Piché-Taillefer , Tal Kachman , Ioannis Mitliagkas

Diffusion models have achieved great success in generating high-dimensional samples across various applications. While the theoretical guarantees for continuous-state diffusion models have been extensively studied, the convergence analysis…

Machine Learning · Computer Science 2025-04-15 Zikun Zhang , Zixiang Chen , Quanquan Gu

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

Generative models can be categorized into two types: explicit generative models that define explicit density forms and allow exact likelihood inference, such as score-based diffusion models (SDMs) and normalizing flows; implicit generative…

Machine Learning · Statistics 2023-07-06 Jingwei Zhang , Han Shi , Jincheng Yu , Enze Xie , Zhenguo Li

Diffusion models for continuous state spaces based on Gaussian noising processes are now relatively well understood from both practical and theoretical perspectives. In contrast, results for diffusion models on discrete state spaces remain…

Machine Learning · Computer Science 2026-04-02 Giovanni Conforti , Alain Durmus , Le-Tuyet-Nhi Pham , Gael Raoul

Recent advances in implicit neural representations have achieved impressive results by sampling and fusing individual points along sampling rays in the sampling space. However, due to the explosively growing sampling space, finely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Yuhan Ding , Fukun Yin , Jiayuan Fan , Hui Li , Xin Chen , Wen Liu , Chongshan Lu , Gang YU , Tao Chen