English
Related papers

Related papers: A Note on the Convergence of Denoising Diffusion P…

200 papers

Diffusion models, which convert noise into new data instances by learning to reverse a Markov diffusion process, have become a cornerstone in contemporary generative modeling. While their practical power has now been widely recognized, the…

Machine Learning · Statistics 2024-03-08 Gen Li , Yuting Wei , Yuxin Chen , Yuejie Chi

We derive a minimalist but powerful deterministic denoising-diffusion model. While denoising diffusion has shown great success in many domains, its underlying theory remains largely inaccessible to non-expert users. Indeed, an understanding…

Graphics · Computer Science 2023-05-08 Eric Heitz , Laurent Belcour , Thomas Chambon

In this paper we analyse a class of nonlinear cross-diffusion systems for two species with local repulsive interactions that exhibit a formal gradient flow structure with respect to the Wasserstein metric. We show that systems where the…

Analysis of PDEs · Mathematics 2019-06-11 M. Burger , J. A. Carrillo , J. -F. Pietschmann , M. Schmidtchen

In the field of modern high-energy physics research, there is a growing emphasis on utilizing deep learning techniques to optimize event simulation, thereby expanding the statistical sample size for more accurate physical analysis.…

Computational Physics · Physics 2025-06-16 Chu-Cheng Pan , Xiang Dong , Yu-Chang Sun , Ao-Yan Cheng , Ao-Bo Wang , Yu-Xuan Hu , Hao Cai

While the asymptotic normality of the maximum likelihood estimator under regularity conditions is long established, this paper derives explicit bounds for the bounded Wasserstein distance between the distribution of the maximum likelihood…

Statistics Theory · Mathematics 2016-09-29 Andreas Anastasiou , Gesine Reinert

Diffusion-based generative models are machine learning models that use diffusion processes to learn the probability distribution of high-dimensional data. In recent years, they have become extremely successful in generating multimedia…

Disordered Systems and Neural Networks · Physics 2025-02-12 Stefano Bae , Enzo Marinari , Federico Ricci-Tersenghi

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

Machine Learning · Statistics 2023-06-01 Titouan Vayer , Rémi Gribonval

Diffusion models generate high-quality synthetic data. They operate by defining a continuous-time forward process which gradually adds Gaussian noise to data until fully corrupted. The corresponding reverse process progressively "denoises"…

We consider a sequence of identically independently distributed random samples from an absolutely continuous probability measure in one dimension with unbounded density. We establish a new rate of convergence of the $\infty-$Wasserstein…

Probability · Mathematics 2018-08-03 Anning Liu , Jian-Guo Liu , Yulong Lu

This work discusses how to derive upper bounds for the expected generalisation error of supervised learning algorithms by means of the chaining technique. By developing a general theoretical framework, we establish a duality between…

Machine Learning · Statistics 2022-07-01 Eugenio Clerico , Amitis Shidani , George Deligiannidis , Arnaud Doucet

The Wasserstein distance between mixing measures has come to occupy a central place in the statistical analysis of mixture models. This work proposes a new canonical interpretation of this distance and provides tools to perform inference on…

Statistics Theory · Mathematics 2024-09-10 Xin Bing , Florentina Bunea , Jonathan Niles-Weed

Despite of its importance for safe machine learning, uncertainty quantification for neural networks is far from being solved. State-of-the-art approaches to estimate neural uncertainties are often hybrid, combining parametric models with…

Machine Learning · Computer Science 2021-12-03 Joachim Sicking , Maram Akila , Maximilian Pintz , Tim Wirtz , Asja Fischer , Stefan Wrobel

Many applications in machine learning involve data represented as probability distributions. The emergence of such data requires radically novel techniques to design tractable gradient flows on probability distributions over this type of…

Machine Learning · Computer Science 2025-06-10 Clément Bonet , Christophe Vauthier , Anna Korba

This short note is on a property of the $\mathcal{W}_2$ Wasserstein distance which indicates that independent elliptical distributions minimize their $\mathcal{W}_2$ Wasserstein distance from given independent elliptical distributions with…

Statistics Theory · Mathematics 2020-12-08 Song Fang , Quanyan Zhu

Deep neural networks achieve superior performance in semantic segmentation, but are limited to a predefined set of classes, which leads to failures when they encounter unknown objects in open-world scenarios. Recognizing and segmenting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Arnold Brosch , Abdelrahman Eldesokey , Michael Felsberg , Kira Maag

Denoising diffusion models are a class of generative models which have recently achieved state-of-the-art results across many domains. Gradual noise is added to the data using a diffusion process, which transforms the data distribution into…

Machine Learning · Statistics 2024-06-28 Francisco Vargas , Teodora Reu , Anna Kerekes , Michael M Bronstein

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

Optimization and Control · Mathematics 2022-10-14 Yibo Zeng , Henry Lam

We investigate long-time behaviors of empirical measures associated with subordinated Dirichlet diffusion processes on a compact Riemannian manifold $M$ with boundary $\partial M$ to some reference measure, under the quadratic Wasserstein…

Probability · Mathematics 2022-06-09 Huaiqian Li , Bingyao Wu

As a class of generative artificial intelligence frameworks inspired by statistical physics, diffusion models have shown extraordinary performance in synthesizing complicated data distributions through a denoising process gradually guided…

Machine Learning · Computer Science 2026-04-23 Fangjun Hu , Guangkuo Liu , Yifan F. Zhang , Xun Gao

Despite the strong predictive performance achieved by machine learning models across many application domains, assessing their trustworthiness through reliable estimates of predictive confidence remains a critical challenge. This issue…

Machine Learning · Computer Science 2026-03-25 Abolfazl Mohammadi-Seif , Carlos Soares , Rita P. Ribeiro , Ricardo Baeza-Yates