English
Related papers

Related papers: Minimax Optimality of Score-based Diffusion Models…

200 papers

Generated images of score-based models can suffer from errors in their spatial means, an effect, referred to as a color shift, which grows for larger images. This paper investigates a previously-introduced approach to mitigate color shifts…

Machine Learning · Computer Science 2023-11-30 Katherine Deck , Tobias Bischoff

Sampling in score-based diffusion models can be performed by solving either a reverse-time stochastic differential equation (SDE) parameterized by an arbitrary time-dependent stochasticity parameter or a probability flow ODE, corresponding…

Machine Learning · Computer Science 2025-07-31 Bernardo P. Schaeffer , Ricardo M. S. Rosa , Glauco Valle

Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and…

Machine Learning · Computer Science 2025-09-23 Stefano Bruno , Sotirios Sabanis

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

Machine Learning · Computer Science 2025-11-14 Eliot Beyler , Francis Bach

The diffusion model has shown remarkable success in computer vision, but it remains unclear whether the ODE-based probability flow or the SDE-based diffusion model is more superior and under what circumstances. Comparing the two is…

Machine Learning · Computer Science 2023-11-08 Yu Cao , Jingrun Chen , Yixin Luo , Xiang Zhou

Despite the widespread adoption of deterministic samplers in diffusion models (DMs), their potential limitations remain largely unexplored. In this paper, we identify collapse errors, a previously unrecognized phenomenon in ODE-based…

Machine Learning · Computer Science 2025-08-25 Yi Zhang , Zhenyu Liao , Jingfeng Wu , Difan Zou

Detecting out-of-distribution (OOD) inputs is pivotal for deploying safe vision systems in open-world environments. We revisit diffusion models, not as generators, but as universal perceptual templates for OOD detection. This research…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Lemar Abdi , Amaan Valiuddin , Francisco Caetano , Christiaan Viviers , Fons van der Sommen

Given an observation $\mathbf Y \in \mathbb{R}^{d_1\times d_2}$ from the model $\mathbf Y = \mathbf X + \mathbf E$ where $\mathbf X$ is constant and $\mathbf E$ has i.i.d. $N(0,1)$ entries, we consider the problem of detecting a planted…

Statistics Theory · Mathematics 2026-05-20 Parker Knight , Julien Chhor

Score-based generative models are a popular class of generative modelling techniques relying on stochastic differential equations (SDE). From their inception, it was realized that it was also possible to perform generation using ordinary…

Machine Learning · Statistics 2024-02-13 Joe Benton , George Deligiannidis , Arnaud Doucet

Diffusion models have achieved great success in generating high-dimensional samples across various applications. While the theoretical guarantees for continuous-state diffusion models have been extensively studied, the convergence analysis…

Machine Learning · Computer Science 2025-04-15 Zikun Zhang , Zixiang Chen , Quanquan Gu

Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference times and cumbersome hyperparameter tuning. While pretrained diffusion models can be reused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Julio Oscanoa , Irmak Sivgin , Cagan Alkan , Daniel Ennis , John Pauly , Mert Pilanci , Shreyas Vasanawala

In this work, we propose a novel framework for estimating the dimension of the data manifold using a trained diffusion model. A diffusion model approximates the score function i.e. the gradient of the log density of a noise-corrupted…

Machine Learning · Computer Science 2023-05-26 Jan Stanczuk , Georgios Batzolis , Teo Deveney , Carola-Bibiane Schönlieb

Score-based generative models have excellent performance in terms of generation quality and likelihood. They model the data distribution by matching a parameterized score network with first-order data score functions. The score network can…

Machine Learning · Statistics 2022-06-28 Cheng Lu , Kaiwen Zheng , Fan Bao , Jianfei Chen , Chongxuan Li , Jun Zhu

The performance of kernel density estimators is usually studied via Taylor expansions and asymptotic approximation arguments, in which the bandwidth parameter tends to zero with increasing sample size. In contrast, this paper focusses…

Statistics Theory · Mathematics 2026-02-25 Nils Lid Hjort , Nikolai G. Ushakov

Finite difference method as a popular numerical method has been widely used to solve fractional diffusion equations. In the general spatial error analyses, an assumption $u\in C^{4}(\bar{\Omega})$ is needed to preserve $\mathcal{O}(h^{2})$…

Numerical Analysis · Mathematics 2023-02-07 Daxin Nie , Jing Sun , Weihua Deng

Recent advances in diffusion models have demonstrated their remarkable ability to capture complex image distributions, but the geometric properties of the learned data manifold remain poorly understood. We address this gap by introducing a…

Machine Learning · Computer Science 2025-10-13 Simone Azeglio , Arianna Di Bernardo

Translational diffusion coefficients are routinely estimated from molecular dynamics simulations. Linear fits to mean squared displacement (MSD) curves have become the de facto standard, from simple liquids to complex biomacromolecules.…

Computational Physics · Physics 2020-11-20 Jakob Tómas Bullerjahn , Sören von Bülow , Gerhard Hummer

We investigate the approximation and estimation rates of conditional diffusion transformers (DiTs) with classifier-free guidance. We present a comprehensive analysis for ``in-context'' conditional DiTs under four common data assumptions. We…

Machine Learning · Statistics 2024-11-27 Jerry Yao-Chieh Hu , Weimin Wu , Yi-Chen Lee , Yu-Chao Huang , Minshuo Chen , Han Liu

We noisily observe solutions of an ordinary differential equation $\dot u = f(u)$ at given times, where $u$ lives in a $d$-dimensional state space. The model function $f$ is unknown and belongs to a H\"older-type smoothness class with…

Statistics Theory · Mathematics 2024-07-23 Christof Schötz , Maximilian Siebel

The advent of large-scale inference has spurred reexamination of conventional statistical thinking. In a Gaussian model for $n$ many $z$-scores with at most $k < \frac{n}{2}$ nonnulls, Efron suggests estimating the location and scale…

Statistics Theory · Mathematics 2025-01-15 Subhodh Kotekal , Chao Gao