English
Related papers

Related papers: Diffusion models for Gaussian distributions: Exact…

200 papers

We introduce an ordinary differential equation (ODE) based deep generative method for learning conditional distributions, named Conditional F\"ollmer Flow. Starting from a standard Gaussian distribution, the proposed flow could approximate…

Machine Learning · Statistics 2025-10-14 Jinyuan Chang , Zhao Ding , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang

This article studies a general divide-and-conquer algorithm for approximating continuous one-dimensional probability distributions with finite mean. The article presents a numerical study that compares pre-existing approximation schemes…

Diffusion models have become fundamental tools for modeling data distributions in machine learning. Despite their success, these models face challenges when generating data with extreme brightness values, as evidenced by limitations…

Machine Learning · Statistics 2026-04-10 Takuro Kutsuna

The diffusion approximation of stochastic gradient descent (SGD) in current literature is only valid on a finite time interval. In this paper, we establish the uniform-in-time diffusion approximation of SGD, by only assuming that the…

Machine Learning · Statistics 2022-07-12 Lei Li , Yuliang Wang

Diffusion models have achieved remarkable success in generating samples from unknown data distributions. Most popular stochastic differential equation-based diffusion models perturb the target distribution by adding Gaussian noise,…

Machine Learning · Statistics 2026-05-20 Wenpin Tang , Nizar Touzi , Zikun Zhang , Xun Yu Zhou

As diffusion models become increasingly popular, the misuse of copyrighted and private images has emerged as a major concern. One promising solution to mitigate this issue is identifying the contribution of specific training samples in…

Machine Learning · Computer Science 2025-03-24 Jinxu Lin , Linwei Tao , Minjing Dong , Chang Xu

Recently, diffusion probabilistic models (DPMs) have achieved promising results in diverse generative tasks. A typical DPM framework includes a forward process that gradually diffuses the data distribution and a reverse process that…

Machine Learning · Computer Science 2023-10-31 Tianyu Pang , Cheng Lu , Chao Du , Min Lin , Shuicheng Yan , Zhijie Deng

In recent years we have witnessed a growth in mathematics for deep learning, which has been used to solve inverse problems of partial differential equations (PDEs). However, most deep learning-based inversion methods either require paired…

Numerical Analysis · Mathematics 2024-04-23 Enze Jiang , Jishen Peng , Zheng Ma , Xiong-Bin Yan

Out-of-distribution (OOD) detection is critical for the safe deployment of machine learning systems in safety-sensitive domains. Diffusion models have recently emerged as powerful generative models, capable of capturing complex data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Shirin Shoushtari , Yi Wang , Xiao Shi , M. Salman Asif , Ulugbek S. Kamilov

Machine learning methods, such as diffusion models, are widely explored as a promising way to accelerate high-fidelity fluid dynamics computation via a super-resolution process from faster-to-compute low-fidelity input. However, existing…

Computational Engineering, Finance, and Science · Computer Science 2025-12-24 Ruoyan Li , Zijie Huang , Haixin Wang , Guancheng Wan , Yizhou Sun , Wei Wang

We study the problem of efficiently detecting Out-of-Distribution (OOD) samples at test time in supervised and unsupervised learning contexts. While ML models are typically trained under the assumption that training and test data stem from…

Machine Learning · Computer Science 2024-05-13 Alberto Caron , Chris Hicks , Vasilios Mavroudis

Score-based diffusion models generate samples from an unknown target distribution using a time-reversed diffusion process. While such models represent state-of-the-art approaches in industrial applications such as artificial image…

Machine Learning · Computer Science 2026-02-09 Adrian Baule

Diffusion models have demonstrated great potential in generating high-quality content for images, natural language, protein domains, etc. However, how to perform user-preferred targeted generation via diffusion models with only black-box…

Machine Learning · Statistics 2024-06-11 Yueming Lyu , Kim Yong Tan , Yew Soon Ong , Ivor W. Tsang

While the mathematical foundations of score-based generative models are increasingly well understood for unconstrained Euclidean spaces, many practical applications involve data restricted to bounded domains. This paper provides a…

Statistics Theory · Mathematics 2026-03-26 Asbjørn Holk , Claudia Strauch , Lukas Trottner

Score-based diffusion models currently constitute the state of the art in continuous generative modeling. These methods are typically formulated via overdamped or underdamped Ornstein--Uhlenbeck-type stochastic differential equations, in…

Machine Learning · Computer Science 2025-12-22 Herlock Rahimi

While diffusion models have shown great success in image generation, their noise-inverting generative process does not explicitly consider the structure of images, such as their inherent multi-scale nature. Inspired by diffusion models and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Severi Rissanen , Markus Heinonen , Arno Solin

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

Machine Learning · Computer Science 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

Diffusion-based generative processes, formulated as differential equation solving, frequently balance computational speed with sample quality. Our theoretical investigation of ODE- and SDE-based solvers reveals complementary weaknesses: ODE…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Ruoyu Wang , Beier Zhu , Junzhi Li , Liangyu Yuan , Chi Zhang

Diffusion models have become a successful approach for solving various image inverse problems by providing a powerful diffusion prior. Many studies tried to combine the measurement into diffusion by score function replacement, matrix…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Hanyu Chen , Zhixiu Hao , Liying Xiao

Efficiently aggregating data from different sources is a challenging problem, particularly when samples from each source are distributed differently. These differences can be inherent to the inference task or present for other reasons:…

Machine Learning · Computer Science 2017-11-15 Matthew Staib , Sebastian Claici , Justin Solomon , Stefanie Jegelka