English
Related papers

Related papers: Structural and Convergence Analysis of Discrete-Ti…

200 papers

Diffusion or score-based models recently showed high performance in image generation. They rely on a forward and a backward stochastic differential equations (SDE). The sampling of a data distribution is achieved by numerically solving the…

Machine Learning · Computer Science 2025-06-04 Emile Pierret , Bruno Galerne

Diffusion models have recently emerged as a powerful framework for generative modeling. They consist of a forward process that perturbs input data with Gaussian white noise and a reverse process that learns a score function to generate…

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

Score-based generative models (SGMs) have revolutionized the field of generative modeling, achieving unprecedented success in generating realistic and diverse content. Despite empirical advances, the theoretical basis for why optimizing the…

Machine Learning · Computer Science 2024-08-30 Gen Li , Yuling Yan

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

We consider the problem of parameter estimation for a class of continuous-time state space models. In particular, we explore the case of a partially observed diffusion, with data also arriving according to a diffusion process. Based upon a…

Computation · Statistics 2021-03-16 Alexandros Beskos , Dan Crisan , Ajay Jasra , Nikolas Kantas , Hamza Ruzayqat

Time series forecasting models are becoming increasingly prevalent due to their critical role in decision-making across various domains. However, most existing approaches represent the coupled temporal patterns, often neglecting the…

Machine Learning · Computer Science 2025-09-26 Jintao Zhang , Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Daoyu Wang

Nowadays, denoising diffusion probabilistic models have been adapted for many image segmentation tasks. However, existing end-to-end models have already demonstrated remarkable capabilities. Rather than using denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shi Zhenning , Dong Changsheng , Xie Xueshuo , Pan Bin , He Along , Li Tao

Inverse problems exist in many disciplines of science and engineering. In computer vision, for example, tasks such as inpainting, deblurring, and super resolution can be effectively modeled as inverse problems. Recently, denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Shayan Mohajer Hamidi , En-Hui Yang

We consider the problem of simulating diffusion bridges, which are diffusion processes that are conditioned to initialize and terminate at two given states. The simulation of diffusion bridges has applications in diverse scientific fields…

Computation · Statistics 2025-06-19 Jeremy Heng , Valentin De Bortoli , Arnaud Doucet , James Thornton

We study a discrete denoising diffusion framework that integrates a sample-efficient estimator of single-site conditionals with round-robin noising and denoising dynamics for generative modeling over discrete state spaces. Rather than…

Machine Learning · Computer Science 2026-03-02 Karthik Elamvazhuthi , Abhijith Jayakumar , Andrey Y. Lokhov

Denoising Diffusion Probabilistic Models (DDPMs) have achieved impressive performance on various generation tasks. By modeling the reverse process of gradually diffusing the data distribution into a Gaussian distribution, generating a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Zhaoyang Lyu , Xudong XU , Ceyuan Yang , Dahua Lin , Bo Dai

Out-of-distribution detection is crucial to the safe deployment of machine learning systems. Currently, unsupervised out-of-distribution detection is dominated by generative-based approaches that make use of estimates of the likelihood or…

Score-based diffusion models generate new samples by learning the score function associated with a diffusion process. While the effectiveness of these models can be theoretically explained using differential equations related to the…

Machine Learning · Computer Science 2026-01-21 Doheon Kim

Diffusion models have garnered significant attention since they can effectively learn complex multivariate Gaussian distributions, resulting in diverse, high-quality outcomes. They introduce Gaussian noise into training data and reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Vidya Prasad , Chen Zhu-Tian , Anna Vilanova , Hanspeter Pfister , Nicola Pezzotti , Hendrik Strobelt

Discrete diffusion models are increasingly competitive for language modeling, yet it remains unclear how their denoising objectives organize learning. Although these objectives target the full data distribution, we show that the exact…

Machine Learning · Computer Science 2026-05-15 Adrian Müller , Antoine Gonon , Zebang Shen , Ya-Ping Hsieh , Niao He

Progressively applying Gaussian noise transforms complex data distributions to approximately Gaussian. Reversing this dynamic defines a generative model. When the forward noising process is given by a Stochastic Differential Equation (SDE),…

Machine Learning · Statistics 2023-04-06 Valentin De Bortoli , James Thornton , Jeremy Heng , Arnaud Doucet

The success of diffusion models has driven interest in performing conditional sampling via training-free guidance of the denoising process to solve image restoration and other inverse problems. A popular class of methods, based on Diffusion…

Machine Learning · Statistics 2025-06-17 Gregory Bellchambers

Diffusion models now set the benchmark in high-fidelity generative sampling, yet they can, in principle, be prone to memorization. In this case, their learned score overfits the finite dataset so that the reverse-time SDE samples are mostly…

Machine Learning · Computer Science 2025-05-30 Franck Gabriel , François Ged , Maria Han Veiga , Emmanuel Schertzer

The denoising diffusion model has recently emerged as a powerful generative technique, capable of transforming noise into meaningful data. While theoretical convergence guarantees for diffusion models are well established when the target…

Machine Learning · Computer Science 2025-03-28 Yuchen Liang , Peizhong Ju , Yingbin Liang , Ness Shroff